2024-04-24T23:44:47.638 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T23:44:47.639 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222 --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --verbose -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/orig.config.yaml 2024-04-24T23:44:47.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T23:44:47.777 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222 branch: squid description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672222' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJxxWEyA5ASCzp+iq+DL+CyeReph4hqXrkUosLqHO3it2BtXuxxOyrqkRuxZafeHsQpZElfzjFT21FraGaJkK3M= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGM1LImTnbwZ6sGA9gZBaqlqf3D0W1smXSvcL37ueEU3Y6gUSRE1jhYvCG+M3/dIYPjwbEbP3yFt07YUxXz5Yw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T23:44:47.777 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-24T23:44:47.778 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-24T23:44:47.778 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T23:44:47.780 INFO:teuthology.task.internal:Checking packages... 2024-04-24T23:44:47.805 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-24T23:44:47.805 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T23:44:47.805 INFO:teuthology.packaging:ref: None 2024-04-24T23:44:47.805 INFO:teuthology.packaging:tag: None 2024-04-24T23:44:47.805 INFO:teuthology.packaging:branch: squid 2024-04-24T23:44:47.805 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:44:47.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-24T23:44:48.022 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-24T23:44:48.023 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T23:44:48.029 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T23:44:48.029 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T23:44:48.066 INFO:teuthology.task.internal:Saving configuration 2024-04-24T23:44:48.084 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T23:44:48.091 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T23:44:48.117 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 23:39:30.718211', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJxxWEyA5ASCzp+iq+DL+CyeReph4hqXrkUosLqHO3it2BtXuxxOyrqkRuxZafeHsQpZElfzjFT21FraGaJkK3M='} 2024-04-24T23:44:48.140 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 23:39:30.716906', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGM1LImTnbwZ6sGA9gZBaqlqf3D0W1smXSvcL37ueEU3Y6gUSRE1jhYvCG+M3/dIYPjwbEbP3yFt07YUxXz5Yw='} 2024-04-24T23:44:48.141 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T23:44:48.147 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-24T23:44:48.147 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-24T23:44:48.148 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T23:44:48.233 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd91eb160d0>, signals=[15]) 2024-04-24T23:44:48.234 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T23:44:48.242 INFO:teuthology.task.internal:Opening connections... 2024-04-24T23:44:48.242 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-04-24T23:44:48.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:44:48.326 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-04-24T23:44:48.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:44:48.408 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T23:44:48.418 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-04-24T23:44:48.435 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-04-24T23:44:48.436 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-04-24T23:44:48.492 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T23:44:48.493 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T23:44:48.494 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T23:44:48.494 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-04-24T23:44:48.520 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-04-24T23:44:48.538 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-04-24T23:44:48.539 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-04-24T23:44:48.596 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-04-24T23:44:48.596 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2024-04-24T23:44:48.596 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T23:44:48.597 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T23:44:48.598 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-04-24T23:44:48.645 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T23:44:48.656 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T23:44:48.686 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T23:44:48.686 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-04-24T23:44:48.689 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-04-24T23:44:48.705 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T23:44:48.720 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T23:44:48.720 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-04-24T23:44:48.745 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-04-24T23:44:48.772 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T23:44:48.832 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T23:44:48.848 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-24T23:44:48.848 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-24T23:44:48.848 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-24T23:44:48.848 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T23:44:48.849 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T23:44:48.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:44:48.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-24T23:44:48.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:44:48.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-24T23:44:49.035 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T23:44:49.035 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-24T23:44:49.035 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-04-24T23:44:49.053 INFO:teuthology.orchestra.run.smithi155.stdout:5.14.0-437.el9.x86_64 2024-04-24T23:44:49.053 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T23:44:49.053 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-24T23:44:49.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum upgrade -y linux-firmware 2024-04-24T23:44:49.123 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T23:44:49.123 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-24T23:44:49.123 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-24T23:44:49.141 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-437.el9.x86_64 2024-04-24T23:44:49.141 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T23:44:49.141 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-24T23:44:49.141 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum upgrade -y linux-firmware 2024-04-24T23:44:51.666 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.0 MB 00:00 2024-04-24T23:44:51.703 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.0 MB 00:00 2024-04-24T23:44:53.404 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-04-24T23:44:54.367 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-24T23:44:57.771 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.2 MB 00:00 2024-04-24T23:44:58.751 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.2 MB 00:00 2024-04-24T23:44:59.413 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-04-24T23:45:01.226 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-04-24T23:45:02.294 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-24T23:45:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 21 MB 00:03 2024-04-24T23:45:07.385 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-24T23:45:07.639 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-24T23:45:09.357 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-04-24T23:45:09.358 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-04-24T23:45:09.358 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-04-24T23:45:09.469 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-24T23:45:09.470 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T23:45:09.614 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-24T23:45:09.616 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-24T23:45:09.616 DEBUG:teuthology.orchestra.run.smithi096:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-24T23:45:09.617 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-24T23:45:09.617 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-24T23:45:09.618 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi096.front.sepia.ceph.com to complete... 2024-04-24T23:45:09.713 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-24T23:45:09.713 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T23:45:09.927 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-24T23:45:09.927 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-24T23:45:09.930 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi155.front.sepia.ceph.com to complete... 2024-04-24T23:45:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24 23:45:28 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-24T23:45:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:FINISHED --2024-04-24 23:45:28-- 2024-04-24T23:45:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:Total wall clock time: 19s 2024-04-24T23:45:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:Downloaded: 1 files, 341M in 19s (18.3 MB/s) 2024-04-24T23:45:28.623 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-24T23:45:28.623 DEBUG:teuthology.orchestra.run.smithi096:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-24T23:45:30.709 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying... ######################################## 2024-04-24T23:45:30.848 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing... ######################################## 2024-04-24T23:45:30.948 INFO:teuthology.orchestra.run.smithi096.stdout:Updating / installing... 2024-04-24T23:45:33.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24 23:45:33 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-24T23:45:33.618 INFO:teuthology.orchestra.run.smithi155.stderr:FINISHED --2024-04-24 23:45:33-- 2024-04-24T23:45:33.618 INFO:teuthology.orchestra.run.smithi155.stderr:Total wall clock time: 24s 2024-04-24T23:45:33.618 INFO:teuthology.orchestra.run.smithi155.stderr:Downloaded: 1 files, 341M in 23s (14.8 MB/s) 2024-04-24T23:45:33.621 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-24T23:45:33.621 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-24T23:45:35.719 INFO:teuthology.orchestra.run.smithi155.stdout:Verifying... ######################################## 2024-04-24T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing... ######################################## 2024-04-24T23:45:35.968 INFO:teuthology.orchestra.run.smithi155.stdout:Updating / installing... 2024-04-24T23:45:38.837 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-24T23:45:43.913 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-24T23:46:18.231 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-24T23:46:18.232 DEBUG:teuthology.orchestra.run.smithi096:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-24T23:46:18.320 INFO:teuthology.orchestra.run.smithi096.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-24T23:46:18.321 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-24T23:46:18.322 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-24T23:46:18.323 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-24T23:46:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-24T23:46:18.325 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-24T23:46:18.326 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-24T23:46:18.327 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-24T23:46:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-24T23:46:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-24T23:46:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-24T23:46:18.331 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-24T23:46:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-24T23:46:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-24T23:46:18.334 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-24T23:46:18.335 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-24T23:46:18.336 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-24T23:46:18.336 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-24T23:46:18.337 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-24T23:46:18.338 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-24T23:46:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-24T23:46:18.340 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-24T23:46:18.341 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-24T23:46:18.342 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-24T23:46:18.343 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-24T23:46:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-24T23:46:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-24T23:46:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-24T23:46:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-24T23:46:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-24T23:46:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-24T23:46:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-24T23:46:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-24T23:46:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-24T23:46:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-24T23:46:18.346 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-24T23:46:18.347 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-24T23:46:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-24T23:46:18.349 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-24T23:46:18.350 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-24T23:46:18.351 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-24T23:46:18.352 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-24T23:46:18.353 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-24T23:46:18.354 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-24T23:46:18.355 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-24T23:46:18.356 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-24T23:46:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-24T23:46:18.358 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-24T23:46:18.359 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-24T23:46:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-24T23:46:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-24T23:46:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-24T23:46:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-24T23:46:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-24T23:46:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-24T23:46:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-24T23:46:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-24T23:46:18.368 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-24T23:46:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-24T23:46:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-24T23:46:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-24T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-24T23:46:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-24T23:46:18.374 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-24T23:46:18.375 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-24T23:46:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-24T23:46:18.377 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-24T23:46:18.378 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-24T23:46:18.379 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-24T23:46:18.380 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-24T23:46:18.381 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-24T23:46:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-24T23:46:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-24T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-24T23:46:18.385 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-24T23:46:18.386 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-24T23:46:18.387 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-24T23:46:18.388 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-24T23:46:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-24T23:46:18.390 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-24T23:46:18.391 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-24T23:46:18.392 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-24T23:46:18.393 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-24T23:46:18.394 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-24T23:46:18.395 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-24T23:46:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-24T23:46:18.397 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-24T23:46:18.398 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-24T23:46:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-24T23:46:18.400 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-24T23:46:18.401 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-24T23:46:18.402 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-24T23:46:18.403 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-24T23:46:18.404 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-24T23:46:18.405 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-24T23:46:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-24T23:46:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-24T23:46:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-24T23:46:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-24T23:46:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-24T23:46:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-24T23:46:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-24T23:46:18.413 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-24T23:46:18.414 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-24T23:46:18.415 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-24T23:46:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-24T23:46:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-24T23:46:18.418 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-24T23:46:18.419 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-24T23:46:18.420 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-24T23:46:18.421 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-24T23:46:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-24T23:46:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-24T23:46:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-24T23:46:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-24T23:46:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-24T23:46:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-24T23:46:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-24T23:46:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-24T23:46:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-24T23:46:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-24T23:46:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-24T23:46:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-24T23:46:18.434 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-24T23:46:18.435 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-24T23:46:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-24T23:46:18.437 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-24T23:46:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-24T23:46:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-24T23:46:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-24T23:46:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-24T23:46:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-24T23:46:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-24T23:46:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-24T23:46:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-24T23:46:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-24T23:46:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-24T23:46:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-24T23:46:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-24T23:46:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-24T23:46:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-24T23:46:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-24T23:46:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-24T23:46:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-24T23:46:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-24T23:46:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-24T23:46:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-24T23:46:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-24T23:46:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-24T23:46:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-24T23:46:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-24T23:46:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-24T23:46:18.463 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-24T23:46:18.464 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-24T23:46:18.465 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-24T23:46:18.466 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-24T23:46:18.467 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-24T23:46:18.467 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-24T23:46:18.467 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-24T23:46:18.467 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-24T23:46:18.467 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-24T23:46:18.467 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-24T23:46:18.467 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-24T23:46:18.467 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-24T23:46:18.467 INFO:teuthology.orchestra.run.smithi096.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-24T23:46:18.471 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:18.472 DEBUG:teuthology.orchestra.run.smithi096:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout:postinstall scriptlet (using /bin/sh): 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout:fi 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout:for file in vmlinuz System.map config; do 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout: fi 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-24T23:46:18.495 INFO:teuthology.orchestra.run.smithi096.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout:fi 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout:fi 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:18.496 INFO:teuthology.orchestra.run.smithi096.stdout:fi 2024-04-24T23:46:18.497 DEBUG:teuthology.orchestra.run.smithi096:> sudo rpm -qi grub2-tools 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:Name : grub2-tools 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:Epoch : 1 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:Version : 2.06 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:Release : 68.el9 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: x86_64 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:Group : Unspecified 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:Size : 8264254 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:License : GPLv3+ 2024-04-24T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:Packager : builder@centos.org 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:Vendor : CentOS 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:Summary : Support tools for GRUB. 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:Description : 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:hardware devices. 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stdout:This subpackage provides tools for support of all platforms. 2024-04-24T23:46:18.573 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-24T23:46:18.573 INFO:teuthology.task.kernel:Updating grub on smithi096 to boot 6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:18.573 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-24T23:46:19.213 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-04-24T23:46:20.635 INFO:teuthology.orchestra.run.smithi096.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-24T23:46:20.678 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-04-24T23:46:20.680 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-24T23:46:20.737 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.1uUVgsi7gG 2024-04-24T23:46:20.737 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1uUVgsi7gG 2024-04-24T23:46:20.806 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.1uUVgsi7gG 2024-04-24T23:46:20.941 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.1uUVgsi7gG is 6KB 2024-04-24T23:46:20.990 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.1uUVgsi7gG 2024-04-24T23:46:21.004 DEBUG:teuthology.orchestra.run.smithi096:> sudo /bin/ls /boot/loader/entries || true 2024-04-24T23:46:21.065 INFO:teuthology.orchestra.run.smithi096.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-24T23:46:21.065 INFO:teuthology.orchestra.run.smithi096.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-24T23:46:21.066 INFO:teuthology.orchestra.run.smithi096.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-24T23:46:21.066 INFO:teuthology.orchestra.run.smithi096.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-24T23:46:21.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:21.230 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-04-24T23:46:22.878 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-24T23:46:22.878 DEBUG:teuthology.orchestra.run.smithi155:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-24T23:46:22.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-24T23:46:22.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-24T23:46:22.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-24T23:46:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-24T23:46:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-24T23:46:22.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-24T23:46:22.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-24T23:46:22.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-24T23:46:22.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-24T23:46:22.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-24T23:46:22.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-24T23:46:22.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-24T23:46:22.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-24T23:46:22.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-24T23:46:22.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-24T23:46:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-24T23:46:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-24T23:46:22.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-24T23:46:22.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-24T23:46:22.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-24T23:46:22.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-24T23:46:22.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-24T23:46:22.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-24T23:46:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-24T23:46:22.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-24T23:46:22.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-24T23:46:22.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-24T23:46:22.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-24T23:46:22.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-24T23:46:22.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-24T23:46:22.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-24T23:46:22.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-24T23:46:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-24T23:46:22.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-24T23:46:22.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-24T23:46:22.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-24T23:46:22.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-24T23:46:22.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-24T23:46:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-24T23:46:23.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-24T23:46:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-24T23:46:23.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-24T23:46:23.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-24T23:46:23.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-24T23:46:23.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-24T23:46:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-24T23:46:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-24T23:46:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-24T23:46:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-24T23:46:23.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-24T23:46:23.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-24T23:46:23.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-24T23:46:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-24T23:46:23.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-24T23:46:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-24T23:46:23.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-24T23:46:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-24T23:46:23.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-24T23:46:23.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-24T23:46:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-24T23:46:23.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-24T23:46:23.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-24T23:46:23.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-24T23:46:23.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-24T23:46:23.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-24T23:46:23.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-24T23:46:23.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-24T23:46:23.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-24T23:46:23.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-24T23:46:23.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-24T23:46:23.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-24T23:46:23.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-24T23:46:23.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-24T23:46:23.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-24T23:46:23.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-24T23:46:23.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-24T23:46:23.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-24T23:46:23.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-24T23:46:23.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-24T23:46:23.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-24T23:46:23.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-24T23:46:23.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-24T23:46:23.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-24T23:46:23.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-24T23:46:23.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-24T23:46:23.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-24T23:46:23.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-24T23:46:23.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-24T23:46:23.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-24T23:46:23.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-24T23:46:23.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-24T23:46:23.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-24T23:46:23.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-24T23:46:23.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-24T23:46:23.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-24T23:46:23.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-24T23:46:23.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-24T23:46:23.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-24T23:46:23.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-24T23:46:23.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-24T23:46:23.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-24T23:46:23.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-24T23:46:23.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-24T23:46:23.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-24T23:46:23.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-24T23:46:23.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-24T23:46:23.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-24T23:46:23.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-24T23:46:23.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-24T23:46:23.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-24T23:46:23.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-24T23:46:23.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-24T23:46:23.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-24T23:46:23.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-24T23:46:23.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-24T23:46:23.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-24T23:46:23.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-24T23:46:23.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-24T23:46:23.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-24T23:46:23.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-24T23:46:23.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-24T23:46:23.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-24T23:46:23.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-24T23:46:23.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-24T23:46:23.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-24T23:46:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-24T23:46:23.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-24T23:46:23.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-24T23:46:23.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-24T23:46:23.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-24T23:46:23.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-24T23:46:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-24T23:46:23.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-24T23:46:23.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-24T23:46:23.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-24T23:46:23.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-24T23:46:23.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-24T23:46:23.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-24T23:46:23.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-24T23:46:23.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-24T23:46:23.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-24T23:46:23.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-24T23:46:23.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-24T23:46:23.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-24T23:46:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-24T23:46:23.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-24T23:46:23.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-24T23:46:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-24T23:46:23.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-24T23:46:23.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-24T23:46:23.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-24T23:46:23.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-24T23:46:23.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-24T23:46:23.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-24T23:46:23.072 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-24T23:46:23.073 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-24T23:46:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-24T23:46:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-24T23:46:23.076 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-24T23:46:23.077 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-24T23:46:23.078 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-24T23:46:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-24T23:46:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-24T23:46:23.081 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-24T23:46:23.082 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-24T23:46:23.083 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-24T23:46:23.084 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-24T23:46:23.085 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-24T23:46:23.086 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-24T23:46:23.087 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-24T23:46:23.088 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-24T23:46:23.089 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-24T23:46:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-24T23:46:23.091 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-24T23:46:23.092 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-24T23:46:23.093 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-24T23:46:23.094 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-24T23:46:23.095 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-24T23:46:23.096 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-24T23:46:23.097 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-24T23:46:23.098 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-24T23:46:23.099 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-24T23:46:23.100 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-24T23:46:23.101 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-24T23:46:23.102 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-24T23:46:23.103 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-24T23:46:23.104 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-24T23:46:23.105 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-24T23:46:23.108 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:23.108 DEBUG:teuthology.orchestra.run.smithi155:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout:postinstall scriptlet (using /bin/sh): 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout:for file in vmlinuz System.map config; do 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: fi 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout:done 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-24T23:46:23.131 INFO:teuthology.orchestra.run.smithi155.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:23.132 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2024-04-24T23:46:23.133 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -qi grub2-tools 2024-04-24T23:46:23.205 INFO:teuthology.orchestra.run.smithi155.stdout:Name : grub2-tools 2024-04-24T23:46:23.205 INFO:teuthology.orchestra.run.smithi155.stdout:Epoch : 1 2024-04-24T23:46:23.205 INFO:teuthology.orchestra.run.smithi155.stdout:Version : 2.06 2024-04-24T23:46:23.205 INFO:teuthology.orchestra.run.smithi155.stdout:Release : 68.el9 2024-04-24T23:46:23.205 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: x86_64 2024-04-24T23:46:23.205 INFO:teuthology.orchestra.run.smithi155.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-24T23:46:23.205 INFO:teuthology.orchestra.run.smithi155.stdout:Group : Unspecified 2024-04-24T23:46:23.205 INFO:teuthology.orchestra.run.smithi155.stdout:Size : 8264254 2024-04-24T23:46:23.205 INFO:teuthology.orchestra.run.smithi155.stdout:License : GPLv3+ 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:Packager : builder@centos.org 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:Vendor : CentOS 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:Summary : Support tools for GRUB. 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:Description : 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-24T23:46:23.206 INFO:teuthology.orchestra.run.smithi155.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-24T23:46:23.207 INFO:teuthology.orchestra.run.smithi155.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-24T23:46:23.207 INFO:teuthology.orchestra.run.smithi155.stdout:hardware devices. 2024-04-24T23:46:23.207 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:46:23.207 INFO:teuthology.orchestra.run.smithi155.stdout:This subpackage provides tools for support of all platforms. 2024-04-24T23:46:23.208 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-24T23:46:23.208 INFO:teuthology.task.kernel:Updating grub on smithi155 to boot 6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:23.208 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-24T23:46:23.745 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2024-04-24T23:46:25.162 INFO:teuthology.orchestra.run.smithi155.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-24T23:46:25.192 INFO:teuthology.orchestra.run.smithi155.stderr:done 2024-04-24T23:46:25.195 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-24T23:46:25.210 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.xMprtHsc3d 2024-04-24T23:46:25.210 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xMprtHsc3d 2024-04-24T23:46:25.276 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.xMprtHsc3d 2024-04-24T23:46:25.419 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.xMprtHsc3d is 6KB 2024-04-24T23:46:25.467 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.xMprtHsc3d 2024-04-24T23:46:25.481 DEBUG:teuthology.orchestra.run.smithi155:> sudo /bin/ls /boot/loader/entries || true 2024-04-24T23:46:25.552 INFO:teuthology.orchestra.run.smithi155.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-24T23:46:25.553 INFO:teuthology.orchestra.run.smithi155.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-24T23:46:25.553 INFO:teuthology.orchestra.run.smithi155.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-24T23:46:25.553 INFO:teuthology.orchestra.run.smithi155.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-24T23:46:25.555 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-24T23:46:25.714 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2024-04-24T23:46:51.258 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-24T23:46:51.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-24T23:46:51.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:46:55.718 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-24T23:46:55.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-24T23:46:55.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:47:14.078 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-04-24T23:47:23.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-24T23:47:23.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:47:25.854 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-24T23:47:26.142 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-04-24T23:47:34.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-24T23:47:34.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:47:38.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-24T23:47:38.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:47:53.246 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-24T23:48:05.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-24T23:48:05.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:48:05.729 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-24T23:48:06.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-24T23:48:06.388 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-24T23:48:06.389 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-24T23:48:06.428 INFO:teuthology.orchestra.run.smithi096.stdout:6.9.0-rc3-g806ec36b2112 2024-04-24T23:48:06.428 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-24T23:48:06.428 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T23:48:06.428 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-24T23:48:07.429 DEBUG:teuthology.parallel:result is None 2024-04-24T23:48:38.149 DEBUG:teuthology.orchestra.remote:timed out 2024-04-24T23:48:53.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-24T23:48:53.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:48:53.526 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-04-24T23:48:54.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-24T23:48:54.193 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-24T23:48:54.193 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-04-24T23:48:54.246 INFO:teuthology.orchestra.run.smithi155.stdout:6.9.0-rc3-g806ec36b2112 2024-04-24T23:48:54.246 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-24T23:48:54.246 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T23:48:54.246 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-24T23:48:55.247 DEBUG:teuthology.parallel:result is None 2024-04-24T23:48:55.248 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T23:48:55.258 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T23:48:55.258 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T23:48:55.268 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T23:48:55.325 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T23:48:55.336 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T23:48:55.371 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T23:48:55.372 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T23:48:55.379 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T23:48:55.453 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T23:48:55.460 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T23:48:55.460 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T23:48:55.467 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T23:48:55.598 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:48:55.618 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:48:55.647 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:48:55.668 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:48:55.673 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T23:48:55.681 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T23:48:55.681 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T23:48:55.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T23:48:55.777 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T23:48:55.787 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T23:48:55.788 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T23:48:55.795 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T23:48:55.849 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T23:48:55.935 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T23:48:56.041 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T23:48:56.126 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T23:48:56.215 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:48:56.215 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T23:48:56.296 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T23:48:56.382 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T23:48:56.475 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T23:48:56.556 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T23:48:56.643 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:48:56.644 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T23:48:56.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-04-24T23:48:56.735 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-04-24T23:48:56.861 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T23:48:56.882 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T23:48:57.354 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T23:48:57.361 INFO:teuthology.task.internal:Starting timer... 2024-04-24T23:48:57.361 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T23:48:57.414 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T23:48:57.463 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-24T23:48:57.464 DEBUG:teuthology.orchestra.run.smithi096:> sudo service auditd rotate 2024-04-24T23:48:57.572 INFO:teuthology.orchestra.run.smithi096.stdout:Rotating logs: 2024-04-24T23:48:57.577 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2024-04-24T23:48:57.682 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2024-04-24T23:48:57.687 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T23:48:57.687 DEBUG:teuthology.orchestra.run.smithi096:> /usr/sbin/getenforce 2024-04-24T23:48:57.746 INFO:teuthology.orchestra.run.smithi096.stdout:Permissive 2024-04-24T23:48:57.746 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2024-04-24T23:48:57.797 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2024-04-24T23:48:57.797 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi096.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive'} 2024-04-24T23:48:57.798 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T23:48:57.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:48:57.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T23:48:57.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:48:57.948 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T23:48:57.949 DEBUG:teuthology.orchestra.run.smithi096:> sudo /usr/sbin/setenforce permissive 2024-04-24T23:48:58.025 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2024-04-24T23:48:58.097 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T23:48:58.109 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T23:48:58.128 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T23:48:58.132 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T23:54:05.540 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2024-04-24T23:54:05.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-24T23:54:05.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:54:05.681 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-24T23:54:05.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-24T23:54:05.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-24T23:54:05.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:54:05.947 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-04-24T23:54:06.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-24T23:54:06.100 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T23:54:06.110 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T23:54:06.110 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T23:54:06.110 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:54:06.118 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T23:54:06.118 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:54:06.201 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T23:54:06.205 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T23:54:06.242 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T23:54:06.246 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T23:54:06.314 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: ntpd: command not found 2024-04-24T23:54:06.319 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2024-04-24T23:54:06.347 INFO:teuthology.orchestra.run.smithi096.stdout:506 Cannot talk to daemon 2024-04-24T23:54:06.351 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2024-04-24T23:54:06.387 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T23:54:06.393 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T23:54:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T23:54:06.436 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T23:54:06.545 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2024-04-24T23:54:06.554 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T23:54:06.554 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2024-04-24T23:54:06.554 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:54:06.554 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:54:06.554 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:54:06.554 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:54:06.558 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-04-24T23:54:06.566 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T23:54:06.566 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-04-24T23:54:06.567 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:54:06.567 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:54:06.567 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:54:06.567 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:54:06.568 INFO:teuthology.run_tasks:Running task install... 2024-04-24T23:54:06.576 DEBUG:teuthology.task.install:project ceph 2024-04-24T23:54:06.576 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-24T23:54:06.576 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-24T23:54:06.576 INFO:teuthology.task.install:Using flavor: default 2024-04-24T23:54:06.583 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T23:54:06.583 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-24T23:54:06.584 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-24T23:54:06.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:54:06.586 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-24T23:54:06.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:54:06.819 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-24T23:54:06.819 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-24T23:54:06.825 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-24T23:54:06.825 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-24T23:54:07.156 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T23:54:07.156 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:54:07.157 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T23:54:07.161 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T23:54:07.161 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:54:07.161 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T23:54:07.248 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-24T23:54:07.248 DEBUG:teuthology.orchestra.run.smithi096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T23:54:07.251 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-24T23:54:07.252 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T23:54:07.378 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T23:54:07.380 DEBUG:teuthology.orchestra.run.smithi096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T23:54:07.491 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T23:54:07.494 DEBUG:teuthology.orchestra.run.smithi096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T23:54:07.570 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2024-04-24T23:54:07.575 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2024-04-24T23:54:07.575 INFO:teuthology.orchestra.run.smithi096.stdout:check_obsoletes = 1 2024-04-24T23:54:07.579 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2024-04-24T23:54:07.893 INFO:teuthology.orchestra.run.smithi155.stdout:48 files removed 2024-04-24T23:54:07.893 INFO:teuthology.orchestra.run.smithi096.stdout:48 files removed 2024-04-24T23:54:07.932 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-24T23:54:07.939 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-24T23:54:09.149 INFO:teuthology.orchestra.run.smithi096.stdout:ceph packages for x86_64 106 kB/s | 83 kB 00:00 2024-04-24T23:54:09.162 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 105 kB/s | 83 kB 00:00 2024-04-24T23:54:09.821 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 21 kB/s | 11 kB 00:00 2024-04-24T23:54:09.850 INFO:teuthology.orchestra.run.smithi096.stdout:ceph noarch packages 19 kB/s | 11 kB 00:00 2024-04-24T23:54:10.621 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 2.6 kB/s | 1.9 kB 00:00 2024-04-24T23:54:10.667 INFO:teuthology.orchestra.run.smithi096.stdout:ceph source packages 2.6 kB/s | 1.9 kB 00:00 2024-04-24T23:54:11.940 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.0 MB 00:01 2024-04-24T23:54:14.016 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-24T23:54:18.633 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 6.2 MB 00:00 2024-04-24T23:54:44.021 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 695 B/s | 16 kB 00:24 2024-04-24T23:54:44.206 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 246 kB/s | 8.0 MB 00:33 2024-04-24T23:54:45.422 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-24T23:54:46.807 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-24T23:54:51.400 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.2 MB 00:00 2024-04-24T23:54:51.413 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-24T23:54:53.772 INFO:teuthology.orchestra.run.smithi096.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-24T23:54:53.773 INFO:teuthology.orchestra.run.smithi096.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-24T23:54:53.793 INFO:teuthology.orchestra.run.smithi096.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-24T23:54:53.794 INFO:teuthology.orchestra.run.smithi096.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-24T23:54:53.795 INFO:teuthology.orchestra.run.smithi096.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-24T23:54:53.796 INFO:teuthology.orchestra.run.smithi096.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-24T23:54:53.799 INFO:teuthology.orchestra.run.smithi096.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-24T23:54:53.802 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-24T23:54:53.803 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-24T23:54:53.873 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-04-24T23:54:53.890 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================= 2024-04-24T23:54:53.890 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-04-24T23:54:53.890 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================= 2024-04-24T23:54:53.890 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-04-24T23:54:53.890 INFO:teuthology.orchestra.run.smithi096.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-24T23:54:53.890 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-24T23:54:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-24T23:54:53.892 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrading: 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-24T23:54:53.893 INFO:teuthology.orchestra.run.smithi096.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-24T23:54:53.894 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T23:54:53.895 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T23:54:53.896 INFO:teuthology.orchestra.run.smithi096.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-24T23:54:53.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T23:54:53.898 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T23:54:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T23:54:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-24T23:54:53.901 INFO:teuthology.orchestra.run.smithi096.stdout:Installing weak dependencies: 2024-04-24T23:54:53.902 INFO:teuthology.orchestra.run.smithi096.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T23:54:53.902 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:54:53.902 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-04-24T23:54:53.902 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================= 2024-04-24T23:54:53.902 INFO:teuthology.orchestra.run.smithi096.stdout:Install 148 Packages 2024-04-24T23:54:53.902 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrade 4 Packages 2024-04-24T23:54:53.902 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:54:53.903 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 220 M 2024-04-24T23:54:53.903 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-04-24T23:54:54.067 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-04-24T23:54:55.065 INFO:teuthology.orchestra.run.smithi096.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-04-24T23:54:55.473 INFO:teuthology.orchestra.run.smithi096.stdout:(2/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 7.4 MB/s | 5.4 MB 00:00 2024-04-24T23:54:55.506 INFO:teuthology.orchestra.run.smithi096.stdout:(3/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 2.0 MB/s | 890 kB 00:00 2024-04-24T23:54:55.548 INFO:teuthology.orchestra.run.smithi096.stdout:(4/152): ceph-immutable-object-cache-19.0.0-244 1.9 MB/s | 145 kB 00:00 2024-04-24T23:54:55.569 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-24T23:54:55.740 INFO:teuthology.orchestra.run.smithi096.stdout:(5/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 10 MB/s | 2.4 MB 00:00 2024-04-24T23:54:55.908 INFO:teuthology.orchestra.run.smithi096.stdout:(6/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 4.2 MB/s | 1.5 MB 00:00 2024-04-24T23:54:56.149 INFO:teuthology.orchestra.run.smithi096.stdout:(7/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 12 MB/s | 4.7 MB 00:00 2024-04-24T23:54:57.125 INFO:teuthology.orchestra.run.smithi096.stdout:(8/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el9 11 MB/s | 10 MB 00:00 2024-04-24T23:54:57.383 INFO:teuthology.orchestra.run.smithi096.stdout:(9/152): ceph-common-19.0.0-2445.gd2c45d97.el9. 8.0 MB/s | 21 MB 00:02 2024-04-24T23:54:57.408 INFO:teuthology.orchestra.run.smithi096.stdout:(10/152): ceph-selinux-19.0.0-2445.gd2c45d97.el 89 kB/s | 25 kB 00:00 2024-04-24T23:54:57.467 INFO:teuthology.orchestra.run.smithi096.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 3.8 MB/s | 222 kB 00:00 2024-04-24T23:54:57.517 INFO:teuthology.orchestra.run.smithi096.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 553 kB/s | 27 kB 00:00 2024-04-24T23:54:57.567 INFO:teuthology.orchestra.run.smithi096.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 647 kB/s | 32 kB 00:00 2024-04-24T23:54:57.701 INFO:teuthology.orchestra.run.smithi096.stdout:(14/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 5.5 MB/s | 745 kB 00:00 2024-04-24T23:54:57.784 INFO:teuthology.orchestra.run.smithi096.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.9 MB/s | 163 kB 00:00 2024-04-24T23:54:57.851 INFO:teuthology.orchestra.run.smithi096.stdout:(16/152): librados-devel-19.0.0-2445.gd2c45d97. 1.9 MB/s | 127 kB 00:00 2024-04-24T23:54:57.935 INFO:teuthology.orchestra.run.smithi096.stdout:(17/152): libradosstriper1-19.0.0-2445.gd2c45d9 5.9 MB/s | 501 kB 00:00 2024-04-24T23:54:58.485 INFO:teuthology.orchestra.run.smithi096.stdout:(18/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 9.7 MB/s | 5.3 MB 00:00 2024-04-24T23:54:58.569 INFO:teuthology.orchestra.run.smithi096.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 548 kB/s | 45 kB 00:00 2024-04-24T23:54:58.786 INFO:teuthology.orchestra.run.smithi096.stdout:(20/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 5.8 MB/s | 17 MB 00:02 2024-04-24T23:54:58.822 INFO:teuthology.orchestra.run.smithi096.stdout:(21/152): python3-ceph-common-19.0.0-2445.gd2c4 533 kB/s | 133 kB 00:00 2024-04-24T23:54:58.853 INFO:teuthology.orchestra.run.smithi096.stdout:(22/152): python3-cephfs-19.0.0-2445.gd2c45d97. 2.4 MB/s | 162 kB 00:00 2024-04-24T23:54:58.895 INFO:teuthology.orchestra.run.smithi096.stdout:(23/152): python3-rados-19.0.0-2445.gd2c45d97.e 4.2 MB/s | 321 kB 00:00 2024-04-24T23:54:58.928 INFO:teuthology.orchestra.run.smithi096.stdout:(24/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 3.9 MB/s | 299 kB 00:00 2024-04-24T23:54:58.991 INFO:teuthology.orchestra.run.smithi096.stdout:(25/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.0 MB/s | 99 kB 00:00 2024-04-24T23:54:59.021 INFO:teuthology.orchestra.run.smithi096.stdout:(26/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 936 kB/s | 85 kB 00:00 2024-04-24T23:54:59.096 INFO:teuthology.orchestra.run.smithi096.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 2.3 MB/s | 171 kB 00:00 2024-04-24T23:54:59.196 INFO:teuthology.orchestra.run.smithi096.stdout:(28/152): ceph-grafana-dashboards-19.0.0-2445.g 320 kB/s | 32 kB 00:00 2024-04-24T23:54:59.271 INFO:teuthology.orchestra.run.smithi096.stdout:(29/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 11 MB/s | 3.1 MB 00:00 2024-04-24T23:54:59.305 INFO:teuthology.orchestra.run.smithi096.stdout:(30/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.3 MB/s | 141 kB 00:00 2024-04-24T23:54:59.655 INFO:teuthology.orchestra.run.smithi096.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 9.2 MB/s | 3.5 MB 00:00 2024-04-24T23:54:59.739 INFO:teuthology.orchestra.run.smithi096.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 3.0 MB/s | 249 kB 00:00 2024-04-24T23:54:59.806 INFO:teuthology.orchestra.run.smithi096.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 752 kB/s | 49 kB 00:00 2024-04-24T23:54:59.873 INFO:teuthology.orchestra.run.smithi096.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 233 kB/s | 15 kB 00:00 2024-04-24T23:54:59.956 INFO:teuthology.orchestra.run.smithi096.stdout:(35/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 3.1 MB/s | 264 kB 00:00 2024-04-24T23:55:00.065 INFO:teuthology.orchestra.run.smithi096.stdout:(36/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 6.9 MB/s | 762 kB 00:00 2024-04-24T23:55:00.132 INFO:teuthology.orchestra.run.smithi096.stdout:(37/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 278 kB/s | 18 kB 00:00 2024-04-24T23:55:00.290 INFO:teuthology.orchestra.run.smithi096.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 511 kB/s | 80 kB 00:00 2024-04-24T23:55:00.474 INFO:teuthology.orchestra.run.smithi096.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 6.3 MB/s | 7.4 MB 00:01 2024-04-24T23:55:00.625 INFO:teuthology.orchestra.run.smithi096.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-04-24T23:55:00.692 INFO:teuthology.orchestra.run.smithi096.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.8 MB/s | 253 kB 00:00 2024-04-24T23:55:01.184 INFO:teuthology.orchestra.run.smithi096.stdout:(42/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 13 MB/s | 48 MB 00:03 2024-04-24T23:55:01.217 INFO:teuthology.orchestra.run.smithi096.stdout:(43/152): libquadmath-11.4.1-3.el9.x86_64.rpm 264 kB/s | 195 kB 00:00 2024-04-24T23:55:01.278 INFO:teuthology.orchestra.run.smithi096.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-04-24T23:55:01.334 INFO:teuthology.orchestra.run.smithi096.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-24T23:55:01.359 INFO:teuthology.orchestra.run.smithi096.stdout:(46/152): python3-pycparser-2.20-6.el9.noarch.r 955 kB/s | 135 kB 00:00 2024-04-24T23:55:01.385 INFO:teuthology.orchestra.run.smithi096.stdout:(47/152): python3-ply-3.11-14.el9.noarch.rpm 533 kB/s | 106 kB 00:00 2024-04-24T23:55:01.418 INFO:teuthology.orchestra.run.smithi096.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-24T23:55:01.477 INFO:teuthology.orchestra.run.smithi096.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-24T23:55:01.510 INFO:teuthology.orchestra.run.smithi096.stdout:(50/152): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-04-24T23:55:01.535 INFO:teuthology.orchestra.run.smithi096.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 371 kB/s | 21 kB 00:00 2024-04-24T23:55:01.585 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-04-24T23:55:01.586 INFO:teuthology.orchestra.run.smithi096.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-04-24T23:55:01.611 INFO:teuthology.orchestra.run.smithi096.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 439 kB/s | 33 kB 00:00 2024-04-24T23:55:01.646 INFO:teuthology.orchestra.run.smithi096.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-04-24T23:55:01.670 INFO:teuthology.orchestra.run.smithi096.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 315 kB/s | 18 kB 00:00 2024-04-24T23:55:01.704 INFO:teuthology.orchestra.run.smithi096.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 193 kB/s | 11 kB 00:00 2024-04-24T23:55:01.753 INFO:teuthology.orchestra.run.smithi096.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-24T23:55:01.779 INFO:teuthology.orchestra.run.smithi096.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 609 kB/s | 45 kB 00:00 2024-04-24T23:55:01.888 INFO:teuthology.orchestra.run.smithi096.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-04-24T23:55:01.929 INFO:teuthology.orchestra.run.smithi096.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-04-24T23:55:01.955 INFO:teuthology.orchestra.run.smithi096.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 384 kB/s | 25 kB 00:00 2024-04-24T23:55:01.997 INFO:teuthology.orchestra.run.smithi096.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 2.6 MB/s | 582 kB 00:00 2024-04-24T23:55:02.022 INFO:teuthology.orchestra.run.smithi096.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 520 kB/s | 47 kB 00:00 2024-04-24T23:55:02.056 INFO:teuthology.orchestra.run.smithi096.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-04-24T23:55:02.081 INFO:teuthology.orchestra.run.smithi096.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 609 kB/s | 35 kB 00:00 2024-04-24T23:55:02.106 INFO:teuthology.orchestra.run.smithi096.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-24T23:55:02.273 INFO:teuthology.orchestra.run.smithi096.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 9.6 MB/s | 1.6 MB 00:00 2024-04-24T23:55:02.390 INFO:teuthology.orchestra.run.smithi096.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-04-24T23:55:02.451 INFO:teuthology.orchestra.run.smithi096.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 5.0 MB/s | 911 kB 00:00 2024-04-24T23:55:02.476 INFO:teuthology.orchestra.run.smithi096.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.5 MB/s | 133 kB 00:00 2024-04-24T23:55:02.560 INFO:teuthology.orchestra.run.smithi096.stdout:(71/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-04-24T23:55:02.626 INFO:teuthology.orchestra.run.smithi096.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-04-24T23:55:02.643 INFO:teuthology.orchestra.run.smithi096.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-04-24T23:55:02.710 INFO:teuthology.orchestra.run.smithi096.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-24T23:55:02.786 INFO:teuthology.orchestra.run.smithi096.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.3 MB/s | 248 kB 00:00 2024-04-24T23:55:02.861 INFO:teuthology.orchestra.run.smithi096.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 347 kB/s | 26 kB 00:00 2024-04-24T23:55:02.978 INFO:teuthology.orchestra.run.smithi096.stdout:(77/152): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-04-24T23:55:03.003 INFO:teuthology.orchestra.run.smithi096.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 136 kB/s | 19 kB 00:00 2024-04-24T23:55:03.045 INFO:teuthology.orchestra.run.smithi096.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-04-24T23:55:03.070 INFO:teuthology.orchestra.run.smithi096.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 526 kB/s | 35 kB 00:00 2024-04-24T23:55:03.195 INFO:teuthology.orchestra.run.smithi096.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-04-24T23:55:03.229 INFO:teuthology.orchestra.run.smithi096.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-04-24T23:55:03.262 INFO:teuthology.orchestra.run.smithi096.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-04-24T23:55:03.288 INFO:teuthology.orchestra.run.smithi096.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-24T23:55:03.321 INFO:teuthology.orchestra.run.smithi096.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 732 kB/s | 42 kB 00:00 2024-04-24T23:55:03.355 INFO:teuthology.orchestra.run.smithi096.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-04-24T23:55:03.388 INFO:teuthology.orchestra.run.smithi096.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.4 MB/s | 159 kB 00:00 2024-04-24T23:55:03.422 INFO:teuthology.orchestra.run.smithi096.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-24T23:55:03.447 INFO:teuthology.orchestra.run.smithi096.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 883 kB/s | 51 kB 00:00 2024-04-24T23:55:03.481 INFO:teuthology.orchestra.run.smithi096.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 932 kB/s | 54 kB 00:00 2024-04-24T23:55:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 723 kB/s | 42 kB 00:00 2024-04-24T23:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout:(92/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.3 MB/s | 5.1 MB 00:00 2024-04-24T23:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 313 kB/s | 44 kB 00:00 2024-04-24T23:55:03.732 INFO:teuthology.orchestra.run.smithi096.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-24T23:55:03.757 INFO:teuthology.orchestra.run.smithi096.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 482 kB/s | 36 kB 00:00 2024-04-24T23:55:03.791 INFO:teuthology.orchestra.run.smithi096.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 824 kB/s | 47 kB 00:00 2024-04-24T23:55:03.824 INFO:teuthology.orchestra.run.smithi096.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-04-24T23:55:03.858 INFO:teuthology.orchestra.run.smithi096.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 875 kB/s | 58 kB 00:00 2024-04-24T23:55:03.883 INFO:teuthology.orchestra.run.smithi096.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-24T23:55:03.917 INFO:teuthology.orchestra.run.smithi096.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-24T23:55:03.943 INFO:teuthology.orchestra.run.smithi096.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-04-24T23:55:04.001 INFO:teuthology.orchestra.run.smithi096.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 270 kB/s | 22 kB 00:00 2024-04-24T23:55:04.015 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-24T23:55:04.017 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-24T23:55:04.039 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-24T23:55:04.040 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-24T23:55:04.041 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-24T23:55:04.043 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-24T23:55:04.045 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-24T23:55:04.049 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-24T23:55:04.050 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-24T23:55:04.118 INFO:teuthology.orchestra.run.smithi096.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-04-24T23:55:04.122 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-24T23:55:04.147 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-24T23:55:04.148 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-24T23:55:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-24T23:55:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T23:55:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T23:55:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T23:55:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T23:55:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T23:55:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-24T23:55:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T23:55:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-24T23:55:04.158 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-04-24T23:55:04.159 INFO:teuthology.orchestra.run.smithi155.stdout:Install 148 Packages 2024-04-24T23:55:04.159 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 4 Packages 2024-04-24T23:55:04.159 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:55:04.159 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 220 M 2024-04-24T23:55:04.159 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-24T23:55:04.402 INFO:teuthology.orchestra.run.smithi096.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-04-24T23:55:04.960 INFO:teuthology.orchestra.run.smithi096.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 40 kB/s | 19 kB 00:00 2024-04-24T23:55:05.245 INFO:teuthology.orchestra.run.smithi155.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-04-24T23:55:05.268 INFO:teuthology.orchestra.run.smithi096.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 284 kB/s | 309 kB 00:01 2024-04-24T23:55:05.377 INFO:teuthology.orchestra.run.smithi096.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 241 kB/s | 26 kB 00:00 2024-04-24T23:55:05.411 INFO:teuthology.orchestra.run.smithi096.stdout:(108/152): abseil-cpp-20211102.0-3.el9.x86_64.r 389 kB/s | 548 kB 00:01 2024-04-24T23:55:05.486 INFO:teuthology.orchestra.run.smithi096.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 451 kB/s | 49 kB 00:00 2024-04-24T23:55:05.603 INFO:teuthology.orchestra.run.smithi096.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 352 kB/s | 67 kB 00:00 2024-04-24T23:55:05.695 INFO:teuthology.orchestra.run.smithi155.stdout:(2/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 6.7 MB/s | 5.4 MB 00:00 2024-04-24T23:55:05.762 INFO:teuthology.orchestra.run.smithi096.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 549 kB/s | 151 kB 00:00 2024-04-24T23:55:05.762 INFO:teuthology.orchestra.run.smithi155.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 2.1 MB/s | 145 kB 00:00 2024-04-24T23:55:06.055 INFO:teuthology.orchestra.run.smithi155.stdout:(4/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 8.1 MB/s | 2.4 MB 00:00 2024-04-24T23:55:06.096 INFO:teuthology.orchestra.run.smithi155.stdout:(5/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.0 MB/s | 890 kB 00:00 2024-04-24T23:55:06.230 INFO:teuthology.orchestra.run.smithi155.stdout:(6/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 8.6 MB/s | 1.5 MB 00:00 2024-04-24T23:55:06.537 INFO:teuthology.orchestra.run.smithi096.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 708 kB/s | 548 kB 00:00 2024-04-24T23:55:06.654 INFO:teuthology.orchestra.run.smithi096.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 377 kB/s | 43 kB 00:00 2024-04-24T23:55:06.687 INFO:teuthology.orchestra.run.smithi096.stdout:(114/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 774 kB/s | 838 kB 00:01 2024-04-24T23:55:06.747 INFO:teuthology.orchestra.run.smithi155.stdout:(7/152): ceph-common-19.0.0-2445.gd2c45d97.el9. 11 MB/s | 21 MB 00:01 2024-04-24T23:55:06.763 INFO:teuthology.orchestra.run.smithi096.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 299 kB/s | 32 kB 00:00 2024-04-24T23:55:06.796 INFO:teuthology.orchestra.run.smithi096.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-04-24T23:55:07.038 INFO:teuthology.orchestra.run.smithi096.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 625 kB/s | 172 kB 00:00 2024-04-24T23:55:07.314 INFO:teuthology.orchestra.run.smithi096.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 694 kB/s | 358 kB 00:00 2024-04-24T23:55:07.422 INFO:teuthology.orchestra.run.smithi096.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 329 kB/s | 35 kB 00:00 2024-04-24T23:55:07.506 INFO:teuthology.orchestra.run.smithi096.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 650 kB/s | 303 kB 00:00 2024-04-24T23:55:07.773 INFO:teuthology.orchestra.run.smithi096.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 588 kB/s | 206 kB 00:00 2024-04-24T23:55:07.780 INFO:teuthology.orchestra.run.smithi155.stdout:(8/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x86 11 MB/s | 17 MB 00:01 2024-04-24T23:55:07.964 INFO:teuthology.orchestra.run.smithi155.stdout:(9/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el9 8.4 MB/s | 10 MB 00:01 2024-04-24T23:55:07.989 INFO:teuthology.orchestra.run.smithi155.stdout:(10/152): ceph-selinux-19.0.0-2445.gd2c45d97.el 121 kB/s | 25 kB 00:00 2024-04-24T23:55:08.040 INFO:teuthology.orchestra.run.smithi096.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 543 kB/s | 144 kB 00:00 2024-04-24T23:55:08.114 INFO:teuthology.orchestra.run.smithi155.stdout:(11/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x8 2.3 MB/s | 4.7 MB 00:02 2024-04-24T23:55:08.148 INFO:teuthology.orchestra.run.smithi155.stdout:(12/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 1.4 MB/s | 222 kB 00:00 2024-04-24T23:55:08.149 INFO:teuthology.orchestra.run.smithi096.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-04-24T23:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 178 kB/s | 18 kB 00:00 2024-04-24T23:55:08.297 INFO:teuthology.orchestra.run.smithi155.stdout:(13/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 149 kB/s | 27 kB 00:00 2024-04-24T23:55:08.349 INFO:teuthology.orchestra.run.smithi096.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 233 kB/s | 23 kB 00:00 2024-04-24T23:55:08.356 INFO:teuthology.orchestra.run.smithi155.stdout:(14/152): libcephfs-devel-19.0.0-2445.gd2c45d97 153 kB/s | 32 kB 00:00 2024-04-24T23:55:08.415 INFO:teuthology.orchestra.run.smithi155.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 2.8 MB/s | 163 kB 00:00 2024-04-24T23:55:08.450 INFO:teuthology.orchestra.run.smithi096.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2024-04-24T23:55:08.482 INFO:teuthology.orchestra.run.smithi155.stdout:(16/152): librados-devel-19.0.0-2445.gd2c45d97. 1.9 MB/s | 127 kB 00:00 2024-04-24T23:55:08.524 INFO:teuthology.orchestra.run.smithi155.stdout:(17/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 3.2 MB/s | 745 kB 00:00 2024-04-24T23:55:08.550 INFO:teuthology.orchestra.run.smithi096.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 198 kB/s | 20 kB 00:00 2024-04-24T23:55:08.591 INFO:teuthology.orchestra.run.smithi155.stdout:(18/152): libradosstriper1-19.0.0-2445.gd2c45d9 4.5 MB/s | 501 kB 00:00 2024-04-24T23:55:08.658 INFO:teuthology.orchestra.run.smithi155.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 682 kB/s | 45 kB 00:00 2024-04-24T23:55:08.741 INFO:teuthology.orchestra.run.smithi155.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 1.6 MB/s | 133 kB 00:00 2024-04-24T23:55:08.825 INFO:teuthology.orchestra.run.smithi155.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 1.9 MB/s | 162 kB 00:00 2024-04-24T23:55:08.926 INFO:teuthology.orchestra.run.smithi155.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 3.1 MB/s | 321 kB 00:00 2024-04-24T23:55:09.009 INFO:teuthology.orchestra.run.smithi155.stdout:(23/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 3.6 MB/s | 299 kB 00:00 2024-04-24T23:55:09.103 INFO:teuthology.orchestra.run.smithi155.stdout:(24/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.1 MB/s | 99 kB 00:00 2024-04-24T23:55:09.176 INFO:teuthology.orchestra.run.smithi155.stdout:(25/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-24T23:55:09.585 INFO:teuthology.orchestra.run.smithi155.stdout:(26/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 5.0 MB/s | 5.3 MB 00:01 2024-04-24T23:55:09.668 INFO:teuthology.orchestra.run.smithi155.stdout:(27/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 6.3 MB/s | 3.1 MB 00:00 2024-04-24T23:55:09.702 INFO:teuthology.orchestra.run.smithi155.stdout:(28/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.4 MB/s | 171 kB 00:00 2024-04-24T23:55:09.719 INFO:teuthology.orchestra.run.smithi155.stdout:(29/152): ceph-grafana-dashboards-19.0.0-2445.g 646 kB/s | 32 kB 00:00 2024-04-24T23:55:09.769 INFO:teuthology.orchestra.run.smithi155.stdout:(30/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 2.1 MB/s | 141 kB 00:00 2024-04-24T23:55:09.900 INFO:teuthology.orchestra.run.smithi096.stdout:(128/152): python3-kubernetes-26.1.0-2.el9.noar 775 kB/s | 1.0 MB 00:01 2024-04-24T23:55:10.017 INFO:teuthology.orchestra.run.smithi096.stdout:(129/152): python3-grpcio-1.46.7-10.el9.x86_64. 831 kB/s | 2.0 MB 00:02 2024-04-24T23:55:10.042 INFO:teuthology.orchestra.run.smithi096.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 328 kB/s | 46 kB 00:00 2024-04-24T23:55:10.186 INFO:teuthology.orchestra.run.smithi155.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 7.5 MB/s | 3.5 MB 00:00 2024-04-24T23:55:10.218 INFO:teuthology.orchestra.run.smithi096.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 395 kB/s | 79 kB 00:00 2024-04-24T23:55:10.243 INFO:teuthology.orchestra.run.smithi096.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 289 kB/s | 58 kB 00:00 2024-04-24T23:55:10.352 INFO:teuthology.orchestra.run.smithi096.stdout:(133/152): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2024-04-24T23:55:10.386 INFO:teuthology.orchestra.run.smithi155.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 1.2 MB/s | 249 kB 00:00 2024-04-24T23:55:10.478 INFO:teuthology.orchestra.run.smithi155.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 543 kB/s | 49 kB 00:00 2024-04-24T23:55:10.556 INFO:teuthology.orchestra.run.smithi096.stdout:(134/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 441 kB/s | 90 kB 00:00 2024-04-24T23:55:10.562 INFO:teuthology.orchestra.run.smithi155.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 187 kB/s | 15 kB 00:00 2024-04-24T23:55:10.660 INFO:teuthology.orchestra.run.smithi096.stdout:(135/152): libarrow-9.0.0-10.el9.x86_64.rpm 794 kB/s | 4.4 MB 00:05 2024-04-24T23:55:10.685 INFO:teuthology.orchestra.run.smithi096.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 219 kB/s | 28 kB 00:00 2024-04-24T23:55:10.711 INFO:teuthology.orchestra.run.smithi096.stdout:(137/152): python3-pecan-1.4.2-3.el9.noarch.rpm 553 kB/s | 272 kB 00:00 2024-04-24T23:55:10.771 INFO:teuthology.orchestra.run.smithi155.stdout:(35/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 1.2 MB/s | 264 kB 00:00 2024-04-24T23:55:10.778 INFO:teuthology.orchestra.run.smithi096.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 264 kB/s | 31 kB 00:00 2024-04-24T23:55:10.887 INFO:teuthology.orchestra.run.smithi096.stdout:(139/152): python3-tempora-5.0.0-2.el9.noarch.r 332 kB/s | 36 kB 00:00 2024-04-24T23:55:10.888 INFO:teuthology.orchestra.run.smithi155.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 6.6 MB/s | 7.4 MB 00:01 2024-04-24T23:55:10.912 INFO:teuthology.orchestra.run.smithi096.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 295 kB/s | 59 kB 00:00 2024-04-24T23:55:10.962 INFO:teuthology.orchestra.run.smithi096.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 685 kB/s | 188 kB 00:00 2024-04-24T23:55:10.995 INFO:teuthology.orchestra.run.smithi096.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 471 kB/s | 51 kB 00:00 2024-04-24T23:55:11.137 INFO:teuthology.orchestra.run.smithi096.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 512 kB/s | 90 kB 00:00 2024-04-24T23:55:11.246 INFO:teuthology.orchestra.run.smithi096.stdout:(144/152): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2024-04-24T23:55:11.279 INFO:teuthology.orchestra.run.smithi096.stdout:(145/152): python3-webob-1.8.7-6.el9.noarch.rpm 626 kB/s | 230 kB 00:00 2024-04-24T23:55:11.427 INFO:teuthology.orchestra.run.smithi155.stdout:(37/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 14 MB/s | 48 MB 00:03 2024-04-24T23:55:11.455 INFO:teuthology.orchestra.run.smithi155.stdout:(38/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 32 kB/s | 18 kB 00:00 2024-04-24T23:55:11.505 INFO:teuthology.orchestra.run.smithi155.stdout:(39/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 1.0 MB/s | 762 kB 00:00 2024-04-24T23:55:11.513 INFO:teuthology.orchestra.run.smithi096.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 720 kB/s | 192 kB 00:00 2024-04-24T23:55:11.605 INFO:teuthology.orchestra.run.smithi155.stdout:(40/152): fuse-2.9.9-15.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-04-24T23:55:11.622 INFO:teuthology.orchestra.run.smithi096.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 683 kB/s | 427 kB 00:00 2024-04-24T23:55:11.664 INFO:teuthology.orchestra.run.smithi155.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-04-24T23:55:11.714 INFO:teuthology.orchestra.run.smithi155.stdout:(42/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-04-24T23:55:11.747 INFO:teuthology.orchestra.run.smithi155.stdout:(43/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-04-24T23:55:11.773 INFO:teuthology.orchestra.run.smithi155.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-24T23:55:11.839 INFO:teuthology.orchestra.run.smithi155.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2024-04-24T23:55:11.874 INFO:teuthology.orchestra.run.smithi155.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-04-24T23:55:11.907 INFO:teuthology.orchestra.run.smithi155.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-24T23:55:11.947 INFO:teuthology.orchestra.run.smithi096.stdout:(148/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 9.7 MB/s | 3.1 MB 00:00 2024-04-24T23:55:11.974 INFO:teuthology.orchestra.run.smithi155.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-04-24T23:55:12.064 INFO:teuthology.orchestra.run.smithi096.stdout:(149/152): librados2-19.0.0-2445.gd2c45d97.el9. 6.2 MB/s | 3.4 MB 00:00 2024-04-24T23:55:12.272 INFO:teuthology.orchestra.run.smithi096.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 4.2 MB/s | 1.3 MB 00:00 2024-04-24T23:55:12.414 INFO:teuthology.orchestra.run.smithi096.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.8 MB/s | 2.4 MB 00:00 2024-04-24T23:55:12.491 INFO:teuthology.orchestra.run.smithi155.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 207 kB/s | 107 kB 00:00 2024-04-24T23:55:12.625 INFO:teuthology.orchestra.run.smithi155.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 162 kB/s | 21 kB 00:00 2024-04-24T23:55:12.658 INFO:teuthology.orchestra.run.smithi155.stdout:(51/152): automake-1.16.2-8.el9.noarch.rpm 880 kB/s | 689 kB 00:00 2024-04-24T23:55:12.708 INFO:teuthology.orchestra.run.smithi155.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-04-24T23:55:12.767 INFO:teuthology.orchestra.run.smithi155.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 303 kB/s | 33 kB 00:00 2024-04-24T23:55:12.875 INFO:teuthology.orchestra.run.smithi155.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 169 kB/s | 18 kB 00:00 2024-04-24T23:55:13.009 INFO:teuthology.orchestra.run.smithi155.stdout:(55/152): flex-2.6.4-9.el9.x86_64.rpm 818 kB/s | 313 kB 00:00 2024-04-24T23:55:13.034 INFO:teuthology.orchestra.run.smithi155.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 71 kB/s | 11 kB 00:00 2024-04-24T23:55:13.118 INFO:teuthology.orchestra.run.smithi155.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.5 MB/s | 160 kB 00:00 2024-04-24T23:55:13.143 INFO:teuthology.orchestra.run.smithi155.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 420 kB/s | 45 kB 00:00 2024-04-24T23:55:13.318 INFO:teuthology.orchestra.run.smithi155.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-04-24T23:55:13.356 INFO:teuthology.orchestra.run.smithi096.stdout:(152/152): thrift-0.15.0-2.el9.x86_64.rpm 780 kB/s | 1.6 MB 00:02 2024-04-24T23:55:13.368 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-04-24T23:55:13.369 INFO:teuthology.orchestra.run.smithi096.stdout:Total 11 MB/s | 220 MB 00:19 2024-04-24T23:55:13.427 INFO:teuthology.orchestra.run.smithi155.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 2.0 MB/s | 582 kB 00:00 2024-04-24T23:55:13.452 INFO:teuthology.orchestra.run.smithi155.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 192 kB/s | 25 kB 00:00 2024-04-24T23:55:13.536 INFO:teuthology.orchestra.run.smithi155.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 441 kB/s | 47 kB 00:00 2024-04-24T23:55:13.569 INFO:teuthology.orchestra.run.smithi155.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 292 kB 00:00 2024-04-24T23:55:13.645 INFO:teuthology.orchestra.run.smithi155.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-24T23:55:13.670 INFO:teuthology.orchestra.run.smithi155.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 353 kB/s | 35 kB 00:00 2024-04-24T23:55:14.170 INFO:teuthology.orchestra.run.smithi155.stdout:(66/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.0 MB/s | 3.0 MB 00:01 2024-04-24T23:55:14.279 INFO:teuthology.orchestra.run.smithi155.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-04-24T23:55:14.421 INFO:teuthology.orchestra.run.smithi155.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 6.3 MB/s | 911 kB 00:00 2024-04-24T23:55:14.579 INFO:teuthology.orchestra.run.smithi155.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 845 kB/s | 133 kB 00:00 2024-04-24T23:55:15.472 INFO:teuthology.orchestra.run.smithi155.stdout:(70/152): openblas-openmp-0.3.21-2.el9.x86_64.r 2.6 MB/s | 4.7 MB 00:01 2024-04-24T23:55:16.235 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-04-24T23:55:16.405 INFO:teuthology.orchestra.run.smithi155.stdout:(71/152): postgresql-13.14-1.el9.x86_64.rpm 728 kB/s | 1.6 MB 00:02 2024-04-24T23:55:16.483 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-04-24T23:55:16.483 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-04-24T23:55:16.588 INFO:teuthology.orchestra.run.smithi155.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 479 kB/s | 87 kB 00:00 2024-04-24T23:55:16.913 INFO:teuthology.orchestra.run.smithi155.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 717 kB/s | 1.0 MB 00:01 2024-04-24T23:55:17.255 INFO:teuthology.orchestra.run.smithi155.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 2.2 MB/s | 5.8 MB 00:02 2024-04-24T23:55:17.305 INFO:teuthology.orchestra.run.smithi155.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 624 kB/s | 244 kB 00:00 2024-04-24T23:55:17.414 INFO:teuthology.orchestra.run.smithi155.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 238 kB/s | 26 kB 00:00 2024-04-24T23:55:17.522 INFO:teuthology.orchestra.run.smithi155.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 178 kB/s | 19 kB 00:00 2024-04-24T23:55:17.598 INFO:teuthology.orchestra.run.smithi155.stdout:(78/152): python3-jinja2-2.11.3-5.el9.noarch.rp 725 kB/s | 248 kB 00:00 2024-04-24T23:55:17.715 INFO:teuthology.orchestra.run.smithi155.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 299 kB/s | 35 kB 00:00 2024-04-24T23:55:17.824 INFO:teuthology.orchestra.run.smithi155.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 574 kB/s | 172 kB 00:00 2024-04-24T23:55:18.182 INFO:teuthology.orchestra.run.smithi155.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 700 kB/s | 250 kB 00:00 2024-04-24T23:55:18.532 INFO:teuthology.orchestra.run.smithi155.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 636 kB/s | 222 kB 00:00 2024-04-24T23:55:18.801 INFO:teuthology.orchestra.run.smithi155.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.7 MB/s | 5.1 MB 00:01 2024-04-24T23:55:18.833 INFO:teuthology.orchestra.run.smithi155.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 257 kB/s | 77 kB 00:00 2024-04-24T23:55:18.925 INFO:teuthology.orchestra.run.smithi155.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 343 kB/s | 42 kB 00:00 2024-04-24T23:55:19.033 INFO:teuthology.orchestra.run.smithi155.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-04-24T23:55:19.122 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-04-24T23:55:19.122 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-04-24T23:55:19.142 INFO:teuthology.orchestra.run.smithi155.stdout:(87/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-04-24T23:55:19.251 INFO:teuthology.orchestra.run.smithi155.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 472 kB/s | 51 kB 00:00 2024-04-24T23:55:19.292 INFO:teuthology.orchestra.run.smithi155.stdout:(89/152): python3-protobuf-3.14.0-13.el9.noarch 587 kB/s | 269 kB 00:00 2024-04-24T23:55:19.359 INFO:teuthology.orchestra.run.smithi155.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 498 kB/s | 54 kB 00:00 2024-04-24T23:55:19.476 INFO:teuthology.orchestra.run.smithi155.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 359 kB/s | 42 kB 00:00 2024-04-24T23:55:19.585 INFO:teuthology.orchestra.run.smithi155.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 410 kB/s | 44 kB 00:00 2024-04-24T23:55:19.694 INFO:teuthology.orchestra.run.smithi155.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-04-24T23:55:19.802 INFO:teuthology.orchestra.run.smithi155.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 333 kB/s | 36 kB 00:00 2024-04-24T23:55:19.910 INFO:teuthology.orchestra.run.smithi155.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 440 kB/s | 47 kB 00:00 2024-04-24T23:55:20.028 INFO:teuthology.orchestra.run.smithi155.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.6 MB/s | 305 kB 00:00 2024-04-24T23:55:20.136 INFO:teuthology.orchestra.run.smithi155.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 536 kB/s | 58 kB 00:00 2024-04-24T23:55:20.236 INFO:teuthology.orchestra.run.smithi155.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 943 kB/s | 94 kB 00:00 2024-04-24T23:55:20.362 INFO:teuthology.orchestra.run.smithi155.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 511 kB/s | 64 kB 00:00 2024-04-24T23:55:20.470 INFO:teuthology.orchestra.run.smithi155.stdout:(100/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-04-24T23:55:20.529 INFO:teuthology.orchestra.run.smithi155.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 387 kB/s | 22 kB 00:00 2024-04-24T23:55:20.646 INFO:teuthology.orchestra.run.smithi155.stdout:(102/152): protobuf-compiler-3.14.0-13.el9.x86_ 7.3 MB/s | 863 kB 00:00 2024-04-24T23:55:20.838 INFO:teuthology.orchestra.run.smithi155.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 2.8 MB/s | 548 kB 00:00 2024-04-24T23:55:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 3.7 MB/s | 309 kB 00:00 2024-04-24T23:55:20.964 INFO:teuthology.orchestra.run.smithi155.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 474 kB/s | 19 kB 00:00 2024-04-24T23:55:21.372 INFO:teuthology.orchestra.run.smithi155.stdout:(106/152): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-24T23:55:21.414 INFO:teuthology.orchestra.run.smithi155.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 635 kB/s | 26 kB 00:00 2024-04-24T23:55:21.456 INFO:teuthology.orchestra.run.smithi155.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-04-24T23:55:21.507 INFO:teuthology.orchestra.run.smithi155.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-24T23:55:21.557 INFO:teuthology.orchestra.run.smithi155.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-04-24T23:55:21.649 INFO:teuthology.orchestra.run.smithi155.stdout:(111/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.0 MB/s | 838 kB 00:00 2024-04-24T23:55:21.716 INFO:teuthology.orchestra.run.smithi155.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 8.2 MB/s | 548 kB 00:00 2024-04-24T23:55:21.758 INFO:teuthology.orchestra.run.smithi155.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-04-24T23:55:21.800 INFO:teuthology.orchestra.run.smithi155.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 784 kB/s | 32 kB 00:00 2024-04-24T23:55:21.842 INFO:teuthology.orchestra.run.smithi155.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 364 kB/s | 15 kB 00:00 2024-04-24T23:55:21.901 INFO:teuthology.orchestra.run.smithi155.stdout:(116/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-24T23:55:21.950 INFO:teuthology.orchestra.run.smithi155.stdout:(117/152): python3-cherrypy-18.6.1-2.el9.noarch 7.2 MB/s | 358 kB 00:00 2024-04-24T23:55:22.001 INFO:teuthology.orchestra.run.smithi155.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.0 MB/s | 303 kB 00:00 2024-04-24T23:55:22.034 INFO:teuthology.orchestra.run.smithi155.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 1.1 MB/s | 35 kB 00:00 2024-04-24T23:55:22.085 INFO:teuthology.orchestra.run.smithi155.stdout:(120/152): python3-google-auth-2.29.0-1.el9.noa 4.1 MB/s | 206 kB 00:00 2024-04-24T23:55:22.261 INFO:teuthology.orchestra.run.smithi155.stdout:(121/152): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-04-24T23:55:22.302 INFO:teuthology.orchestra.run.smithi155.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 3.5 MB/s | 144 kB 00:00 2024-04-24T23:55:22.344 INFO:teuthology.orchestra.run.smithi155.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 260 kB/s | 11 kB 00:00 2024-04-24T23:55:22.386 INFO:teuthology.orchestra.run.smithi155.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 432 kB/s | 18 kB 00:00 2024-04-24T23:55:22.428 INFO:teuthology.orchestra.run.smithi155.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 565 kB/s | 23 kB 00:00 2024-04-24T23:55:22.470 INFO:teuthology.orchestra.run.smithi155.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 475 kB/s | 19 kB 00:00 2024-04-24T23:55:22.512 INFO:teuthology.orchestra.run.smithi155.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 479 kB/s | 20 kB 00:00 2024-04-24T23:55:22.595 INFO:teuthology.orchestra.run.smithi155.stdout:(128/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-24T23:55:22.662 INFO:teuthology.orchestra.run.smithi155.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 704 kB/s | 46 kB 00:00 2024-04-24T23:55:22.704 INFO:teuthology.orchestra.run.smithi155.stdout:(130/152): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-04-24T23:55:22.746 INFO:teuthology.orchestra.run.smithi155.stdout:(131/152): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-04-24T23:55:22.796 INFO:teuthology.orchestra.run.smithi155.stdout:(132/152): python3-pecan-1.4.2-3.el9.noarch.rpm 5.4 MB/s | 272 kB 00:00 2024-04-24T23:55:22.838 INFO:teuthology.orchestra.run.smithi155.stdout:(133/152): python3-portend-3.1.0-2.el9.noarch.r 397 kB/s | 16 kB 00:00 2024-04-24T23:55:22.880 INFO:teuthology.orchestra.run.smithi155.stdout:(134/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-04-24T23:55:22.922 INFO:teuthology.orchestra.run.smithi155.stdout:(135/152): python3-pyperclip-1.8.2-2.el9.noarch 687 kB/s | 28 kB 00:00 2024-04-24T23:55:22.965 INFO:teuthology.orchestra.run.smithi155.stdout:(136/152): python3-repoze-lru-0.7-16.el9.noarch 749 kB/s | 31 kB 00:00 2024-04-24T23:55:23.015 INFO:teuthology.orchestra.run.smithi155.stdout:(137/152): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-04-24T23:55:23.065 INFO:teuthology.orchestra.run.smithi155.stdout:(138/152): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-04-24T23:55:23.107 INFO:teuthology.orchestra.run.smithi155.stdout:(139/152): python3-tempora-5.0.0-2.el9.noarch.r 871 kB/s | 36 kB 00:00 2024-04-24T23:55:23.149 INFO:teuthology.orchestra.run.smithi155.stdout:(140/152): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-04-24T23:55:23.199 INFO:teuthology.orchestra.run.smithi155.stdout:(141/152): python3-webob-1.8.7-6.el9.noarch.rpm 4.6 MB/s | 230 kB 00:00 2024-04-24T23:55:23.241 INFO:teuthology.orchestra.run.smithi155.stdout:(142/152): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-04-24T23:55:23.300 INFO:teuthology.orchestra.run.smithi155.stdout:(143/152): python3-werkzeug-2.0.3-3.el9.1.noarc 7.2 MB/s | 427 kB 00:00 2024-04-24T23:55:23.342 INFO:teuthology.orchestra.run.smithi155.stdout:(144/152): python3-zc-lockfile-2.0-10.el9.noarc 490 kB/s | 20 kB 00:00 2024-04-24T23:55:23.392 INFO:teuthology.orchestra.run.smithi155.stdout:(145/152): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-04-24T23:55:23.500 INFO:teuthology.orchestra.run.smithi155.stdout:(146/152): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-24T23:55:24.009 INFO:teuthology.orchestra.run.smithi155.stdout:(147/152): librados2-19.0.0-2445.gd2c45d97.el9. 6.7 MB/s | 3.4 MB 00:00 2024-04-24T23:55:24.334 INFO:teuthology.orchestra.run.smithi155.stdout:(148/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 9.7 MB/s | 3.1 MB 00:00 2024-04-24T23:55:24.509 INFO:teuthology.orchestra.run.smithi155.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 7.8 MB/s | 1.3 MB 00:00 2024-04-24T23:55:24.627 INFO:teuthology.orchestra.run.smithi155.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-04-24T23:55:25.135 INFO:teuthology.orchestra.run.smithi155.stdout:(151/152): python3-babel-2.9.1-2.el9.noarch.rpm 714 kB/s | 6.0 MB 00:08 2024-04-24T23:55:25.774 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-04-24T23:55:25.870 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-24T23:55:25.941 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-24T23:55:26.041 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-24T23:55:26.096 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-24T23:55:26.147 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-24T23:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-24T23:55:26.720 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-24T23:55:26.827 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T23:55:27.009 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T23:55:27.045 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T23:55:27.174 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T23:55:27.219 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-24T23:55:27.530 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-24T23:55:27.591 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-24T23:55:27.616 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T23:55:27.774 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T23:55:27.800 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-24T23:55:27.887 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-24T23:55:27.918 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-24T23:55:27.981 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-24T23:55:28.289 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-24T23:55:28.342 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-24T23:55:28.526 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-24T23:55:28.643 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-24T23:55:28.685 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-24T23:55:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-24T23:55:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-24T23:55:28.879 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-24T23:55:28.941 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-24T23:55:28.985 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-24T23:55:29.024 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-24T23:55:29.140 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-24T23:55:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-24T23:55:29.243 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-24T23:55:29.295 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-24T23:55:29.395 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-24T23:55:29.437 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-24T23:55:29.489 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-24T23:55:29.536 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-24T23:55:29.656 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-24T23:55:29.725 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-24T23:55:29.833 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-24T23:55:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-24T23:55:30.083 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-24T23:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-24T23:55:30.873 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-24T23:55:30.909 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-24T23:55:30.954 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-24T23:55:30.994 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-24T23:55:31.058 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-24T23:55:31.318 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-24T23:55:31.387 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-24T23:55:31.455 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-24T23:55:31.571 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-24T23:55:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-24T23:55:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-24T23:55:31.717 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-24T23:55:31.758 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-24T23:55:31.820 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-24T23:55:31.878 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-24T23:55:32.073 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-24T23:55:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-24T23:55:32.168 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-24T23:55:32.224 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-24T23:55:32.352 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-24T23:55:32.393 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-24T23:55:32.440 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-24T23:55:32.475 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-24T23:55:32.508 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-24T23:55:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-24T23:55:32.865 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-24T23:55:32.939 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-24T23:55:32.983 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-24T23:55:33.035 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-24T23:55:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-24T23:55:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-24T23:55:33.206 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-24T23:55:33.246 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-24T23:55:33.286 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-24T23:55:33.350 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-24T23:55:33.394 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-24T23:55:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-24T23:55:33.590 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-24T23:55:33.635 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-24T23:55:33.705 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-24T23:55:33.850 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-24T23:55:33.923 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-24T23:55:34.868 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-24T23:55:34.922 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-24T23:55:34.955 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-24T23:55:35.075 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-24T23:55:35.141 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-24T23:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-24T23:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-24T23:55:35.523 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-24T23:55:35.554 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-24T23:55:35.659 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-24T23:55:36.473 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-24T23:55:36.615 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-24T23:55:38.174 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-24T23:55:38.268 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-24T23:55:38.301 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-24T23:55:38.368 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-24T23:55:38.753 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-24T23:55:38.805 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-24T23:55:38.934 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-24T23:55:38.971 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-24T23:55:39.030 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-24T23:55:39.562 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-24T23:55:39.608 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-24T23:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-24T23:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-24T23:55:41.284 INFO:teuthology.orchestra.run.smithi155.stdout:(152/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 757 kB/s | 16 MB 00:21 2024-04-24T23:55:41.288 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-24T23:55:41.289 INFO:teuthology.orchestra.run.smithi155.stdout:Total 5.9 MB/s | 220 MB 00:37 2024-04-24T23:55:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T23:55:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T23:55:43.113 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T23:55:43.169 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-24T23:55:43.342 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-24T23:55:43.343 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T23:55:43.343 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T23:55:43.343 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:55:43.386 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-24T23:55:44.083 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-24T23:55:44.334 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-24T23:55:44.335 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-24T23:55:46.997 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-24T23:55:46.997 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-24T23:55:53.522 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-24T23:55:53.623 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-24T23:55:53.708 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-24T23:55:53.821 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-24T23:55:53.878 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-24T23:55:53.910 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-24T23:55:54.037 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-24T23:55:54.496 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-24T23:55:54.607 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T23:55:54.800 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T23:55:54.825 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T23:55:54.979 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T23:55:55.024 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-24T23:55:55.363 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-24T23:55:55.434 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-24T23:55:55.470 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T23:55:55.633 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T23:55:55.671 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-24T23:55:55.797 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-24T23:55:55.822 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-24T23:55:55.900 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-24T23:55:56.352 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-24T23:55:56.393 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-24T23:55:56.393 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2024-04-24T23:55:56.394 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2024-04-24T23:55:56.394 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2024-04-24T23:55:56.394 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2024-04-24T23:55:56.394 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2024-04-24T23:55:56.394 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /root 2024-04-24T23:55:56.394 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2024-04-24T23:55:56.394 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:55:56.416 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-24T23:55:56.610 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-24T23:55:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-24T23:55:56.668 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-24T23:55:56.669 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:55:56.669 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T23:55:56.669 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:55:56.734 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-24T23:55:56.784 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-24T23:55:56.854 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-24T23:55:56.958 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-24T23:55:57.010 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-24T23:55:57.085 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-24T23:55:57.131 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-24T23:55:57.171 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-24T23:55:57.300 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-24T23:55:57.366 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-24T23:55:57.406 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-24T23:55:57.453 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-24T23:55:57.544 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-24T23:55:57.609 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-24T23:55:57.662 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-24T23:55:57.698 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-24T23:55:57.812 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-24T23:55:57.867 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-24T23:55:57.965 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-24T23:55:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-24T23:55:58.213 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-24T23:55:58.299 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-24T23:55:58.389 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-24T23:55:58.389 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:55:58.389 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T23:55:58.389 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T23:55:58.389 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T23:55:58.389 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:55:58.641 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-24T23:55:58.713 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-24T23:55:58.713 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:55:58.713 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T23:55:58.713 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T23:55:58.713 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T23:55:58.713 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:55:58.884 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-24T23:55:58.986 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-24T23:55:59.030 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-24T23:55:59.076 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-24T23:55:59.139 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-24T23:55:59.200 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-24T23:55:59.220 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-24T23:55:59.273 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-24T23:55:59.273 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:55:59.273 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T23:55:59.274 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T23:55:59.274 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T23:55:59.274 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:55:59.399 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-24T23:55:59.459 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-24T23:55:59.507 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-24T23:55:59.535 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-24T23:55:59.592 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-24T23:55:59.680 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-24T23:55:59.768 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-24T23:55:59.776 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-24T23:55:59.815 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-24T23:55:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-24T23:55:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-24T23:55:59.914 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-24T23:55:59.952 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-24T23:56:00.005 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-24T23:56:00.021 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-24T23:56:00.070 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-24T23:56:00.135 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-24T23:56:00.194 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-24T23:56:00.252 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-24T23:56:00.294 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-24T23:56:00.343 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-24T23:56:00.361 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-24T23:56:00.401 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-24T23:56:00.438 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-24T23:56:00.496 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-24T23:56:00.638 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-24T23:56:00.707 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-24T23:56:00.765 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-24T23:56:00.804 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-24T23:56:00.837 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-24T23:56:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-24T23:56:01.027 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-24T23:56:01.038 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-24T23:56:01.092 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-24T23:56:01.201 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-24T23:56:01.230 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-24T23:56:01.232 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-24T23:56:01.275 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-24T23:56:01.326 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-24T23:56:01.370 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-24T23:56:01.428 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-24T23:56:01.500 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-24T23:56:01.547 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-24T23:56:01.593 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-24T23:56:01.641 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-24T23:56:01.716 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-24T23:56:01.764 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-24T23:56:01.906 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-24T23:56:01.985 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-24T23:56:02.055 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-24T23:56:02.130 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-24T23:56:02.285 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-24T23:56:02.360 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-24T23:56:02.536 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-24T23:56:02.584 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-24T23:56:03.335 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-24T23:56:03.392 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-24T23:56:03.425 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-24T23:56:03.570 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-24T23:56:03.653 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-24T23:56:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-24T23:56:03.708 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-24T23:56:03.758 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-24T23:56:03.801 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-24T23:56:03.852 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-24T23:56:04.025 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-24T23:56:04.063 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-24T23:56:04.069 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-24T23:56:04.106 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-24T23:56:04.151 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-24T23:56:04.151 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:04.151 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T23:56:04.151 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T23:56:04.151 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T23:56:04.151 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:04.220 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-24T23:56:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-24T23:56:04.259 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-24T23:56:04.392 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-24T23:56:04.470 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-24T23:56:05.107 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-24T23:56:05.255 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-24T23:56:05.475 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-24T23:56:05.505 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-24T23:56:05.580 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-24T23:56:05.580 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:05.580 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T23:56:05.580 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:56:05.580 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:56:05.580 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:05.631 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-24T23:56:05.726 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-24T23:56:05.726 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:05.726 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T23:56:05.726 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:05.798 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-24T23:56:05.893 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-24T23:56:05.893 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:05.893 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-24T23:56:05.893 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:56:05.893 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:56:05.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:06.299 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-24T23:56:06.370 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-24T23:56:06.370 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:06.370 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T23:56:06.370 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T23:56:06.370 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T23:56:06.370 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:06.873 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-24T23:56:07.003 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-24T23:56:07.048 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-24T23:56:07.100 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-24T23:56:07.485 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-24T23:56:07.523 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-24T23:56:07.646 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-24T23:56:07.680 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-24T23:56:07.735 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-24T23:56:08.269 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-24T23:56:08.301 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-24T23:56:08.401 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-24T23:56:08.428 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-24T23:56:11.279 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-24T23:56:11.322 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-24T23:56:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T23:56:11.415 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-24T23:56:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T23:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-24T23:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-24T23:56:11.833 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-24T23:56:11.892 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-24T23:56:11.920 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-24T23:56:12.062 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T23:56:12.111 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-24T23:56:12.337 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-24T23:56:12.337 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T23:56:12.338 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T23:56:12.338 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:12.412 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-24T23:56:12.719 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T23:56:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T23:56:12.861 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T23:56:14.203 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-24T23:56:14.317 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-24T23:56:14.401 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-24T23:56:14.575 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-24T23:56:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-24T23:56:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-24T23:56:14.754 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-24T23:56:14.797 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-24T23:56:14.797 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-24T23:56:14.944 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-24T23:56:15.066 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T23:56:15.371 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T23:56:15.371 INFO:teuthology.orchestra.run.smithi096.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-24T23:56:15.371 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:21.000 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-24T23:56:21.000 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-24T23:56:21.000 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-24T23:56:21.000 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-24T23:56:21.000 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-24T23:56:21.000 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-24T23:56:21.000 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-24T23:56:21.000 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-24T23:56:21.001 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-24T23:56:21.002 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-24T23:56:21.002 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-24T23:56:21.002 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-24T23:56:21.002 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-24T23:56:21.014 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-24T23:56:21.014 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-24T23:56:21.014 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-24T23:56:21.014 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-24T23:56:21.014 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-24T23:56:21.014 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-24T23:56:21.014 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-24T23:56:21.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-24T23:56:21.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-24T23:56:21.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-24T23:56:21.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-24T23:56:21.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-24T23:56:21.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-24T23:56:21.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-24T23:56:21.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-24T23:56:21.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-24T23:56:21.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-24T23:56:21.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-24T23:56:21.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-24T23:56:21.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-24T23:56:21.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-24T23:56:23.287 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout:Upgraded: 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: automake-1.16.2-8.el9.noarch 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: bison-3.7.4-5.el9.x86_64 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.288 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: flex-2.6.4-9.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T23:56:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T23:56:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-13.14-1.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-24T23:56:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T23:56:23.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T23:56:23.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T23:56:23.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T23:56:23.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T23:56:23.297 INFO:teuthology.orchestra.run.smithi096.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-04-24T23:56:23.870 DEBUG:teuthology.parallel:result is None 2024-04-24T23:56:25.497 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-24T23:56:25.497 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2024-04-24T23:56:25.497 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2024-04-24T23:56:25.497 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2024-04-24T23:56:25.497 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2024-04-24T23:56:25.497 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2024-04-24T23:56:25.497 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /root 2024-04-24T23:56:25.497 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2024-04-24T23:56:25.497 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:25.716 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-24T23:56:25.764 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-24T23:56:25.764 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:25.765 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T23:56:25.765 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:27.400 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-24T23:56:27.477 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-24T23:56:27.477 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:27.477 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T23:56:27.477 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T23:56:27.477 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T23:56:27.477 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:27.750 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-24T23:56:27.820 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-24T23:56:27.820 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:27.820 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T23:56:27.820 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T23:56:27.820 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T23:56:27.820 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:28.342 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-24T23:56:28.426 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-24T23:56:28.426 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:28.426 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T23:56:28.426 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T23:56:28.426 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T23:56:28.426 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:28.559 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-24T23:56:28.622 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-24T23:56:28.713 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-24T23:56:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-24T23:56:29.013 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-24T23:56:29.099 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-24T23:56:29.208 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-24T23:56:29.406 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-24T23:56:29.471 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-24T23:56:29.511 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-24T23:56:29.552 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-24T23:56:30.492 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-24T23:56:30.540 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-24T23:56:30.594 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-24T23:56:30.704 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-24T23:56:30.732 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-24T23:56:32.049 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-24T23:56:32.092 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-24T23:56:33.196 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-24T23:56:33.234 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-24T23:56:33.382 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-24T23:56:33.567 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-24T23:56:33.603 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-24T23:56:33.697 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-24T23:56:33.697 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:33.697 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T23:56:33.697 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T23:56:33.697 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T23:56:33.697 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:33.754 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-24T23:56:33.792 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-24T23:56:33.910 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-24T23:56:33.994 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-24T23:56:34.989 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-24T23:56:35.023 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-24T23:56:35.090 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-24T23:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T23:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:35.140 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-24T23:56:35.233 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-24T23:56:35.233 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:35.234 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T23:56:35.234 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:35.308 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-24T23:56:35.395 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-24T23:56:35.395 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:35.395 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-24T23:56:35.395 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:56:35.396 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:56:35.396 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-24T23:56:35.823 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-24T23:56:35.823 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T23:56:35.823 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T23:56:35.823 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T23:56:35.823 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T23:56:35.823 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:40.706 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-24T23:56:40.758 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-24T23:56:40.834 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-24T23:56:40.899 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-24T23:56:40.954 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-24T23:56:41.282 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-24T23:56:41.335 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-24T23:56:41.363 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-24T23:56:42.222 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T23:56:42.268 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T23:56:42.323 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T23:56:43.630 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-24T23:56:43.742 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-24T23:56:43.830 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-24T23:56:44.009 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-24T23:56:44.056 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-24T23:56:44.056 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-24T23:56:44.165 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-24T23:56:44.205 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-24T23:56:44.205 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-24T23:56:44.369 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-24T23:56:44.501 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T23:56:44.795 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T23:56:44.795 INFO:teuthology.orchestra.run.smithi155.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-24T23:56:44.795 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:50.741 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-24T23:56:50.741 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-24T23:56:50.741 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-24T23:56:50.741 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-24T23:56:50.742 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-24T23:56:50.743 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-24T23:56:50.756 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-24T23:56:50.757 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-24T23:56:50.757 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-24T23:56:50.757 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-24T23:56:50.757 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-24T23:56:50.757 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-24T23:56:50.757 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-24T23:56:50.758 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-24T23:56:50.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-24T23:56:50.760 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-24T23:56:50.761 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-24T23:56:50.762 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-24T23:56:50.763 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-24T23:56:50.764 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-24T23:56:50.765 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-24T23:56:50.766 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-24T23:56:50.766 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-24T23:56:50.766 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-24T23:56:50.766 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-24T23:56:50.766 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-24T23:56:50.766 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-24T23:56:50.766 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-24T23:56:50.767 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-24T23:56:50.767 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-24T23:56:50.767 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-24T23:56:50.767 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-24T23:56:50.767 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-24T23:56:50.767 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-24T23:56:50.767 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-24T23:56:50.767 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-24T23:56:50.767 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-24T23:56:53.302 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T23:56:53.302 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:53.302 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2024-04-24T23:56:53.302 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.302 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.302 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.2-8.el9.noarch 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.7.4-5.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.303 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.304 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.4-9.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T23:56:53.305 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.306 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-13.14-1.el9.x86_64 2024-04-24T23:56:53.307 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T23:56:53.308 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T23:56:53.309 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T23:56:53.310 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.311 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T23:56:53.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T23:56:53.313 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-24T23:56:53.314 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-24T23:56:53.314 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T23:56:53.314 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-24T23:56:53.314 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:53.314 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-24T23:56:53.977 DEBUG:teuthology.parallel:result is None 2024-04-24T23:56:53.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:56:54.199 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T23:56:54.276 INFO:teuthology.orchestra.run.smithi096.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-24T23:56:54.276 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-24T23:56:54.276 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-24T23:56:54.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:56:54.418 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T23:56:54.473 INFO:teuthology.orchestra.run.smithi155.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-24T23:56:54.474 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-24T23:56:54.474 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-24T23:56:54.476 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T23:56:54.476 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:54.476 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T23:56:54.569 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:56:54.569 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T23:56:54.651 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T23:56:54.651 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:54.651 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T23:56:54.740 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T23:56:54.824 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:56:54.824 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T23:56:54.898 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T23:56:55.004 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T23:56:55.005 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:55.005 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T23:56:55.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T23:56:55.200 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:56:55.200 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T23:56:55.271 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T23:56:55.376 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T23:56:55.377 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:55.377 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T23:56:55.456 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T23:56:55.525 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:56:55.525 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T23:56:55.595 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T23:56:55.698 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T23:56:55.780 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T23:56:55.780 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-04-24T23:56:55.788 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2024-04-24T23:56:55.854 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T23:56:55.854 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T23:56:55.858 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T23:56:55.922 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T23:56:55.922 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T23:56:55.927 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T23:56:55.999 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-24T23:56:55.999 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-24T23:56:55.999 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-24T23:56:55.999 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:55.999 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T23:56:56.043 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T23:56:56.232 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-24T23:56:56.310 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:56:56.310 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T23:56:56.349 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T23:56:56.532 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-24T23:56:56.601 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T23:56:56.602 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T23:56:56.602 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222', 'branch': 'squid', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672222', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJxxWEyA5ASCzp+iq+DL+CyeReph4hqXrkUosLqHO3it2BtXuxxOyrqkRuxZafeHsQpZElfzjFT21FraGaJkK3M=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGM1LImTnbwZ6sGA9gZBaqlqf3D0W1smXSvcL37ueEU3Y6gUSRE1jhYvCG+M3/dIYPjwbEbP3yFt07YUxXz5Yw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T23:56:56.602 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T23:56:56.610 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T23:56:56.661 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T23:56:56.665 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T23:56:56.750 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:56.750 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T23:56:56.803 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T23:56:56.804 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-04-24T23:56:56.857 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T23:56:56.857 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:56:56.857 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-24T23:56:56.857 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:56:56.857 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T23:56:56.858 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-24 23:56:15.837860101 +0000 2024-04-24T23:56:56.858 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-24 23:53:37.735147312 +0000 2024-04-24T23:56:56.858 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-24 23:53:37.735147312 +0000 2024-04-24T23:56:56.858 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-04-24 23:53:37.735147312 +0000 2024-04-24T23:56:56.858 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T23:56:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-24T23:56:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-24T23:56:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000338003 s, 1.5 MB/s 2024-04-24T23:56:56.940 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T23:56:56.994 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-04-24T23:56:57.044 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T23:56:57.044 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:56:57.044 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-24T23:56:57.045 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:56:57.045 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T23:56:57.045 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-24 23:56:15.838860078 +0000 2024-04-24T23:56:57.045 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-24 23:53:38.337134009 +0000 2024-04-24T23:56:57.045 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-24 23:53:38.337134009 +0000 2024-04-24T23:56:57.045 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-04-24 23:53:38.337134009 +0000 2024-04-24T23:56:57.045 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T23:56:57.121 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-24T23:56:57.121 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-24T23:56:57.121 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000299427 s, 1.7 MB/s 2024-04-24T23:56:57.124 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T23:56:57.175 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-04-24T23:56:57.220 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T23:56:57.220 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:56:57.220 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-04-24T23:56:57.221 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:56:57.221 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T23:56:57.221 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-24 23:56:15.839860056 +0000 2024-04-24T23:56:57.221 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-24 23:53:38.959120264 +0000 2024-04-24T23:56:57.221 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-24 23:53:38.959120264 +0000 2024-04-24T23:56:57.221 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-04-24 23:53:38.959120264 +0000 2024-04-24T23:56:57.221 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T23:56:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-24T23:56:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-24T23:56:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000380539 s, 1.3 MB/s 2024-04-24T23:56:57.348 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T23:56:57.405 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-04-24T23:56:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T23:56:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:56:57.455 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-24T23:56:57.455 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:56:57.455 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T23:56:57.456 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-24 23:56:15.840860033 +0000 2024-04-24T23:56:57.456 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-24 23:53:39.564106894 +0000 2024-04-24T23:56:57.456 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-24 23:53:39.564106894 +0000 2024-04-24T23:56:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-04-24 23:53:39.564106894 +0000 2024-04-24T23:56:57.456 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T23:56:57.531 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-24T23:56:57.532 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-24T23:56:57.532 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000298509 s, 1.7 MB/s 2024-04-24T23:56:57.535 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T23:56:57.591 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:56:57.591 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:56:57.591 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T23:56:57.633 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T23:56:57.633 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-04-24T23:56:57.712 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T23:56:57.712 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:56:57.712 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-24T23:56:57.712 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:56:57.712 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T23:56:57.712 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-24 23:56:45.343202188 +0000 2024-04-24T23:56:57.712 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-24 23:53:38.248666155 +0000 2024-04-24T23:56:57.713 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-24 23:53:38.248666155 +0000 2024-04-24T23:56:57.713 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-24 23:53:38.248666155 +0000 2024-04-24T23:56:57.713 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T23:56:57.811 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-24T23:56:57.811 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-24T23:56:57.811 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000370108 s, 1.4 MB/s 2024-04-24T23:56:57.814 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T23:56:57.852 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-04-24T23:56:57.932 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T23:56:57.932 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:56:57.933 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-24T23:56:57.933 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:56:57.933 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T23:56:57.933 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-24 23:56:45.344202167 +0000 2024-04-24T23:56:57.933 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-24 23:53:38.821654557 +0000 2024-04-24T23:56:57.933 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-24 23:53:38.821654557 +0000 2024-04-24T23:56:57.933 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-24 23:53:38.821654557 +0000 2024-04-24T23:56:57.933 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T23:56:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-24T23:56:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-24T23:56:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000304731 s, 1.7 MB/s 2024-04-24T23:56:58.036 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T23:56:58.075 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-04-24T23:56:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T23:56:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:56:58.155 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-24T23:56:58.155 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:56:58.155 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T23:56:58.156 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-24 23:56:45.344202167 +0000 2024-04-24T23:56:58.156 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-24 23:53:39.407642696 +0000 2024-04-24T23:56:58.156 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-24 23:53:39.407642696 +0000 2024-04-24T23:56:58.156 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-24 23:53:39.407642696 +0000 2024-04-24T23:56:58.156 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T23:56:58.252 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-24T23:56:58.252 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-24T23:56:58.252 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000352666 s, 1.5 MB/s 2024-04-24T23:56:58.255 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T23:56:58.296 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-04-24T23:56:58.378 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T23:56:58.378 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:56:58.378 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-04-24T23:56:58.378 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:56:58.378 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T23:56:58.378 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-24 23:56:45.345202147 +0000 2024-04-24T23:56:58.378 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-24 23:53:40.026630168 +0000 2024-04-24T23:56:58.378 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-24 23:53:40.026630168 +0000 2024-04-24T23:56:58.378 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-24 23:53:40.026630168 +0000 2024-04-24T23:56:58.378 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T23:56:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-24T23:56:58.484 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-24T23:56:58.484 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000258336 s, 2.0 MB/s 2024-04-24T23:56:58.486 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T23:56:58.525 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:56:58.526 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T23:56:58.526 INFO:tasks.ceph:Generating config... 2024-04-24T23:56:58.527 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-24T23:56:58.527 INFO:tasks.ceph:[client] debug client = 20 2024-04-24T23:56:58.527 INFO:tasks.ceph:[client] debug ms = 1 2024-04-24T23:56:58.527 INFO:tasks.ceph:[client] pid file = 2024-04-24T23:56:58.527 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-24T23:56:58.527 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-24T23:56:58.527 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-24T23:56:58.527 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-24T23:56:58.527 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-24T23:56:58.527 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-24T23:56:58.527 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-24T23:56:58.527 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-24T23:56:58.528 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-24T23:56:58.528 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-24T23:56:58.528 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-24T23:56:58.528 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-24T23:56:58.529 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-24T23:56:58.529 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T23:56:58.530 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T23:56:58.905 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T23:56:58.914 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T23:56:59.038 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T23:56:59.116 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.96'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2024-04-24T23:56:59.116 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.96,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-24T23:56:59.117 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:59.117 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T23:56:59.166 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.96 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:56:59.317 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:56:59.317 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: generated fsid c95ce1e9-7a69-4f8e-a964-bd4778092d3c 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = quincy 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 0 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:fsid c95ce1e9-7a69-4f8e-a964-bd4778092d3c 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:last_changed 2024-04-24T23:56:59.318770+0000 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-04-24T23:56:59.318770+0000 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:min_mon_release 17 (quincy) 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:election_strategy: 1 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:0: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.a 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2024-04-24T23:56:59.318 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-24T23:56:59.321 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T23:56:59.370 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c95ce1e9-7a69-4f8e-a964-bd4778092d3c... 2024-04-24T23:56:59.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T23:56:59.378 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T23:56:59.491 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-04-24T23:56:59.491 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-04-24T23:56:59.491 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T23:56:59.491 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-04-24T23:56:59.491 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-04-24T23:56:59.492 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T23:56:59.493 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.96,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-04-24T23:56:59.494 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on skipped message = False 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = c95ce1e9-7a69-4f8e-a964-bd4778092d3c 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-04-24T23:56:59.495 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-04-24T23:56:59.496 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 1/20 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 1/20 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 4/10 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T23:56:59.497 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:56:59.498 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: debug finisher = 20 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-04-24T23:56:59.499 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-04-24T23:56:59.500 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-24T23:56:59.501 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-24T23:56:59.502 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-04-24T23:56:59.503 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-04-24T23:56:59.503 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-04-24T23:56:59.503 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-04-24T23:56:59.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-04-24T23:56:59.503 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-04-24T23:56:59.503 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-04-24T23:56:59.503 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-04-24T23:56:59.503 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T23:56:59.504 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T23:56:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-04-24T23:56:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.96,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on skipped message = False 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = c95ce1e9-7a69-4f8e-a964-bd4778092d3c 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-04-24T23:56:59.507 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug trim objects = true 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: bdev async discard = True 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: bdev enable discard = True 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore allocator = bitmap 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 1/20 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 1/20 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 4/10 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-04-24T23:56:59.509 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:56:59.510 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: debug finisher = 20 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-04-24T23:56:59.511 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-04-24T23:56:59.512 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: mon down mkfs grace = 300 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: mon op complaint time = 120 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: client mount timeout = 600 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-04-24T23:56:59.513 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = "" 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mds] 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds = 20 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds balancer = 20 2024-04-24T23:56:59.514 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-24T23:56:59.515 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug frag = True 2024-04-24T23:56:59.515 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug scatterstat = True 2024-04-24T23:56:59.515 INFO:teuthology.orchestra.run.smithi096.stdout: mds op complaint time = 180 2024-04-24T23:56:59.515 INFO:teuthology.orchestra.run.smithi096.stdout: mds verify scatter = True 2024-04-24T23:56:59.515 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-04-24T23:56:59.515 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-04-24T23:56:59.515 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-04-24T23:56:59.534 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T23:56:59.534 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T23:56:59.665 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T23:56:59.665 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:59.665 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T23:56:59.719 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:59.720 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T23:56:59.771 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-04-24T23:56:59.771 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:59.771 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T23:56:59.771 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T23:56:59.900 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:56:59.901 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:56:59.997 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2024-04-24T23:56:59.997 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:56:59.997 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T23:56:59.997 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T23:57:00.083 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:00.083 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:00.160 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T23:57:00.161 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T23:57:00.161 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T23:57:00.306 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T23:57:00.314 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T23:57:00.445 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T23:57:00.454 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T23:57:00.454 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T23:57:00.618 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T23:57:00.627 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-24T23:57:00.697 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-24T23:57:00.829 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-24T23:57:00.837 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-24T23:57:00.912 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T23:57:01.035 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T23:57:01.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-24T23:57:01.124 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-24T23:57:01.273 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-24T23:57:01.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-24T23:57:01.364 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T23:57:01.364 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T23:57:01.485 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T23:57:01.523 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-24T23:57:01.637 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-24T23:57:01.682 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-24T23:57:01.799 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-24T23:57:01.843 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-24T23:57:01.963 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-24T23:57:02.009 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T23:57:02.009 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T23:57:02.009 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T23:57:02.099 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:57:02.099 INFO:tasks.ceph:role: osd.0 2024-04-24T23:57:02.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-24T23:57:02.099 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T23:57:02.187 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:57:02.188 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:57:02.188 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:57:02.188 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T23:57:02.188 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:57:02.188 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:57:02.188 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:57:02.188 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T23:57:02.188 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:57:02.188 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:57:02.605 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-24T23:57:02.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-24T23:57:02.613 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T23:57:02.744 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T23:57:02.821 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T23:57:02.894 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:57:02.894 INFO:tasks.ceph:role: osd.1 2024-04-24T23:57:02.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-24T23:57:02.894 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T23:57:02.971 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:57:02.971 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:57:02.971 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:57:02.971 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T23:57:02.971 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:57:02.971 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:57:02.971 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:57:02.971 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T23:57:02.972 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:57:02.972 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:57:03.329 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-24T23:57:03.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-24T23:57:03.334 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-24T23:57:03.452 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T23:57:03.531 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T23:57:03.603 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:57:03.604 INFO:tasks.ceph:role: osd.2 2024-04-24T23:57:03.604 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-24T23:57:03.604 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:57:03.684 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:57:04.067 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-24T23:57:04.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-24T23:57:04.071 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-24T23:57:04.199 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T23:57:04.279 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T23:57:04.357 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:57:04.357 INFO:tasks.ceph:role: osd.3 2024-04-24T23:57:04.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-24T23:57:04.357 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T23:57:04.440 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:57:04.441 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:57:04.441 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:57:04.441 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T23:57:04.441 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:57:04.441 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:57:04.441 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:57:04.441 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T23:57:04.441 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:57:04.441 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:57:04.858 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-24T23:57:04.864 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-24T23:57:04.864 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-24T23:57:05.006 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T23:57:05.095 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:05.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:05.264+0000 7f9af8188640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-24T23:57:05.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:05.264+0000 7f9af8188640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-24T23:57:05.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:05.265+0000 7f9af8188640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T23:57:05.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:05.265+0000 7f9af8188640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T23:57:05.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:05.265+0000 7f9af8188640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T23:57:05.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:05.268+0000 7f9af8188640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-24T23:57:08.516 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T23:57:08.601 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:08.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:08.725+0000 7eff57820640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-24T23:57:08.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:08.726+0000 7eff57820640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-24T23:57:08.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:08.726+0000 7eff57820640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T23:57:08.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:08.726+0000 7eff57820640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T23:57:08.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:08.726+0000 7eff57820640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T23:57:08.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:08.728+0000 7eff57820640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-24T23:57:11.733 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T23:57:11.822 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:11.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:11.948+0000 7f5221bbe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-24T23:57:11.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:11.949+0000 7f5221bbe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-24T23:57:11.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:11.949+0000 7f5221bbe640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T23:57:11.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:11.949+0000 7f5221bbe640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T23:57:11.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:11.949+0000 7f5221bbe640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T23:57:11.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:11.951+0000 7f5221bbe640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-24T23:57:15.173 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T23:57:15.259 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:15.386+0000 7fb370818640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-24T23:57:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:15.387+0000 7fb370818640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-24T23:57:15.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:15.387+0000 7fb370818640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T23:57:15.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:15.387+0000 7fb370818640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T23:57:15.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:15.387+0000 7fb370818640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T23:57:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:15.389+0000 7fb370818640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-24T23:57:18.618 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T23:57:18.703 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-24T23:57:18.794 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:57:18.794 INFO:tasks.ceph:role: osd.4 2024-04-24T23:57:18.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-24T23:57:18.794 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T23:57:18.883 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:57:18.883 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:57:18.883 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:57:18.883 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T23:57:18.883 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:57:18.883 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:57:18.884 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:57:18.884 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T23:57:18.884 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:57:18.884 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:57:19.305 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-24T23:57:19.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-24T23:57:19.312 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-24T23:57:19.464 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-24T23:57:19.555 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-24T23:57:19.630 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:57:19.631 INFO:tasks.ceph:role: osd.5 2024-04-24T23:57:19.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-24T23:57:19.631 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T23:57:19.711 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:57:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:57:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:57:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T23:57:19.712 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:57:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:57:19.712 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:57:19.712 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T23:57:19.712 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:57:19.712 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:57:20.069 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-24T23:57:20.074 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-24T23:57:20.075 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-24T23:57:20.171 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-24T23:57:20.239 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-24T23:57:20.301 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:57:20.301 INFO:tasks.ceph:role: osd.6 2024-04-24T23:57:20.301 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-24T23:57:20.301 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T23:57:20.379 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:57:20.379 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:57:20.380 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:57:20.380 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T23:57:20.380 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:57:20.380 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:57:20.380 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:57:20.380 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T23:57:20.381 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:57:20.381 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:57:20.762 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-24T23:57:20.768 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-24T23:57:20.768 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-24T23:57:20.875 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-24T23:57:20.952 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-24T23:57:21.018 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:57:21.018 INFO:tasks.ceph:role: osd.7 2024-04-24T23:57:21.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-24T23:57:21.019 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:57:21.099 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:57:21.510 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-24T23:57:21.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-24T23:57:21.516 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-24T23:57:21.686 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-24T23:57:21.782 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:21.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:21.920+0000 7f7827e15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-24T23:57:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:21.921+0000 7f7827e15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-24T23:57:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:21.921+0000 7f7827e15640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T23:57:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:21.921+0000 7f7827e15640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T23:57:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:21.921+0000 7f7827e15640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T23:57:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:21.925+0000 7f7827e15640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-24T23:57:25.152 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-24T23:57:25.232 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:25.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:25.354+0000 7fe55ed50640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-24T23:57:25.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:25.355+0000 7fe55ed50640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-24T23:57:25.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:25.355+0000 7fe55ed50640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T23:57:25.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:25.355+0000 7fe55ed50640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T23:57:25.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:25.355+0000 7fe55ed50640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T23:57:25.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:25.357+0000 7fe55ed50640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-24T23:57:26.604 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:57:26.611 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:57:28.572 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-24T23:57:28.659 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:28.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:28.786+0000 7fdf60126640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-24T23:57:28.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:28.787+0000 7fdf60126640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-24T23:57:28.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:28.787+0000 7fdf60126640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T23:57:28.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:28.787+0000 7fdf60126640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T23:57:28.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:28.787+0000 7fdf60126640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T23:57:28.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:28.789+0000 7fdf60126640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-24T23:57:31.993 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-24T23:57:32.078 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:32.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:32.201+0000 7f7975f4c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-24T23:57:32.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:32.202+0000 7f7975f4c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-24T23:57:32.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:32.202+0000 7f7975f4c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T23:57:32.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:32.202+0000 7f7975f4c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T23:57:32.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:32.202+0000 7f7975f4c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T23:57:32.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:32.205+0000 7f7975f4c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-24T23:57:35.667 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-24T23:57:35.749 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T23:57:35.750 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:35.750 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-24T23:57:35.847 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:35.847 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-24T23:57:35.929 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:35.930 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-24T23:57:36.010 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:36.011 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T23:57:36.088 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:36.088 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T23:57:36.215 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:36.215 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T23:57:36.291 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:36.291 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T23:57:36.419 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:36.419 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T23:57:36.507 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:36.507 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-24T23:57:36.592 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:36.592 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-24T23:57:36.676 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:36.676 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-24T23:57:36.752 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:36.752 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-24T23:57:36.880 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:36.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-24T23:57:36.965 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:36.965 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-24T23:57:37.049 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:37.049 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T23:57:37.106 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:37.106 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-24T23:57:37.158 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:37.158 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-24T23:57:37.215 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:37.215 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-24T23:57:37.268 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T23:57:37.268 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T23:57:37.275 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T23:57:37.350 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBMnClm2ppOEhAALB8T24BRkDb/4b30+tBYgg== 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBMnClmF/jwJBAAmGfIIb43eyPbE+r3ohORJQ== 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBMnClmgViHMRAAc35ovhN/crf8yS69YqFoGA== 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBRnClmjoHRDxAAFqTu+Jr6Dqflzm+2wPFTNg== 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBUnClmt6pRKxAAgDgQYbqfvEwtaFTjx4nF8g== 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2024-04-24T23:57:37.351 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBXnClm81adOBAAtSqQ0aJcfugi6bysL3l0bw== 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBbnClmh+4dFxAAT9yF+cMijpFCNWnEDeVUZw== 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBMnClm/dinGhAAQQTuWQasKu6Nwi/jWmBD2A== 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBNnClmfcwuAhAAJSbgV/+L/+mVc5zO8FEtfQ== 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBNnClmLxdbEBAA0CVvb3VRLAa2ACTXZ1r4MQ== 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBhnClmtQHsNhAASylddRopDyWb25vOETk/SA== 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBlnClmEC42FRAAv4ct19yMQnOw2N8HFPNZFw== 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2024-04-24T23:57:37.352 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBonClmWCL4LhAA46sPqIX8an3HwZBcsoWCnw== 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBsnClmvkgcDBAAdFzpyHzg2ZPpDJtNqYwU9w== 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBNnClmJTIAHRAAQWQYHUYotRYXVJCsgrfvDg== 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout:[client.2] 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBNnClmJrYSJhAAmzwMW00q2QB+6i6PaGvj6A== 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBNnClmmI6/LxAAQdvALs9pDsxJzGxcbnzzgw== 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout:[client.3] 2024-04-24T23:57:37.353 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBNnClm6993ORAAxz/wGaGODYnNkYFMceoU/Q== 2024-04-24T23:57:37.354 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2024-04-24T23:57:37.354 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBMnClm2ppOEhAALB8T24BRkDb/4b30+tBYgg== 2024-04-24T23:57:37.354 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-24T23:57:37.354 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBMnClmF/jwJBAAmGfIIb43eyPbE+r3ohORJQ== 2024-04-24T23:57:37.354 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2024-04-24T23:57:37.354 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBMnClmgViHMRAAc35ovhN/crf8yS69YqFoGA== 2024-04-24T23:57:37.354 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2024-04-24T23:57:37.354 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBRnClmjoHRDxAAFqTu+Jr6Dqflzm+2wPFTNg== 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBUnClmt6pRKxAAgDgQYbqfvEwtaFTjx4nF8g== 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBXnClm81adOBAAtSqQ0aJcfugi6bysL3l0bw== 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBbnClmh+4dFxAAT9yF+cMijpFCNWnEDeVUZw== 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBMnClm/dinGhAAQQTuWQasKu6Nwi/jWmBD2A== 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBNnClmfcwuAhAAJSbgV/+L/+mVc5zO8FEtfQ== 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBNnClmLxdbEBAA0CVvb3VRLAa2ACTXZ1r4MQ== 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.4] 2024-04-24T23:57:37.355 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBhnClmtQHsNhAASylddRopDyWb25vOETk/SA== 2024-04-24T23:57:37.356 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.5] 2024-04-24T23:57:37.356 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBlnClmEC42FRAAv4ct19yMQnOw2N8HFPNZFw== 2024-04-24T23:57:37.356 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.6] 2024-04-24T23:57:37.356 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBonClmWCL4LhAA46sPqIX8an3HwZBcsoWCnw== 2024-04-24T23:57:37.356 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.7] 2024-04-24T23:57:37.356 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBsnClmvkgcDBAAdFzpyHzg2ZPpDJtNqYwU9w== 2024-04-24T23:57:37.356 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-04-24T23:57:37.357 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBNnClmJTIAHRAAQWQYHUYotRYXVJCsgrfvDg== 2024-04-24T23:57:37.357 INFO:teuthology.orchestra.run.smithi096.stdout:[client.2] 2024-04-24T23:57:37.357 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBNnClmJrYSJhAAmzwMW00q2QB+6i6PaGvj6A== 2024-04-24T23:57:37.357 INFO:teuthology.orchestra.run.smithi096.stdout:[client.1] 2024-04-24T23:57:37.357 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBNnClmmI6/LxAAQdvALs9pDsxJzGxcbnzzgw== 2024-04-24T23:57:37.357 INFO:teuthology.orchestra.run.smithi096.stdout:[client.3] 2024-04-24T23:57:37.357 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBNnClm6993ORAAxz/wGaGODYnNkYFMceoU/Q== 2024-04-24T23:57:37.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T23:57:37.409 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T23:57:37.547 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:57:37.553 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:57:37.687 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:57:37.695 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:57:37.830 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:37.838 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:37.967 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:37.971 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:38.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:38.104 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:38.236 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:38.241 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:38.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T23:57:38.377 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T23:57:38.510 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:57:38.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:57:38.648 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:57:38.653 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:57:38.788 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:38.793 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:38.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:38.932 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:39.061 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:39.067 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:39.198 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:39.207 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:57:39.339 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:57:39.343 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:57:39.477 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:57:39.484 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:57:39.619 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:57:39.624 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:57:39.758 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:57:39.764 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:57:39.897 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T23:57:39.897 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T23:57:39.979 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T23:57:40.130 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T23:57:40.199 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-24T23:57:40.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T23:57:40.417 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-24T23:57:40.491 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-24T23:57:40.568 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T23:57:40.713 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-24T23:57:40.783 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:40.789 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:57:40.840 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T23:57:40.841 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T23:57:40.841 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T23:57:40.846 INFO:tasks.ceph.mon.a:Started 2024-04-24T23:57:40.846 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-24T23:57:40.847 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-24T23:57:40.851 INFO:tasks.ceph.mon.b:Started 2024-04-24T23:57:40.851 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-24T23:57:40.851 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-24T23:57:40.855 INFO:tasks.ceph.mon.c:Started 2024-04-24T23:57:40.855 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T23:57:40.855 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-24T23:57:40.855 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-24T23:57:40.860 INFO:tasks.ceph.mgr.y:Started 2024-04-24T23:57:40.860 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T23:57:40.861 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T23:57:40.864 INFO:tasks.ceph.mgr.x:Started 2024-04-24T23:57:40.865 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T23:57:40.865 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T23:57:41.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.042+0000 7f777f200640 1 Processor -- start 2024-04-24T23:57:41.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.042+0000 7f777f200640 1 -- start start 2024-04-24T23:57:41.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777f200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f77801615d0 0x7f77800d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:41.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777f200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 0x7f77800d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:41.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 0x7f77800d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:41.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777f200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f77800d11e0 con 0x7f77801615d0 2024-04-24T23:57:41.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777f200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f77800b7530 con 0x7f77800cf610 2024-04-24T23:57:41.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77800cfeb0 con 0x7f77800d0d70 2024-04-24T23:57:41.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 0x7f77800d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:41.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777d400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 0x7f77800d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:41.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 0x7f77800d1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:37578/0 (socket says 172.21.15.96:37578) 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777e800640 1 -- 172.21.15.96:0/3178478985 learned_addr learned my addr 172.21.15.96:0/3178478985 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.043+0000 7f777de00640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.96:3300/0 conn(0x7f77801615d0 0x7f77800d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777d400640 1 -- 172.21.15.96:0/3178478985 >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 msgr2=0x7f77800d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777d400640 1 -- 172.21.15.96:0/3178478985 >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 msgr2=0x7f77800d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777d400640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 0x7f77800d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777e800640 1 -- 172.21.15.96:0/3178478985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 msgr2=0x7f77800d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777e800640 1 -- 172.21.15.96:0/3178478985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 msgr2=0x7f77800d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777e800640 1 --2- 172.21.15.96:0/3178478985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 0x7f77800d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777de00640 1 -- 172.21.15.96:0/3178478985 >> v2:172.21.15.96:3300/0 conn(0x7f77801615d0 msgr2=0x7f77800d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777de00640 1 -- 172.21.15.96:0/3178478985 >> v2:172.21.15.96:3300/0 conn(0x7f77801615d0 msgr2=0x7f77800d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777e800640 1 --2- 172.21.15.96:0/3178478985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 0x7f77800d1bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777de00640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.96:3300/0 conn(0x7f77801615d0 0x7f77800d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T23:57:41.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777d400640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 0x7f77800d0830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T23:57:41.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.044+0000 7f777de00640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.96:3300/0 conn(0x7f77801615d0 0x7f77800d1440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T23:57:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.245+0000 7f777de00640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.96:3300/0 conn(0x7f77801615d0 0x7f77800d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.245+0000 7f777e800640 1 --2- 172.21.15.96:0/3178478985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 0x7f77800d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.245+0000 7f777d400640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 0x7f77800d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.245+0000 7f777de00640 1 -- 172.21.15.96:0/3178478985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 msgr2=0x7f77800d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.245+0000 7f777de00640 1 --2- 172.21.15.96:0/3178478985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 0x7f77800d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.245+0000 7f777de00640 1 -- 172.21.15.96:0/3178478985 >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 msgr2=0x7f77800d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.245+0000 7f777de00640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 0x7f77800d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.246+0000 7f777de00640 1 -- 172.21.15.96:0/3178478985 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77800d1980 con 0x7f77801615d0 2024-04-24T23:57:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.246+0000 7f777d400640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 0x7f77800d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:57:41.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.248+0000 7f777de00640 1 --2- 172.21.15.96:0/3178478985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77801615d0 0x7f77800d1440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f778008d3a0 tx=0x7f777002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eba5544bb805cb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:41.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.248+0000 7f777ca00640 1 -- 172.21.15.96:0/3178478985 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7770030070 con 0x7f77801615d0 2024-04-24T23:57:41.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.248+0000 7f777ca00640 1 -- 172.21.15.96:0/3178478985 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7770034400 con 0x7f77801615d0 2024-04-24T23:57:41.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.248+0000 7f777ca00640 1 -- 172.21.15.96:0/3178478985 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77700347f0 con 0x7f77801615d0 2024-04-24T23:57:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.249+0000 7f777f200640 1 -- 172.21.15.96:0/3178478985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77801615d0 msgr2=0x7f77800d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.249+0000 7f777f200640 1 --2- 172.21.15.96:0/3178478985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77801615d0 0x7f77800d1440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f778008d3a0 tx=0x7f777002a1f0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.249+0000 7f777f200640 1 -- 172.21.15.96:0/3178478985 shutdown_connections 2024-04-24T23:57:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.249+0000 7f777f200640 1 --2- 172.21.15.96:0/3178478985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800d0d70 0x7f77800d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.249+0000 7f777f200640 1 --2- 172.21.15.96:0/3178478985 >> v2:172.21.15.155:3300/0 conn(0x7f77800cf610 0x7f77800d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.249+0000 7f777f200640 1 --2- 172.21.15.96:0/3178478985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77801615d0 0x7f77800d1440 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.249+0000 7f777f200640 1 -- 172.21.15.96:0/3178478985 >> 172.21.15.96:0/3178478985 conn(0x7f77800d3ff0 msgr2=0x7f77800d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.250+0000 7f777f200640 1 -- 172.21.15.96:0/3178478985 shutdown_connections 2024-04-24T23:57:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.250+0000 7f777f200640 1 -- 172.21.15.96:0/3178478985 wait complete. 2024-04-24T23:57:41.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.253+0000 7f777f200640 1 Processor -- start 2024-04-24T23:57:41.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.254+0000 7f777f200640 1 -- start start 2024-04-24T23:57:41.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800cf610 0x7f77800cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:41.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777f200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77800d0d70 0x7f77800cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:41.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77801615d0 0x7f77800cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:41.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777f200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f77800b71c0 con 0x7f77800d0d70 2024-04-24T23:57:41.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f77800b6ee0 con 0x7f77801615d0 2024-04-24T23:57:41.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77801619b0 con 0x7f77800cf610 2024-04-24T23:57:41.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777d400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77800d0d70 0x7f77800cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:41.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800cf610 0x7f77800cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:41.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777d400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77800d0d70 0x7f77800cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36622/0 (socket says 172.21.15.96:36622) 2024-04-24T23:57:41.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800cf610 0x7f77800cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:37614/0 (socket says 172.21.15.96:37614) 2024-04-24T23:57:41.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777d400640 1 -- 172.21.15.96:0/1038959718 learned_addr learned my addr 172.21.15.96:0/1038959718 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:57:41.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.256+0000 7f777e800640 1 --2- 172.21.15.96:0/1038959718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77801615d0 0x7f77800cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.257+0000 7f777d400640 1 -- 172.21.15.96:0/1038959718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800cf610 msgr2=0x7f77800cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.257+0000 7f777d400640 1 --2- 172.21.15.96:0/1038959718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800cf610 0x7f77800cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.257+0000 7f777d400640 1 -- 172.21.15.96:0/1038959718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77801615d0 msgr2=0x7f77800cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.257+0000 7f777d400640 1 --2- 172.21.15.96:0/1038959718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77801615d0 0x7f77800cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.257+0000 7f777d400640 1 -- 172.21.15.96:0/1038959718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7780158f70 con 0x7f77800d0d70 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.257+0000 7f777de00640 1 --2- 172.21.15.96:0/1038959718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800cf610 0x7f77800cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.257+0000 7f777d400640 1 --2- 172.21.15.96:0/1038959718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77800d0d70 0x7f77800cb370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f776c00f5a0 tx=0x7f776c00fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.258+0000 7f7776000640 1 -- 172.21.15.96:0/1038959718 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c019020 con 0x7f77800d0d70 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.258+0000 7f7776000640 1 -- 172.21.15.96:0/1038959718 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c014870 con 0x7f77800d0d70 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.258+0000 7f7776000640 1 -- 172.21.15.96:0/1038959718 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c014c80 con 0x7f77800d0d70 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.258+0000 7f777f200640 1 -- 172.21.15.96:0/1038959718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77800c7d70 con 0x7f77800d0d70 2024-04-24T23:57:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.258+0000 7f777f200640 1 -- 172.21.15.96:0/1038959718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77800ccd60 con 0x7f77800d0d70 2024-04-24T23:57:41.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.258+0000 7f7776000640 1 -- 172.21.15.96:0/1038959718 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f776c01c020 con 0x7f77800d0d70 2024-04-24T23:57:41.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.258+0000 7f7776000640 1 -- 172.21.15.96:0/1038959718 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f776c01e4d0 con 0x7f77800d0d70 2024-04-24T23:57:41.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.259+0000 7f777f200640 1 -- 172.21.15.96:0/1038959718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77800755d0 con 0x7f77800d0d70 2024-04-24T23:57:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.263+0000 7f7776000640 1 -- 172.21.15.96:0/1038959718 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f776c023020 con 0x7f77800d0d70 2024-04-24T23:57:41.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.352+0000 7f777f200640 1 -- 172.21.15.96:0/1038959718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f77800d2950 con 0x7f77800d0d70 2024-04-24T23:57:41.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.356+0000 7f7776000640 1 -- 172.21.15.96:0/1038959718 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f776c01e6d0 con 0x7f77800d0d70 2024-04-24T23:57:41.356 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2024-04-24T23:57:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.357+0000 7f777f200640 1 -- 172.21.15.96:0/1038959718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77800d0d70 msgr2=0x7f77800cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.357+0000 7f777f200640 1 --2- 172.21.15.96:0/1038959718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77800d0d70 0x7f77800cb370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f776c00f5a0 tx=0x7f776c00fa60 comp rx=0 tx=0).stop 2024-04-24T23:57:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.358+0000 7f777f200640 1 -- 172.21.15.96:0/1038959718 shutdown_connections 2024-04-24T23:57:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.358+0000 7f777f200640 1 --2- 172.21.15.96:0/1038959718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77801615d0 0x7f77800cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.358+0000 7f777f200640 1 --2- 172.21.15.96:0/1038959718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77800d0d70 0x7f77800cb370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.358+0000 7f777f200640 1 --2- 172.21.15.96:0/1038959718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77800cf610 0x7f77800cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.358+0000 7f777f200640 1 -- 172.21.15.96:0/1038959718 >> 172.21.15.96:0/1038959718 conn(0x7f77800d3ff0 msgr2=0x7f778006bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.358+0000 7f777f200640 1 -- 172.21.15.96:0/1038959718 shutdown_connections 2024-04-24T23:57:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:41.358+0000 7f777f200640 1 -- 172.21.15.96:0/1038959718 wait complete. 2024-04-24T23:57:41.377 INFO:tasks.ceph:check_enable_crimson: False 2024-04-24T23:57:41.378 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T23:57:41.378 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:41.378 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T23:57:41.379 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:41.378+0000 7f076f49a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T23:57:41.388 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:41.388+0000 7fd1ef91b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T23:57:41.451 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:41.451 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T23:57:41.568 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:41.568 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T23:57:41.584 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:41.585+0000 7f076f49a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T23:57:41.601 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:41.601+0000 7fd1ef91b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T23:57:41.634 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:57:41.634 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T23:57:41.653 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:41.654+0000 7f076f49a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T23:57:41.669 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:41.669+0000 7fd1ef91b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T23:57:41.739 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:41.739 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-24T23:57:41.815 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:41.815 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-24T23:57:41.931 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:41.931 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-24T23:57:41.978 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:41.977+0000 7fd1ef91b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T23:57:41.978 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:41.974+0000 7f076f49a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T23:57:42.032 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:42.032+0000 7f076f49a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T23:57:42.035 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:42.035+0000 7fd1ef91b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T23:57:42.054 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:57:42.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-24T23:57:42.125 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new a0389f3b-91ca-4e0e-b21d-9a9d38be69b2 0 2024-04-24T23:57:42.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.348+0000 7f526f200640 1 Processor -- start 2024-04-24T23:57:42.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.348+0000 7f526f200640 1 -- start start 2024-04-24T23:57:42.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.350+0000 7f526f200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f52700cf610 0x7f52700d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.350+0000 7f526f200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f52700d0d70 0x7f52700b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.350+0000 7f526f200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52700cfeb0 con 0x7f52701615d0 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.350+0000 7f526f200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f52700b7530 con 0x7f52700cf610 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.350+0000 7f526f200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f52700d11a0 con 0x7f52700d0d70 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.350+0000 7f526de00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f52701615d0 0x7f52700d1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57216/0 (socket says 172.21.15.155:57216) 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.350+0000 7f526de00640 1 -- 172.21.15.155:0/816965070 learned_addr learned my addr 172.21.15.155:0/816965070 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.350+0000 7f526e800640 1 --2- 172.21.15.155:0/816965070 >> v2:172.21.15.155:3300/0 conn(0x7f52700d0d70 0x7f52700b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.350+0000 7f5267e00640 1 --2- 172.21.15.155:0/816965070 >> v2:172.21.15.96:3300/0 conn(0x7f52700cf610 0x7f52700d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.351+0000 7f526e800640 1 -- 172.21.15.155:0/816965070 >> v2:172.21.15.96:3300/0 conn(0x7f52700cf610 msgr2=0x7f52700d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.351+0000 7f526e800640 1 --2- 172.21.15.155:0/816965070 >> v2:172.21.15.96:3300/0 conn(0x7f52700cf610 0x7f52700d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.351+0000 7f526e800640 1 -- 172.21.15.155:0/816965070 >> v1:172.21.15.155:6789/0 conn(0x7f52701615d0 legacy=0x7f52700d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.351+0000 7f526e800640 1 -- 172.21.15.155:0/816965070 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52700cfbd0 con 0x7f52700d0d70 2024-04-24T23:57:42.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.352+0000 7f526e800640 1 --2- 172.21.15.155:0/816965070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700d0d70 0x7f52700b79c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52700b76b0 tx=0x7f526802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74807faeee7d3555 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:42.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.352+0000 7f526d400640 1 -- 172.21.15.155:0/816965070 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268031600 con 0x7f52700d0d70 2024-04-24T23:57:42.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.352+0000 7f526d400640 1 -- 172.21.15.155:0/816965070 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52680317a0 con 0x7f52700d0d70 2024-04-24T23:57:42.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.352+0000 7f526d400640 1 -- 172.21.15.155:0/816965070 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268031b70 con 0x7f52700d0d70 2024-04-24T23:57:42.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.352+0000 7f526f200640 1 -- 172.21.15.155:0/816965070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700d0d70 msgr2=0x7f52700b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.352+0000 7f526f200640 1 --2- 172.21.15.155:0/816965070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700d0d70 0x7f52700b79c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52700b76b0 tx=0x7f526802a5d0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.353+0000 7f526f200640 1 -- 172.21.15.155:0/816965070 shutdown_connections 2024-04-24T23:57:42.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.353+0000 7f526f200640 1 --2- 172.21.15.155:0/816965070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700d0d70 0x7f52700b79c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.353+0000 7f526f200640 1 --2- 172.21.15.155:0/816965070 >> v2:172.21.15.96:3300/0 conn(0x7f52700cf610 0x7f52700d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.353+0000 7f526f200640 1 -- 172.21.15.155:0/816965070 >> 172.21.15.155:0/816965070 conn(0x7f52700d3ff0 msgr2=0x7f52700d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:42.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.353+0000 7f526f200640 1 -- 172.21.15.155:0/816965070 shutdown_connections 2024-04-24T23:57:42.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.353+0000 7f526f200640 1 -- 172.21.15.155:0/816965070 wait complete. 2024-04-24T23:57:42.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.355+0000 7f526f200640 1 Processor -- start 2024-04-24T23:57:42.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.355+0000 7f526f200640 1 -- start start 2024-04-24T23:57:42.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f526f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700cf610 0x7f527015d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f526f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52700d0d70 0x7f527015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f526f200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52701615d0 0x7f5270157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f526f200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f52701619b0 con 0x7f52701615d0 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f526f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52700b71c0 con 0x7f52700cf610 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f526f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5270161b30 con 0x7f52700d0d70 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f526de00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700cf610 0x7f527015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f5267e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52700d0d70 0x7f527015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f5267e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52700d0d70 0x7f527015a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:60714/0 (socket says 172.21.15.155:60714) 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.356+0000 7f5267e00640 1 -- 172.21.15.155:0/2922646578 learned_addr learned my addr 172.21.15.155:0/2922646578 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5267e00640 1 -- 172.21.15.155:0/2922646578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700cf610 msgr2=0x7f527015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5267e00640 1 --2- 172.21.15.155:0/2922646578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700cf610 0x7f527015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5267e00640 1 -- 172.21.15.155:0/2922646578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52701615d0 msgr2=0x7f5270157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5267e00640 1 --2- 172.21.15.155:0/2922646578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52701615d0 0x7f5270157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5267e00640 1 -- 172.21.15.155:0/2922646578 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527015d7b0 con 0x7f52700d0d70 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f526de00640 1 --2- 172.21.15.155:0/2922646578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700cf610 0x7f527015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5267e00640 1 --2- 172.21.15.155:0/2922646578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52700d0d70 0x7f527015a250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f525800d830 tx=0x7f525800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5266000640 1 -- 172.21.15.155:0/2922646578 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525800b6c0 con 0x7f52700d0d70 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5266000640 1 -- 172.21.15.155:0/2922646578 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5258019070 con 0x7f52700d0d70 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5266000640 1 -- 172.21.15.155:0/2922646578 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525800ba80 con 0x7f52700d0d70 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f526f200640 1 -- 172.21.15.155:0/2922646578 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527015da90 con 0x7f52700d0d70 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f526f200640 1 -- 172.21.15.155:0/2922646578 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5270157ab0 con 0x7f52700d0d70 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.357+0000 7f5266000640 1 -- 172.21.15.155:0/2922646578 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f525800bc20 con 0x7f52700d0d70 2024-04-24T23:57:42.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.358+0000 7f5266000640 1 -- 172.21.15.155:0/2922646578 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f52580148a0 con 0x7f52700d0d70 2024-04-24T23:57:42.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.358+0000 7f526f200640 1 -- 172.21.15.155:0/2922646578 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52700755d0 con 0x7f52700d0d70 2024-04-24T23:57:42.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.361+0000 7f5266000640 1 -- 172.21.15.155:0/2922646578 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5258014aa0 con 0x7f52700d0d70 2024-04-24T23:57:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.441+0000 7f526f200640 1 -- 172.21.15.155:0/2922646578 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a0389f3b-91ca-4e0e-b21d-9a9d38be69b2", "id": 0} v 0) -- 0x7f52700b5120 con 0x7f52700d0d70 2024-04-24T23:57:42.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.449+0000 7f5266000640 1 -- 172.21.15.155:0/2922646578 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0389f3b-91ca-4e0e-b21d-9a9d38be69b2", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5258014c80 con 0x7f52700d0d70 2024-04-24T23:57:42.448 INFO:teuthology.orchestra.run.smithi155.stdout:0 2024-04-24T23:57:42.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.450+0000 7f526f200640 1 -- 172.21.15.155:0/2922646578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52700d0d70 msgr2=0x7f527015a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.450+0000 7f526f200640 1 --2- 172.21.15.155:0/2922646578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52700d0d70 0x7f527015a250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f525800d830 tx=0x7f525800dcf0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.450+0000 7f526f200640 1 -- 172.21.15.155:0/2922646578 shutdown_connections 2024-04-24T23:57:42.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.450+0000 7f526f200640 1 --2- 172.21.15.155:0/2922646578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52701615d0 0x7f5270157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.450+0000 7f526f200640 1 --2- 172.21.15.155:0/2922646578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52700d0d70 0x7f527015a250 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.451+0000 7f526f200640 1 --2- 172.21.15.155:0/2922646578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52700cf610 0x7f527015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.451+0000 7f526f200640 1 -- 172.21.15.155:0/2922646578 >> 172.21.15.155:0/2922646578 conn(0x7f52700d3ff0 msgr2=0x7f52700b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:42.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.451+0000 7f526f200640 1 -- 172.21.15.155:0/2922646578 shutdown_connections 2024-04-24T23:57:42.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.451+0000 7f526f200640 1 -- 172.21.15.155:0/2922646578 wait complete. 2024-04-24T23:57:42.465 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 14f7d06f-d9bb-4285-8d4c-5c86de912529 1 2024-04-24T23:57:42.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.637+0000 7f318d800640 1 Processor -- start 2024-04-24T23:57:42.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.638+0000 7f318d800640 1 -- start start 2024-04-24T23:57:42.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.639+0000 7f318d800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3188156620 0x7f318815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.639+0000 7f318d800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f318806d100 con 0x7f31880ae8e0 2024-04-24T23:57:42.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.640+0000 7f318d800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31880acda0 con 0x7f318806edf0 2024-04-24T23:57:42.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.640+0000 7f318d800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f31880ad060 con 0x7f3188156620 2024-04-24T23:57:42.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.640+0000 7f317e000640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f318806edf0 0x7f318806dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57220/0 (socket says 172.21.15.155:57220) 2024-04-24T23:57:42.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.640+0000 7f317e000640 1 -- 172.21.15.155:0/3793157212 learned_addr learned my addr 172.21.15.155:0/3793157212 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-24T23:57:42.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.640+0000 7f3186a00640 1 --2- 172.21.15.155:0/3793157212 >> v2:172.21.15.96:3300/0 conn(0x7f3188156620 0x7f318815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.640+0000 7f3186000640 1 -- 172.21.15.155:0/3793157212 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151263859 0 0) 0x7f31880acda0 con 0x7f318806edf0 2024-04-24T23:57:42.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.640+0000 7f3186000640 1 -- 172.21.15.155:0/3793157212 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f316c003520 con 0x7f318806edf0 2024-04-24T23:57:42.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.641+0000 7f3186000640 1 -- 172.21.15.155:0/3793157212 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860804122 0 0) 0x7f318806d100 con 0x7f31880ae8e0 2024-04-24T23:57:42.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.641+0000 7f3186000640 1 -- 172.21.15.155:0/3793157212 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31880acda0 con 0x7f31880ae8e0 2024-04-24T23:57:42.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.641+0000 7f3186a00640 1 -- 172.21.15.155:0/3793157212 >> v1:172.21.15.155:6789/0 conn(0x7f318806edf0 legacy=0x7f318806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.641+0000 7f3186000640 1 -- 172.21.15.155:0/3793157212 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 182448423 0 0) 0x7f316c003520 con 0x7f318806edf0 2024-04-24T23:57:42.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.641+0000 7f3186a00640 1 -- 172.21.15.155:0/3793157212 >> v1:172.21.15.96:6789/0 conn(0x7f31880ae8e0 legacy=0x7f31880aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.641+0000 7f3186a00640 1 -- 172.21.15.155:0/3793157212 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318806d3a0 con 0x7f3188156620 2024-04-24T23:57:42.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.642+0000 7f3186a00640 1 --2- 172.21.15.155:0/3793157212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3188156620 0x7f318815cf70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3178009720 tx=0x7f317802a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12943e463ab86897 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:42.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.643+0000 7f3186000640 1 -- 172.21.15.155:0/3793157212 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178037070 con 0x7f3188156620 2024-04-24T23:57:42.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.643+0000 7f3186000640 1 -- 172.21.15.155:0/3793157212 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317802ab40 con 0x7f3188156620 2024-04-24T23:57:42.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.643+0000 7f3186000640 1 -- 172.21.15.155:0/3793157212 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170001670 con 0x7f3188156620 2024-04-24T23:57:42.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.643+0000 7f318d800640 1 -- 172.21.15.155:0/3793157212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3188156620 msgr2=0x7f318815cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.643+0000 7f318d800640 1 --2- 172.21.15.155:0/3793157212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3188156620 0x7f318815cf70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3178009720 tx=0x7f317802a030 comp rx=0 tx=0).stop 2024-04-24T23:57:42.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.643+0000 7f318d800640 1 -- 172.21.15.155:0/3793157212 shutdown_connections 2024-04-24T23:57:42.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.643+0000 7f318d800640 1 --2- 172.21.15.155:0/3793157212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3188156620 0x7f318815cf70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.643+0000 7f318d800640 1 -- 172.21.15.155:0/3793157212 >> 172.21.15.155:0/3793157212 conn(0x7f31880b19c0 msgr2=0x7f31880b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:42.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.644+0000 7f318d800640 1 -- 172.21.15.155:0/3793157212 shutdown_connections 2024-04-24T23:57:42.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.644+0000 7f318d800640 1 -- 172.21.15.155:0/3793157212 wait complete. 2024-04-24T23:57:42.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.645+0000 7f318d800640 1 Processor -- start 2024-04-24T23:57:42.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.645+0000 7f318d800640 1 -- start start 2024-04-24T23:57:42.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.646+0000 7f318d800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318806edf0 0x7f31881583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.646+0000 7f318d800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31880ae8e0 0x7f3188158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.646+0000 7f318d800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3188156620 0x7f318809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.646+0000 7f318d800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f31880ad4c0 con 0x7f31880ae8e0 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.646+0000 7f318d800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f31880ad340 con 0x7f3188156620 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.646+0000 7f318d800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3188070e10 con 0x7f318806edf0 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f3186a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318806edf0 0x7f31881583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f3187400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3188156620 0x7f318809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f3186a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318806edf0 0x7f31881583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:60718/0 (socket says 172.21.15.155:60718) 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f3186a00640 1 -- 172.21.15.155:0/2143221787 learned_addr learned my addr 172.21.15.155:0/2143221787 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f317e000640 1 --2- 172.21.15.155:0/2143221787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31880ae8e0 0x7f3188158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f3186a00640 1 -- 172.21.15.155:0/2143221787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3188156620 msgr2=0x7f318809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f3186a00640 1 --2- 172.21.15.155:0/2143221787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3188156620 0x7f318809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f3186a00640 1 -- 172.21.15.155:0/2143221787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31880ae8e0 msgr2=0x7f3188158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f3186a00640 1 --2- 172.21.15.155:0/2143221787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31880ae8e0 0x7f3188158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f3186a00640 1 -- 172.21.15.155:0/2143221787 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318809b680 con 0x7f318806edf0 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.647+0000 7f317e000640 1 --2- 172.21.15.155:0/2143221787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31880ae8e0 0x7f3188158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:57:42.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.648+0000 7f3186a00640 1 --2- 172.21.15.155:0/2143221787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318806edf0 0x7f31881583e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3178009840 tx=0x7f31780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:42.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.648+0000 7f317f400640 1 -- 172.21.15.155:0/2143221787 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178037050 con 0x7f318806edf0 2024-04-24T23:57:42.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.648+0000 7f317f400640 1 -- 172.21.15.155:0/2143221787 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3178043070 con 0x7f318806edf0 2024-04-24T23:57:42.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.648+0000 7f317f400640 1 -- 172.21.15.155:0/2143221787 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178006e10 con 0x7f318806edf0 2024-04-24T23:57:42.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.648+0000 7f318d800640 1 -- 172.21.15.155:0/2143221787 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31881f7220 con 0x7f318806edf0 2024-04-24T23:57:42.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.648+0000 7f318d800640 1 -- 172.21.15.155:0/2143221787 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31881f77e0 con 0x7f318806edf0 2024-04-24T23:57:42.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.648+0000 7f317f400640 1 -- 172.21.15.155:0/2143221787 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f317803ca30 con 0x7f318806edf0 2024-04-24T23:57:42.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.648+0000 7f317f400640 1 -- 172.21.15.155:0/2143221787 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f317803e450 con 0x7f318806edf0 2024-04-24T23:57:42.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.649+0000 7f318d800640 1 -- 172.21.15.155:0/2143221787 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3188069110 con 0x7f318806edf0 2024-04-24T23:57:42.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.652+0000 7f317f400640 1 -- 172.21.15.155:0/2143221787 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3178048460 con 0x7f318806edf0 2024-04-24T23:57:42.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.731+0000 7f318d800640 1 -- 172.21.15.155:0/2143221787 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "14f7d06f-d9bb-4285-8d4c-5c86de912529", "id": 1} v 0) -- 0x7f318806dfb0 con 0x7f318806edf0 2024-04-24T23:57:42.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.738+0000 7f317f400640 1 -- 172.21.15.155:0/2143221787 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14f7d06f-d9bb-4285-8d4c-5c86de912529", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f3178048640 con 0x7f318806edf0 2024-04-24T23:57:42.737 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-24T23:57:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.739+0000 7f318d800640 1 -- 172.21.15.155:0/2143221787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318806edf0 msgr2=0x7f31881583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.739+0000 7f318d800640 1 --2- 172.21.15.155:0/2143221787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318806edf0 0x7f31881583e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3178009840 tx=0x7f31780046c0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.740+0000 7f318d800640 1 -- 172.21.15.155:0/2143221787 shutdown_connections 2024-04-24T23:57:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.740+0000 7f318d800640 1 --2- 172.21.15.155:0/2143221787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3188156620 0x7f318809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.740+0000 7f318d800640 1 --2- 172.21.15.155:0/2143221787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31880ae8e0 0x7f3188158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.740+0000 7f318d800640 1 --2- 172.21.15.155:0/2143221787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318806edf0 0x7f31881583e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.740+0000 7f318d800640 1 -- 172.21.15.155:0/2143221787 >> 172.21.15.155:0/2143221787 conn(0x7f31880b19c0 msgr2=0x7f31880aed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.740+0000 7f318d800640 1 -- 172.21.15.155:0/2143221787 shutdown_connections 2024-04-24T23:57:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.740+0000 7f318d800640 1 -- 172.21.15.155:0/2143221787 wait complete. 2024-04-24T23:57:42.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 9570a31b-f631-4603-b3a5-10672507eaec 2 2024-04-24T23:57:42.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.933+0000 7f813b200640 1 Processor -- start 2024-04-24T23:57:42.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.933+0000 7f813b200640 1 -- start start 2024-04-24T23:57:42.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.935+0000 7f813b200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f813406b0c0 0x7f81340cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.935+0000 7f813b200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813406b7a0 con 0x7f8134071e70 2024-04-24T23:57:42.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.935+0000 7f813b200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813406ba80 con 0x7f81340d0a00 2024-04-24T23:57:42.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.935+0000 7f813b200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f813406c040 con 0x7f813406b0c0 2024-04-24T23:57:42.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.935+0000 7f8133e00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f81340d0a00 0x7f81340cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57224/0 (socket says 172.21.15.155:57224) 2024-04-24T23:57:42.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.935+0000 7f8133e00640 1 -- 172.21.15.155:0/2296693828 learned_addr learned my addr 172.21.15.155:0/2296693828 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-24T23:57:42.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.935+0000 7f812be00640 1 --2- 172.21.15.155:0/2296693828 >> v2:172.21.15.155:3300/0 conn(0x7f813406b0c0 0x7f81340cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.935+0000 7f8133400640 1 -- 172.21.15.155:0/2296693828 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685079665 0 0) 0x7f813406ba80 con 0x7f81340d0a00 2024-04-24T23:57:42.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.936+0000 7f8133400640 1 -- 172.21.15.155:0/2296693828 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8118003520 con 0x7f81340d0a00 2024-04-24T23:57:42.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.936+0000 7f812be00640 1 -- 172.21.15.155:0/2296693828 >> v1:172.21.15.155:6789/0 conn(0x7f81340d0a00 legacy=0x7f81340cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.936+0000 7f812be00640 1 -- 172.21.15.155:0/2296693828 >> v1:172.21.15.96:6789/0 conn(0x7f8134071e70 legacy=0x7f813406f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:42.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.936+0000 7f812be00640 1 -- 172.21.15.155:0/2296693828 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813406bd60 con 0x7f813406b0c0 2024-04-24T23:57:42.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.937+0000 7f812be00640 1 --2- 172.21.15.155:0/2296693828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813406b0c0 0x7f81340cd1d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f811c0097a0 tx=0x7f811c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c2363269df9b7eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:42.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.938+0000 7f8133400640 1 -- 172.21.15.155:0/2296693828 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c037070 con 0x7f813406b0c0 2024-04-24T23:57:42.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.938+0000 7f8133400640 1 -- 172.21.15.155:0/2296693828 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811c032440 con 0x7f813406b0c0 2024-04-24T23:57:42.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.938+0000 7f8133400640 1 -- 172.21.15.155:0/2296693828 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c032810 con 0x7f813406b0c0 2024-04-24T23:57:42.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.938+0000 7f813b200640 1 -- 172.21.15.155:0/2296693828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813406b0c0 msgr2=0x7f81340cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.938+0000 7f813b200640 1 --2- 172.21.15.155:0/2296693828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813406b0c0 0x7f81340cd1d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f811c0097a0 tx=0x7f811c02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.938+0000 7f813b200640 1 -- 172.21.15.155:0/2296693828 shutdown_connections 2024-04-24T23:57:42.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.938+0000 7f813b200640 1 --2- 172.21.15.155:0/2296693828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813406b0c0 0x7f81340cd1d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.938+0000 7f813b200640 1 -- 172.21.15.155:0/2296693828 >> 172.21.15.155:0/2296693828 conn(0x7f81340d0e20 msgr2=0x7f81340d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:42.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.939+0000 7f813b200640 1 -- 172.21.15.155:0/2296693828 shutdown_connections 2024-04-24T23:57:42.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.939+0000 7f813b200640 1 -- 172.21.15.155:0/2296693828 wait complete. 2024-04-24T23:57:42.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.940+0000 7f813b200640 1 Processor -- start 2024-04-24T23:57:42.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.940+0000 7f813b200640 1 -- start start 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.941+0000 7f813b200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f813406b0c0 0x7f81340cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.941+0000 7f813b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8134071e70 0x7f8134160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.941+0000 7f813b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81340d0a00 0x7f8134072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.941+0000 7f813b200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f813406b550 con 0x7f813406b0c0 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.941+0000 7f813b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81340cef50 con 0x7f81340d0a00 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.941+0000 7f813b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f813406fa00 con 0x7f8134071e70 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f812be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8134071e70 0x7f8134160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f8139200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81340d0a00 0x7f8134072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f812be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8134071e70 0x7f8134160de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:60730/0 (socket says 172.21.15.155:60730) 2024-04-24T23:57:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f812be00640 1 -- 172.21.15.155:0/763757495 learned_addr learned my addr 172.21.15.155:0/763757495 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f8133e00640 1 --2- 172.21.15.155:0/763757495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f813406b0c0 0x7f81340cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f812be00640 1 -- 172.21.15.155:0/763757495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81340d0a00 msgr2=0x7f8134072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f812be00640 1 --2- 172.21.15.155:0/763757495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81340d0a00 0x7f8134072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f812be00640 1 -- 172.21.15.155:0/763757495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f813406b0c0 msgr2=0x7f81340cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f812be00640 1 --2- 172.21.15.155:0/763757495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f813406b0c0 0x7f81340cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f812be00640 1 -- 172.21.15.155:0/763757495 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81340cbc20 con 0x7f8134071e70 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.942+0000 7f812be00640 1 --2- 172.21.15.155:0/763757495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8134071e70 0x7f8134160de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f811c035040 tx=0x7f811c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.943+0000 7f8130c00640 1 -- 172.21.15.155:0/763757495 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c037040 con 0x7f8134071e70 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.943+0000 7f8130c00640 1 -- 172.21.15.155:0/763757495 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811c030500 con 0x7f8134071e70 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.943+0000 7f813b200640 1 -- 172.21.15.155:0/763757495 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81341e6e20 con 0x7f8134071e70 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.943+0000 7f8130c00640 1 -- 172.21.15.155:0/763757495 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c030910 con 0x7f8134071e70 2024-04-24T23:57:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.943+0000 7f813b200640 1 -- 172.21.15.155:0/763757495 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81341e73e0 con 0x7f8134071e70 2024-04-24T23:57:42.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.943+0000 7f8130c00640 1 -- 172.21.15.155:0/763757495 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f811c044020 con 0x7f8134071e70 2024-04-24T23:57:42.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.943+0000 7f8130c00640 1 -- 172.21.15.155:0/763757495 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f811c03d420 con 0x7f8134071e70 2024-04-24T23:57:42.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.944+0000 7f813b200640 1 -- 172.21.15.155:0/763757495 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8134067e40 con 0x7f8134071e70 2024-04-24T23:57:42.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:42.946+0000 7f8130c00640 1 -- 172.21.15.155:0/763757495 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f811c03bbb0 con 0x7f8134071e70 2024-04-24T23:57:42.957 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:42.958+0000 7f076f49a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T23:57:43.008 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:43.008+0000 7fd1ef91b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T23:57:43.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.024+0000 7f813b200640 1 -- 172.21.15.155:0/763757495 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9570a31b-f631-4603-b3a5-10672507eaec", "id": 2} v 0) -- 0x7f81340cf8d0 con 0x7f8134071e70 2024-04-24T23:57:43.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.033+0000 7f8130c00640 1 -- 172.21.15.155:0/763757495 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9570a31b-f631-4603-b3a5-10672507eaec", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f811c03b430 con 0x7f8134071e70 2024-04-24T23:57:43.033 INFO:teuthology.orchestra.run.smithi155.stdout:2 2024-04-24T23:57:43.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.035+0000 7f813b200640 1 -- 172.21.15.155:0/763757495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8134071e70 msgr2=0x7f8134160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.035+0000 7f813b200640 1 --2- 172.21.15.155:0/763757495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8134071e70 0x7f8134160de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f811c035040 tx=0x7f811c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.035+0000 7f813b200640 1 -- 172.21.15.155:0/763757495 shutdown_connections 2024-04-24T23:57:43.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.035+0000 7f813b200640 1 --2- 172.21.15.155:0/763757495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81340d0a00 0x7f8134072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.035+0000 7f813b200640 1 --2- 172.21.15.155:0/763757495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8134071e70 0x7f8134160de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.035+0000 7f813b200640 1 --2- 172.21.15.155:0/763757495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f813406b0c0 0x7f81340cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.035+0000 7f813b200640 1 -- 172.21.15.155:0/763757495 >> 172.21.15.155:0/763757495 conn(0x7f81340d0e20 msgr2=0x7f81340ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:43.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.035+0000 7f813b200640 1 -- 172.21.15.155:0/763757495 shutdown_connections 2024-04-24T23:57:43.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.035+0000 7f813b200640 1 -- 172.21.15.155:0/763757495 wait complete. 2024-04-24T23:57:43.051 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 4a98e265-fd07-4543-a871-921ce673500b 3 2024-04-24T23:57:43.075 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:43.076+0000 7f076f49a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T23:57:43.113 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:43.113+0000 7fd1ef91b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T23:57:43.132 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:43.133+0000 7f076f49a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T23:57:43.164 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:43.164+0000 7fd1ef91b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T23:57:43.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.218+0000 7f4f09200640 1 Processor -- start 2024-04-24T23:57:43.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.218+0000 7f4f09200640 1 -- start start 2024-04-24T23:57:43.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.219+0000 7f4f09200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f040b3c30 0x7f4f04071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.219+0000 7f4f09200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4f0406d9c0 0x7f4f04072140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f09200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f040b40d0 con 0x7f4f0415a5d0 2024-04-24T23:57:43.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f09200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4f0415a9b0 con 0x7f4f0406d9c0 2024-04-24T23:57:43.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f09200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4f04070e40 con 0x7f4f040b3c30 2024-04-24T23:57:43.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f02a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f040b3c30 0x7f4f04071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f02a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f040b3c30 0x7f4f04071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52282/0 (socket says 172.21.15.155:52282) 2024-04-24T23:57:43.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f03400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4f0415a5d0 0x7f4f0406d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.155:35202/0 (socket says 172.21.15.155:35202) 2024-04-24T23:57:43.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f02a00640 1 -- 172.21.15.155:0/1880288835 learned_addr learned my addr 172.21.15.155:0/1880288835 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:43.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f03e00640 1 --2- 172.21.15.155:0/1880288835 >> v2:172.21.15.96:3300/0 conn(0x7f4f0406d9c0 0x7f4f04072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f02a00640 1 -- 172.21.15.155:0/1880288835 >> v2:172.21.15.96:3300/0 conn(0x7f4f0406d9c0 msgr2=0x7f4f04072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:43.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f02a00640 1 --2- 172.21.15.155:0/1880288835 >> v2:172.21.15.96:3300/0 conn(0x7f4f0406d9c0 0x7f4f04072140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f02a00640 1 -- 172.21.15.155:0/1880288835 >> v1:172.21.15.96:6789/0 conn(0x7f4f0415a5d0 legacy=0x7f4f0406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.220+0000 7f4f02a00640 1 -- 172.21.15.155:0/1880288835 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f04071120 con 0x7f4f040b3c30 2024-04-24T23:57:43.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.222+0000 7f4f02a00640 1 --2- 172.21.15.155:0/1880288835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f040b3c30 0x7f4f04071c00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4f040cc390 tx=0x7f4ef002c690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5888642262abfae2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:43.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.222+0000 7f4f02000640 1 -- 172.21.15.155:0/1880288835 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef003a070 con 0x7f4f040b3c30 2024-04-24T23:57:43.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.222+0000 7f4f02000640 1 -- 172.21.15.155:0/1880288835 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef0032480 con 0x7f4f040b3c30 2024-04-24T23:57:43.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.222+0000 7f4f02000640 1 -- 172.21.15.155:0/1880288835 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0032850 con 0x7f4f040b3c30 2024-04-24T23:57:43.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.222+0000 7f4f09200640 1 -- 172.21.15.155:0/1880288835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f040b3c30 msgr2=0x7f4f04071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.222+0000 7f4f09200640 1 --2- 172.21.15.155:0/1880288835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f040b3c30 0x7f4f04071c00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4f040cc390 tx=0x7f4ef002c690 comp rx=0 tx=0).stop 2024-04-24T23:57:43.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.223+0000 7f4f09200640 1 -- 172.21.15.155:0/1880288835 shutdown_connections 2024-04-24T23:57:43.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.223+0000 7f4f09200640 1 --2- 172.21.15.155:0/1880288835 >> v2:172.21.15.96:3300/0 conn(0x7f4f0406d9c0 0x7f4f04072140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.223+0000 7f4f09200640 1 --2- 172.21.15.155:0/1880288835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f040b3c30 0x7f4f04071c00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.223+0000 7f4f09200640 1 -- 172.21.15.155:0/1880288835 >> 172.21.15.155:0/1880288835 conn(0x7f4f040b18b0 msgr2=0x7f4f040b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:43.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.223+0000 7f4f09200640 1 -- 172.21.15.155:0/1880288835 shutdown_connections 2024-04-24T23:57:43.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.223+0000 7f4f09200640 1 -- 172.21.15.155:0/1880288835 wait complete. 2024-04-24T23:57:43.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.224+0000 7f4f09200640 1 Processor -- start 2024-04-24T23:57:43.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.224+0000 7f4f09200640 1 -- start start 2024-04-24T23:57:43.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.225+0000 7f4f09200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f0406d9c0 0x7f4f04154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.225+0000 7f4f09200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040b3c30 0x7f4f0414e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.225+0000 7f4f09200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f0415a5d0 0x7f4f041e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.225+0000 7f4f09200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0406e180 con 0x7f4f040b3c30 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.225+0000 7f4f09200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0406e000 con 0x7f4f0415a5d0 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.225+0000 7f4f09200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f040b2d40 con 0x7f4f0406d9c0 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f0406d9c0 0x7f4f04154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f0406d9c0 0x7f4f04154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:60744/0 (socket says 172.21.15.155:60744) 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03400640 1 -- 172.21.15.155:0/1504658932 learned_addr learned my addr 172.21.15.155:0/1504658932 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03e00640 1 --2- 172.21.15.155:0/1504658932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f0415a5d0 0x7f4f041e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f02a00640 1 --2- 172.21.15.155:0/1504658932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040b3c30 0x7f4f0414e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03400640 1 -- 172.21.15.155:0/1504658932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f0415a5d0 msgr2=0x7f4f041e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03400640 1 --2- 172.21.15.155:0/1504658932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f0415a5d0 0x7f4f041e3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03400640 1 -- 172.21.15.155:0/1504658932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040b3c30 msgr2=0x7f4f0414e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03400640 1 --2- 172.21.15.155:0/1504658932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040b3c30 0x7f4f0414e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03400640 1 -- 172.21.15.155:0/1504658932 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0413d2d0 con 0x7f4f0406d9c0 2024-04-24T23:57:43.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.226+0000 7f4f03400640 1 --2- 172.21.15.155:0/1504658932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f0406d9c0 0x7f4f04154980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400c3e0 tx=0x7f4ef400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:43.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.227+0000 7f4efb400640 1 -- 172.21.15.155:0/1504658932 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40074e0 con 0x7f4f0406d9c0 2024-04-24T23:57:43.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.227+0000 7f4efb400640 1 -- 172.21.15.155:0/1504658932 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4007680 con 0x7f4f0406d9c0 2024-04-24T23:57:43.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.227+0000 7f4efb400640 1 -- 172.21.15.155:0/1504658932 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40049e0 con 0x7f4f0406d9c0 2024-04-24T23:57:43.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.227+0000 7f4f09200640 1 -- 172.21.15.155:0/1504658932 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0413d5b0 con 0x7f4f0406d9c0 2024-04-24T23:57:43.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.227+0000 7f4f09200640 1 -- 172.21.15.155:0/1504658932 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0413db70 con 0x7f4f0406d9c0 2024-04-24T23:57:43.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.227+0000 7f4efb400640 1 -- 172.21.15.155:0/1504658932 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ef401a020 con 0x7f4f0406d9c0 2024-04-24T23:57:43.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.227+0000 7f4efb400640 1 -- 172.21.15.155:0/1504658932 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4ef4013890 con 0x7f4f0406d9c0 2024-04-24T23:57:43.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.228+0000 7f4f09200640 1 -- 172.21.15.155:0/1504658932 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f040755d0 con 0x7f4f0406d9c0 2024-04-24T23:57:43.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.230+0000 7f4efb400640 1 -- 172.21.15.155:0/1504658932 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4ef4021070 con 0x7f4f0406d9c0 2024-04-24T23:57:43.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.306+0000 7f4f09200640 1 -- 172.21.15.155:0/1504658932 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4a98e265-fd07-4543-a871-921ce673500b", "id": 3} v 0) -- 0x7f4f0406e430 con 0x7f4f0406d9c0 2024-04-24T23:57:43.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.312+0000 7f4efb400640 1 -- 172.21.15.155:0/1504658932 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a98e265-fd07-4543-a871-921ce673500b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4f040b40d0 con 0x7f4f0406d9c0 2024-04-24T23:57:43.312 INFO:teuthology.orchestra.run.smithi155.stdout:3 2024-04-24T23:57:43.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.314+0000 7f4f09200640 1 -- 172.21.15.155:0/1504658932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f0406d9c0 msgr2=0x7f4f04154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.314+0000 7f4f09200640 1 --2- 172.21.15.155:0/1504658932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f0406d9c0 0x7f4f04154980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400c3e0 tx=0x7f4ef400c8a0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.314+0000 7f4f09200640 1 -- 172.21.15.155:0/1504658932 shutdown_connections 2024-04-24T23:57:43.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.314+0000 7f4f09200640 1 --2- 172.21.15.155:0/1504658932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f0415a5d0 0x7f4f041e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.314+0000 7f4f09200640 1 --2- 172.21.15.155:0/1504658932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040b3c30 0x7f4f0414e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.314+0000 7f4f09200640 1 --2- 172.21.15.155:0/1504658932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f0406d9c0 0x7f4f04154980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.314+0000 7f4f09200640 1 -- 172.21.15.155:0/1504658932 >> 172.21.15.155:0/1504658932 conn(0x7f4f040b18b0 msgr2=0x7f4f04157f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:43.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.314+0000 7f4f09200640 1 -- 172.21.15.155:0/1504658932 shutdown_connections 2024-04-24T23:57:43.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.314+0000 7f4f09200640 1 -- 172.21.15.155:0/1504658932 wait complete. 2024-04-24T23:57:43.328 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 143d5098-bf88-4698-bdff-116597e598e8 4 2024-04-24T23:57:43.348 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:43.349+0000 7f076f49a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T23:57:43.356 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:43.356+0000 7fd1ef91b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T23:57:43.409 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:43.409+0000 7f076f49a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T23:57:43.432 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:43.432+0000 7fd1ef91b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T23:57:43.474 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:43.475+0000 7f076f49a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T23:57:43.493 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:43.493+0000 7fd1ef91b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T23:57:43.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.520+0000 7f3555000640 1 Processor -- start 2024-04-24T23:57:43.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.520+0000 7f3555000640 1 -- start start 2024-04-24T23:57:43.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.521+0000 7f3555000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35500cf610 0x7f35500d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.521+0000 7f3555000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f35500d0d70 0x7f35500b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.521+0000 7f3555000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35500cfeb0 con 0x7f35501615d0 2024-04-24T23:57:43.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.521+0000 7f3555000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f35500b7530 con 0x7f35500d0d70 2024-04-24T23:57:43.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.521+0000 7f3555000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f35500d11a0 con 0x7f35500cf610 2024-04-24T23:57:43.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.522+0000 7f354f400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f35501615d0 0x7f35500d1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.155:35204/0 (socket says 172.21.15.155:35204) 2024-04-24T23:57:43.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.522+0000 7f354fe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f35500d0d70 0x7f35500b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.522+0000 7f354f400640 1 -- 172.21.15.155:0/3371220099 learned_addr learned my addr 172.21.15.155:0/3371220099 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-24T23:57:43.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.522+0000 7f354ea00640 1 --2- 172.21.15.155:0/3371220099 >> v2:172.21.15.155:3300/0 conn(0x7f35500cf610 0x7f35500d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.522+0000 7f354ea00640 1 -- 172.21.15.155:0/3371220099 >> v2:172.21.15.96:3300/0 conn(0x7f35500d0d70 msgr2=0x7f35500b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:43.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.522+0000 7f354ea00640 1 --2- 172.21.15.155:0/3371220099 >> v2:172.21.15.96:3300/0 conn(0x7f35500d0d70 0x7f35500b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.522+0000 7f354ea00640 1 -- 172.21.15.155:0/3371220099 >> v1:172.21.15.96:6789/0 conn(0x7f35501615d0 legacy=0x7f35500d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.522+0000 7f354ea00640 1 -- 172.21.15.155:0/3371220099 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35500cfbd0 con 0x7f35500cf610 2024-04-24T23:57:43.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.523+0000 7f354ea00640 1 --2- 172.21.15.155:0/3371220099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500cf610 0x7f35500d0830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f35500b76b0 tx=0x7f353c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=830c11968e7f6af8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:43.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.524+0000 7f354e000640 1 -- 172.21.15.155:0/3371220099 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c037070 con 0x7f35500cf610 2024-04-24T23:57:43.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.524+0000 7f354e000640 1 -- 172.21.15.155:0/3371220099 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353c032440 con 0x7f35500cf610 2024-04-24T23:57:43.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.524+0000 7f354e000640 1 -- 172.21.15.155:0/3371220099 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c02ae60 con 0x7f35500cf610 2024-04-24T23:57:43.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.525+0000 7f3555000640 1 -- 172.21.15.155:0/3371220099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500cf610 msgr2=0x7f35500d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.525+0000 7f3555000640 1 --2- 172.21.15.155:0/3371220099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500cf610 0x7f35500d0830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f35500b76b0 tx=0x7f353c02a110 comp rx=0 tx=0).stop 2024-04-24T23:57:43.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.525+0000 7f3555000640 1 -- 172.21.15.155:0/3371220099 shutdown_connections 2024-04-24T23:57:43.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.525+0000 7f3555000640 1 --2- 172.21.15.155:0/3371220099 >> v2:172.21.15.96:3300/0 conn(0x7f35500d0d70 0x7f35500b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.525+0000 7f3555000640 1 --2- 172.21.15.155:0/3371220099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500cf610 0x7f35500d0830 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.525+0000 7f3555000640 1 -- 172.21.15.155:0/3371220099 >> 172.21.15.155:0/3371220099 conn(0x7f35500d3ff0 msgr2=0x7f35500d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:43.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.525+0000 7f3555000640 1 -- 172.21.15.155:0/3371220099 shutdown_connections 2024-04-24T23:57:43.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.525+0000 7f3555000640 1 -- 172.21.15.155:0/3371220099 wait complete. 2024-04-24T23:57:43.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.526+0000 7f3555000640 1 Processor -- start 2024-04-24T23:57:43.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.527+0000 7f3555000640 1 -- start start 2024-04-24T23:57:43.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.527+0000 7f3555000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35500cf610 0x7f355014a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.527+0000 7f3555000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500d0d70 0x7f35500b9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.527+0000 7f3555000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35501615d0 0x7f355015d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.527+0000 7f3555000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f35501619b0 con 0x7f35501615d0 2024-04-24T23:57:43.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.527+0000 7f3555000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f35500b71c0 con 0x7f35500d0d70 2024-04-24T23:57:43.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.527+0000 7f3555000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3550161b30 con 0x7f35500cf610 2024-04-24T23:57:43.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500d0d70 0x7f35500b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35500cf610 0x7f355014a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500d0d70 0x7f35500b9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52310/0 (socket says 172.21.15.155:52310) 2024-04-24T23:57:43.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354ea00640 1 -- 172.21.15.155:0/1682785950 learned_addr learned my addr 172.21.15.155:0/1682785950 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:43.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354fe00640 1 --2- 172.21.15.155:0/1682785950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35501615d0 0x7f355015d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354ea00640 1 -- 172.21.15.155:0/1682785950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35500cf610 msgr2=0x7f355014a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354ea00640 1 --2- 172.21.15.155:0/1682785950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35500cf610 0x7f355014a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354ea00640 1 -- 172.21.15.155:0/1682785950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35501615d0 msgr2=0x7f355015d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354ea00640 1 --2- 172.21.15.155:0/1682785950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35501615d0 0x7f355015d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.528+0000 7f354ea00640 1 -- 172.21.15.155:0/1682785950 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35500b7ff0 con 0x7f35500d0d70 2024-04-24T23:57:43.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.529+0000 7f354ea00640 1 --2- 172.21.15.155:0/1682785950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500d0d70 0x7f35500b9090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f353c000c00 tx=0x7f353c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:43.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.529+0000 7f3547400640 1 -- 172.21.15.155:0/1682785950 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c037040 con 0x7f35500d0d70 2024-04-24T23:57:43.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.529+0000 7f3547400640 1 -- 172.21.15.155:0/1682785950 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353c042070 con 0x7f35500d0d70 2024-04-24T23:57:43.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.529+0000 7f3547400640 1 -- 172.21.15.155:0/1682785950 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c030960 con 0x7f35500d0d70 2024-04-24T23:57:43.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.529+0000 7f3555000640 1 -- 172.21.15.155:0/1682785950 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35500b82d0 con 0x7f35500d0d70 2024-04-24T23:57:43.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.529+0000 7f3555000640 1 -- 172.21.15.155:0/1682785950 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35500b8890 con 0x7f35500d0d70 2024-04-24T23:57:43.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.529+0000 7f3547400640 1 -- 172.21.15.155:0/1682785950 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f353c030b00 con 0x7f35500d0d70 2024-04-24T23:57:43.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.530+0000 7f3547400640 1 -- 172.21.15.155:0/1682785950 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f353c030df0 con 0x7f35500d0d70 2024-04-24T23:57:43.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.531+0000 7f3544c00640 1 -- 172.21.15.155:0/1682785950 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3524005290 con 0x7f35500d0d70 2024-04-24T23:57:43.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.534+0000 7f3547400640 1 -- 172.21.15.155:0/1682785950 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f353c047460 con 0x7f35500d0d70 2024-04-24T23:57:43.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.609+0000 7f3544c00640 1 -- 172.21.15.155:0/1682785950 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "143d5098-bf88-4698-bdff-116597e598e8", "id": 4} v 0) -- 0x7f3524005850 con 0x7f35500d0d70 2024-04-24T23:57:43.613 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:43.613+0000 7f076f49a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T23:57:43.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.617+0000 7f3547400640 1 -- 172.21.15.155:0/1682785950 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "143d5098-bf88-4698-bdff-116597e598e8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f353c047640 con 0x7f35500d0d70 2024-04-24T23:57:43.616 INFO:teuthology.orchestra.run.smithi155.stdout:4 2024-04-24T23:57:43.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.618+0000 7f3544c00640 1 -- 172.21.15.155:0/1682785950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500d0d70 msgr2=0x7f35500b9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.618+0000 7f3544c00640 1 --2- 172.21.15.155:0/1682785950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500d0d70 0x7f35500b9090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f353c000c00 tx=0x7f353c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.618+0000 7f3544c00640 1 -- 172.21.15.155:0/1682785950 shutdown_connections 2024-04-24T23:57:43.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.618+0000 7f3544c00640 1 --2- 172.21.15.155:0/1682785950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35501615d0 0x7f355015d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.618+0000 7f3544c00640 1 --2- 172.21.15.155:0/1682785950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35500d0d70 0x7f35500b9090 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.618+0000 7f3544c00640 1 --2- 172.21.15.155:0/1682785950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35500cf610 0x7f355014a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.618+0000 7f3544c00640 1 -- 172.21.15.155:0/1682785950 >> 172.21.15.155:0/1682785950 conn(0x7f35500d3ff0 msgr2=0x7f355006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:43.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.619+0000 7f3544c00640 1 -- 172.21.15.155:0/1682785950 shutdown_connections 2024-04-24T23:57:43.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.619+0000 7f3544c00640 1 -- 172.21.15.155:0/1682785950 wait complete. 2024-04-24T23:57:43.623 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:43.623+0000 7fd1ef91b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T23:57:43.634 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 6b9a01d2-7234-4d42-8062-1bf82c81aefe 5 2024-04-24T23:57:43.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.802+0000 7f0f81a00640 1 Processor -- start 2024-04-24T23:57:43.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.803+0000 7f0f81a00640 1 -- start start 2024-04-24T23:57:43.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f81a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0cf610 0x7f0f7c0d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f81a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7c0cfeb0 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f81a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7c0cfbd0 con 0x7f0f7c1615d0 2024-04-24T23:57:43.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f81a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c0b7530 con 0x7f0f7c0cf610 2024-04-24T23:57:43.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0cf610 0x7f0f7c0d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f7be00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0f7c1615d0 0x7f0f7c0d1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57240/0 (socket says 172.21.15.155:57240) 2024-04-24T23:57:43.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f7be00640 1 -- 172.21.15.155:0/4124771822 learned_addr learned my addr 172.21.15.155:0/4124771822 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-24T23:57:43.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f73e00640 1 -- 172.21.15.155:0/4124771822 >> v1:172.21.15.155:6789/0 conn(0x7f0f7c1615d0 legacy=0x7f0f7c0d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f73e00640 1 -- 172.21.15.155:0/4124771822 >> v1:172.21.15.96:6789/0 conn(0x7f0f7c0d0d70 legacy=0x7f0f7c0b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:43.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.804+0000 7f0f73e00640 1 -- 172.21.15.155:0/4124771822 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c0b6ee0 con 0x7f0f7c0cf610 2024-04-24T23:57:43.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.805+0000 7f0f73e00640 1 --2- 172.21.15.155:0/4124771822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0cf610 0x7f0f7c0d0830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0b76b0 tx=0x7f0f6402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be7521697df7758c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:43.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.806+0000 7f0f7b400640 1 -- 172.21.15.155:0/4124771822 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64037070 con 0x7f0f7c0cf610 2024-04-24T23:57:43.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.806+0000 7f0f7b400640 1 -- 172.21.15.155:0/4124771822 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6402ae20 con 0x7f0f7c0cf610 2024-04-24T23:57:43.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.806+0000 7f0f7b400640 1 -- 172.21.15.155:0/4124771822 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64032660 con 0x7f0f7c0cf610 2024-04-24T23:57:43.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.806+0000 7f0f81a00640 1 -- 172.21.15.155:0/4124771822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0cf610 msgr2=0x7f0f7c0d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.806+0000 7f0f81a00640 1 --2- 172.21.15.155:0/4124771822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0cf610 0x7f0f7c0d0830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0b76b0 tx=0x7f0f6402a110 comp rx=0 tx=0).stop 2024-04-24T23:57:43.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.806+0000 7f0f81a00640 1 -- 172.21.15.155:0/4124771822 shutdown_connections 2024-04-24T23:57:43.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.806+0000 7f0f81a00640 1 --2- 172.21.15.155:0/4124771822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0cf610 0x7f0f7c0d0830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.806+0000 7f0f81a00640 1 -- 172.21.15.155:0/4124771822 >> 172.21.15.155:0/4124771822 conn(0x7f0f7c0d3ff0 msgr2=0x7f0f7c0d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:43.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.806+0000 7f0f81a00640 1 -- 172.21.15.155:0/4124771822 shutdown_connections 2024-04-24T23:57:43.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.807+0000 7f0f81a00640 1 -- 172.21.15.155:0/4124771822 wait complete. 2024-04-24T23:57:43.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.808+0000 7f0f81a00640 1 Processor -- start 2024-04-24T23:57:43.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.808+0000 7f0f81a00640 1 -- start start 2024-04-24T23:57:43.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f81a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f7c0cf610 0x7f0f7c15c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f81a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0d0d70 0x7f0f7c150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f81a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c1615d0 0x7f0f7c15af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:43.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f81a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c161b30 con 0x7f0f7c1615d0 2024-04-24T23:57:43.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f81a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c1619b0 con 0x7f0f7c0cf610 2024-04-24T23:57:43.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f81a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c0b80d0 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0d0d70 0x7f0f7c150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0d0d70 0x7f0f7c150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:60760/0 (socket says 172.21.15.155:60760) 2024-04-24T23:57:43.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f73e00640 1 -- 172.21.15.155:0/3936614852 learned_addr learned my addr 172.21.15.155:0/3936614852 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:43.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.809+0000 7f0f7be00640 1 --2- 172.21.15.155:0/3936614852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f7c0cf610 0x7f0f7c15c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f81000640 1 --2- 172.21.15.155:0/3936614852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c1615d0 0x7f0f7c15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:43.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f73e00640 1 -- 172.21.15.155:0/3936614852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f7c0cf610 msgr2=0x7f0f7c15c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f73e00640 1 --2- 172.21.15.155:0/3936614852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f7c0cf610 0x7f0f7c15c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f73e00640 1 -- 172.21.15.155:0/3936614852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c1615d0 msgr2=0x7f0f7c15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f73e00640 1 --2- 172.21.15.155:0/3936614852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c1615d0 0x7f0f7c15af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f73e00640 1 -- 172.21.15.155:0/3936614852 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c15ce80 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f73e00640 1 --2- 172.21.15.155:0/3936614852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0d0d70 0x7f0f7c150290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0f640098c0 tx=0x7f0f640046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:43.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f78c00640 1 -- 172.21.15.155:0/3936614852 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64041020 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f78c00640 1 -- 172.21.15.155:0/3936614852 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6403c670 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f78c00640 1 -- 172.21.15.155:0/3936614852 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64037040 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.810+0000 7f0f81a00640 1 -- 172.21.15.155:0/3936614852 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7c15b8a0 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.811+0000 7f0f81a00640 1 -- 172.21.15.155:0/3936614852 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7c15be60 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.811+0000 7f0f78c00640 1 -- 172.21.15.155:0/3936614852 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0f64044020 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.811+0000 7f0f78c00640 1 -- 172.21.15.155:0/3936614852 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0f6403d410 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.812+0000 7f0f81a00640 1 -- 172.21.15.155:0/3936614852 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7c0755d0 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.814+0000 7f0f78c00640 1 -- 172.21.15.155:0/3936614852 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0f6402ae20 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.888+0000 7f0f81a00640 1 -- 172.21.15.155:0/3936614852 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6b9a01d2-7234-4d42-8062-1bf82c81aefe", "id": 5} v 0) -- 0x7f0f7c0d39d0 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.896+0000 7f0f78c00640 1 -- 172.21.15.155:0/3936614852 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b9a01d2-7234-4d42-8062-1bf82c81aefe", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0f6404b030 con 0x7f0f7c0d0d70 2024-04-24T23:57:43.896 INFO:teuthology.orchestra.run.smithi155.stdout:5 2024-04-24T23:57:43.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.897+0000 7f0f81a00640 1 -- 172.21.15.155:0/3936614852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0d0d70 msgr2=0x7f0f7c150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:43.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.897+0000 7f0f81a00640 1 --2- 172.21.15.155:0/3936614852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0d0d70 0x7f0f7c150290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0f640098c0 tx=0x7f0f640046c0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.897+0000 7f0f81a00640 1 -- 172.21.15.155:0/3936614852 shutdown_connections 2024-04-24T23:57:43.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.897+0000 7f0f81a00640 1 --2- 172.21.15.155:0/3936614852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c1615d0 0x7f0f7c15af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.897+0000 7f0f81a00640 1 --2- 172.21.15.155:0/3936614852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f7c0d0d70 0x7f0f7c150290 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.897+0000 7f0f81a00640 1 --2- 172.21.15.155:0/3936614852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f7c0cf610 0x7f0f7c15c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:43.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.897+0000 7f0f81a00640 1 -- 172.21.15.155:0/3936614852 >> 172.21.15.155:0/3936614852 conn(0x7f0f7c0d3ff0 msgr2=0x7f0f7c0ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:43.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.898+0000 7f0f81a00640 1 -- 172.21.15.155:0/3936614852 shutdown_connections 2024-04-24T23:57:43.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:43.898+0000 7f0f81a00640 1 -- 172.21.15.155:0/3936614852 wait complete. 2024-04-24T23:57:43.913 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 86918891-3b52-46fb-af9c-2e1b526e9480 6 2024-04-24T23:57:44.078 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:44.078+0000 7fd1ef91b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-24T23:57:44.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.093+0000 7f0b5be00640 1 Processor -- start 2024-04-24T23:57:44.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.093+0000 7f0b5be00640 1 -- start start 2024-04-24T23:57:44.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b5be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5415b090 0x7f0b5409db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b5be00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0b5406ec40 0x7f0b540add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b5be00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b540ad820 con 0x7f0b540b2cc0 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b5be00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0b540b3260 con 0x7f0b5406ec40 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b5be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b540b3540 con 0x7f0b5415b090 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b59400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5415b090 0x7f0b5409db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b59400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5415b090 0x7f0b5409db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:60762/0 (socket says 172.21.15.155:60762) 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b59400640 1 -- 172.21.15.155:0/1718070896 learned_addr learned my addr 172.21.15.155:0/1718070896 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b59e00640 1 --2- 172.21.15.155:0/1718070896 >> v2:172.21.15.96:3300/0 conn(0x7f0b5406ec40 0x7f0b540add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.095+0000 7f0b59400640 1 -- 172.21.15.155:0/1718070896 >> v2:172.21.15.96:3300/0 conn(0x7f0b5406ec40 msgr2=0x7f0b540add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.096+0000 7f0b59400640 1 --2- 172.21.15.155:0/1718070896 >> v2:172.21.15.96:3300/0 conn(0x7f0b5406ec40 0x7f0b540add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.096+0000 7f0b59400640 1 -- 172.21.15.155:0/1718070896 >> v1:172.21.15.96:6789/0 conn(0x7f0b540b2cc0 legacy=0x7f0b5406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.096+0000 7f0b59400640 1 -- 172.21.15.155:0/1718070896 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b540b3820 con 0x7f0b5415b090 2024-04-24T23:57:44.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.097+0000 7f0b59400640 1 --2- 172.21.15.155:0/1718070896 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5415b090 0x7f0b5409db30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009870 tx=0x7f0b4802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f38a6e563c7df474 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:44.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.097+0000 7f0b53e00640 1 -- 172.21.15.155:0/1718070896 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48037070 con 0x7f0b5415b090 2024-04-24T23:57:44.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.097+0000 7f0b53e00640 1 -- 172.21.15.155:0/1718070896 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b48032440 con 0x7f0b5415b090 2024-04-24T23:57:44.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.097+0000 7f0b53e00640 1 -- 172.21.15.155:0/1718070896 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48032810 con 0x7f0b5415b090 2024-04-24T23:57:44.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.098+0000 7f0b5be00640 1 -- 172.21.15.155:0/1718070896 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5415b090 msgr2=0x7f0b5409db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.098+0000 7f0b5be00640 1 --2- 172.21.15.155:0/1718070896 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5415b090 0x7f0b5409db30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009870 tx=0x7f0b4802a210 comp rx=0 tx=0).stop 2024-04-24T23:57:44.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.098+0000 7f0b5be00640 1 -- 172.21.15.155:0/1718070896 shutdown_connections 2024-04-24T23:57:44.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.098+0000 7f0b5be00640 1 --2- 172.21.15.155:0/1718070896 >> v2:172.21.15.96:3300/0 conn(0x7f0b5406ec40 0x7f0b540add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.098+0000 7f0b5be00640 1 --2- 172.21.15.155:0/1718070896 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5415b090 0x7f0b5409db30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.098+0000 7f0b5be00640 1 -- 172.21.15.155:0/1718070896 >> 172.21.15.155:0/1718070896 conn(0x7f0b540b19c0 msgr2=0x7f0b540b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:44.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.098+0000 7f0b5be00640 1 -- 172.21.15.155:0/1718070896 shutdown_connections 2024-04-24T23:57:44.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.098+0000 7f0b5be00640 1 -- 172.21.15.155:0/1718070896 wait complete. 2024-04-24T23:57:44.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.099+0000 7f0b5be00640 1 Processor -- start 2024-04-24T23:57:44.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.100+0000 7f0b5be00640 1 -- start start 2024-04-24T23:57:44.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.100+0000 7f0b5be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5406ec40 0x7f0b54142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.100+0000 7f0b5be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b540b2cc0 0x7f0b54152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.100+0000 7f0b5be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b5415b090 0x7f0b54152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.100+0000 7f0b5be00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5415b470 con 0x7f0b5415b090 2024-04-24T23:57:44.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.100+0000 7f0b5be00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b540b4f70 con 0x7f0b540b2cc0 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.100+0000 7f0b5be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b54070e10 con 0x7f0b5406ec40 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b59400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5406ec40 0x7f0b54142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b58a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b540b2cc0 0x7f0b54152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b59400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5406ec40 0x7f0b54142ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:60766/0 (socket says 172.21.15.155:60766) 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b59400640 1 -- 172.21.15.155:0/746282605 learned_addr learned my addr 172.21.15.155:0/746282605 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b59e00640 1 --2- 172.21.15.155:0/746282605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b5415b090 0x7f0b54152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b59400640 1 -- 172.21.15.155:0/746282605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b540b2cc0 msgr2=0x7f0b54152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b59400640 1 --2- 172.21.15.155:0/746282605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b540b2cc0 0x7f0b54152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b59400640 1 -- 172.21.15.155:0/746282605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b5415b090 msgr2=0x7f0b54152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b59400640 1 --2- 172.21.15.155:0/746282605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b5415b090 0x7f0b54152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b59400640 1 -- 172.21.15.155:0/746282605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b541541a0 con 0x7f0b5406ec40 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.101+0000 7f0b58a00640 1 --2- 172.21.15.155:0/746282605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b540b2cc0 0x7f0b54152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:57:44.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.102+0000 7f0b59400640 1 --2- 172.21.15.155:0/746282605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5406ec40 0x7f0b54142ca0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b48000c00 tx=0x7f0b480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:44.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.102+0000 7f0b51600640 1 -- 172.21.15.155:0/746282605 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48041070 con 0x7f0b5406ec40 2024-04-24T23:57:44.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.102+0000 7f0b51600640 1 -- 172.21.15.155:0/746282605 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4803c870 con 0x7f0b5406ec40 2024-04-24T23:57:44.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.102+0000 7f0b51600640 1 -- 172.21.15.155:0/746282605 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48037040 con 0x7f0b5406ec40 2024-04-24T23:57:44.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.102+0000 7f0b5be00640 1 -- 172.21.15.155:0/746282605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b54153100 con 0x7f0b5406ec40 2024-04-24T23:57:44.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.102+0000 7f0b5be00640 1 -- 172.21.15.155:0/746282605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b541536c0 con 0x7f0b5406ec40 2024-04-24T23:57:44.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.102+0000 7f0b51600640 1 -- 172.21.15.155:0/746282605 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0b48044070 con 0x7f0b5406ec40 2024-04-24T23:57:44.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.102+0000 7f0b51600640 1 -- 172.21.15.155:0/746282605 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f0b48046450 con 0x7f0b5406ec40 2024-04-24T23:57:44.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.103+0000 7f0b5be00640 1 -- 172.21.15.155:0/746282605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b54069110 con 0x7f0b5406ec40 2024-04-24T23:57:44.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.105+0000 7f0b51600640 1 -- 172.21.15.155:0/746282605 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0b4803cc60 con 0x7f0b5406ec40 2024-04-24T23:57:44.110 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:44.111+0000 7f076f49a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-24T23:57:44.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.182+0000 7f0b5be00640 1 -- 172.21.15.155:0/746282605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "86918891-3b52-46fb-af9c-2e1b526e9480", "id": 6} v 0) -- 0x7f0b5406cdd0 con 0x7f0b5406ec40 2024-04-24T23:57:44.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.193+0000 7f0b51600640 1 -- 172.21.15.155:0/746282605 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86918891-3b52-46fb-af9c-2e1b526e9480", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f0b4803ce40 con 0x7f0b5406ec40 2024-04-24T23:57:44.192 INFO:teuthology.orchestra.run.smithi155.stdout:6 2024-04-24T23:57:44.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.195+0000 7f0b5be00640 1 -- 172.21.15.155:0/746282605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5406ec40 msgr2=0x7f0b54142ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.195+0000 7f0b5be00640 1 --2- 172.21.15.155:0/746282605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5406ec40 0x7f0b54142ca0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b48000c00 tx=0x7f0b480046c0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.195+0000 7f0b5be00640 1 -- 172.21.15.155:0/746282605 shutdown_connections 2024-04-24T23:57:44.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.195+0000 7f0b5be00640 1 --2- 172.21.15.155:0/746282605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b5415b090 0x7f0b54152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.195+0000 7f0b5be00640 1 --2- 172.21.15.155:0/746282605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b540b2cc0 0x7f0b54152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.195+0000 7f0b5be00640 1 --2- 172.21.15.155:0/746282605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b5406ec40 0x7f0b54142ca0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.195+0000 7f0b5be00640 1 -- 172.21.15.155:0/746282605 >> 172.21.15.155:0/746282605 conn(0x7f0b540b19c0 msgr2=0x7f0b540aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:44.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.195+0000 7f0b5be00640 1 -- 172.21.15.155:0/746282605 shutdown_connections 2024-04-24T23:57:44.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.195+0000 7f0b5be00640 1 -- 172.21.15.155:0/746282605 wait complete. 2024-04-24T23:57:44.210 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new ec46fd06-12ff-48dd-ac6b-2a65da5ec402 7 2024-04-24T23:57:44.373 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:44.372+0000 7fd1ef91b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T23:57:44.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.390+0000 7fc729000640 1 Processor -- start 2024-04-24T23:57:44.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.390+0000 7fc729000640 1 -- start start 2024-04-24T23:57:44.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.392+0000 7fc729000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7240cfb20 0x7fc724168fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.392+0000 7fc729000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7240b5120 con 0x7fc724161790 2024-04-24T23:57:44.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.392+0000 7fc729000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7240cff50 con 0x7fc7240b8260 2024-04-24T23:57:44.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.392+0000 7fc729000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc7240d2550 con 0x7fc7240cfb20 2024-04-24T23:57:44.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.392+0000 7fc723e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7240cfb20 0x7fc724168fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.392+0000 7fc723e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7240cfb20 0x7fc724168fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52358/0 (socket says 172.21.15.155:52358) 2024-04-24T23:57:44.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.392+0000 7fc723e00640 1 -- 172.21.15.155:0/2608278882 learned_addr learned my addr 172.21.15.155:0/2608278882 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:44.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.393+0000 7fc723e00640 1 -- 172.21.15.155:0/2608278882 >> v1:172.21.15.155:6789/0 conn(0x7fc7240b8260 legacy=0x7fc7240d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.393+0000 7fc723e00640 1 -- 172.21.15.155:0/2608278882 >> v1:172.21.15.96:6789/0 conn(0x7fc724161790 legacy=0x7fc7240d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.393+0000 7fc723e00640 1 -- 172.21.15.155:0/2608278882 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7240d27a0 con 0x7fc7240cfb20 2024-04-24T23:57:44.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.394+0000 7fc723e00640 1 --2- 172.21.15.155:0/2608278882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 0x7fc724168fc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009e50 tx=0x7fc71c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a875ce98fac8bd37 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:44.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.394+0000 7fc722000640 1 -- 172.21.15.155:0/2608278882 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71c036070 con 0x7fc7240cfb20 2024-04-24T23:57:44.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.394+0000 7fc722000640 1 -- 172.21.15.155:0/2608278882 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71c031600 con 0x7fc7240cfb20 2024-04-24T23:57:44.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.394+0000 7fc722000640 1 -- 172.21.15.155:0/2608278882 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71c0319d0 con 0x7fc7240cfb20 2024-04-24T23:57:44.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.395+0000 7fc729000640 1 -- 172.21.15.155:0/2608278882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 msgr2=0x7fc724168fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.395+0000 7fc729000640 1 --2- 172.21.15.155:0/2608278882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 0x7fc724168fc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009e50 tx=0x7fc71c02a730 comp rx=0 tx=0).stop 2024-04-24T23:57:44.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.395+0000 7fc729000640 1 -- 172.21.15.155:0/2608278882 shutdown_connections 2024-04-24T23:57:44.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.395+0000 7fc729000640 1 --2- 172.21.15.155:0/2608278882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 0x7fc724168fc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.395+0000 7fc729000640 1 -- 172.21.15.155:0/2608278882 >> 172.21.15.155:0/2608278882 conn(0x7fc7240d3f70 msgr2=0x7fc7240d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:44.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.395+0000 7fc729000640 1 -- 172.21.15.155:0/2608278882 shutdown_connections 2024-04-24T23:57:44.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.395+0000 7fc729000640 1 -- 172.21.15.155:0/2608278882 wait complete. 2024-04-24T23:57:44.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.396+0000 7fc729000640 1 Processor -- start 2024-04-24T23:57:44.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.397+0000 7fc729000640 1 -- start start 2024-04-24T23:57:44.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc729000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7240b8260 0x7fc7240b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc729000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 0x7fc724150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc729000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc724161790 0x7fc724153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc729000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc7240d2d60 con 0x7fc724161790 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc729000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7240b6dc0 con 0x7fc7240cfb20 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc729000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc7240d16f0 con 0x7fc7240b8260 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc722a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 0x7fc724150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc723400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7240b8260 0x7fc7240b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc722a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 0x7fc724150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52362/0 (socket says 172.21.15.155:52362) 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc722a00640 1 -- 172.21.15.155:0/3643104032 learned_addr learned my addr 172.21.15.155:0/3643104032 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc723e00640 1 --2- 172.21.15.155:0/3643104032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc724161790 0x7fc724153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc722a00640 1 -- 172.21.15.155:0/3643104032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7240b8260 msgr2=0x7fc7240b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc722a00640 1 --2- 172.21.15.155:0/3643104032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7240b8260 0x7fc7240b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc722a00640 1 -- 172.21.15.155:0/3643104032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc724161790 msgr2=0x7fc724153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc722a00640 1 --2- 172.21.15.155:0/3643104032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc724161790 0x7fc724153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.398+0000 7fc722a00640 1 -- 172.21.15.155:0/3643104032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72414d9c0 con 0x7fc7240cfb20 2024-04-24T23:57:44.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.399+0000 7fc722a00640 1 --2- 172.21.15.155:0/3643104032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 0x7fc724150430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc71000c480 tx=0x7fc71000c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:44.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.399+0000 7fc71b400640 1 -- 172.21.15.155:0/3643104032 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7100052d0 con 0x7fc7240cfb20 2024-04-24T23:57:44.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.399+0000 7fc71b400640 1 -- 172.21.15.155:0/3643104032 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc710005470 con 0x7fc7240cfb20 2024-04-24T23:57:44.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.399+0000 7fc71b400640 1 -- 172.21.15.155:0/3643104032 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710012870 con 0x7fc7240cfb20 2024-04-24T23:57:44.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.399+0000 7fc729000640 1 -- 172.21.15.155:0/3643104032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72414dc80 con 0x7fc7240cfb20 2024-04-24T23:57:44.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.399+0000 7fc729000640 1 -- 172.21.15.155:0/3643104032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc72414e240 con 0x7fc7240cfb20 2024-04-24T23:57:44.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.399+0000 7fc71b400640 1 -- 172.21.15.155:0/3643104032 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc710012a10 con 0x7fc7240cfb20 2024-04-24T23:57:44.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.399+0000 7fc71b400640 1 -- 172.21.15.155:0/3643104032 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc71001bb50 con 0x7fc7240cfb20 2024-04-24T23:57:44.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.400+0000 7fc729000640 1 -- 172.21.15.155:0/3643104032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc724069110 con 0x7fc7240cfb20 2024-04-24T23:57:44.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.403+0000 7fc71b400640 1 -- 172.21.15.155:0/3643104032 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc724069110 con 0x7fc7240cfb20 2024-04-24T23:57:44.430 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:44.429+0000 7f076f49a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T23:57:44.435 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:44.435+0000 7fd1ef91b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T23:57:44.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.482+0000 7fc729000640 1 -- 172.21.15.155:0/3643104032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ec46fd06-12ff-48dd-ac6b-2a65da5ec402", "id": 7} v 0) -- 0x7fc7240755d0 con 0x7fc7240cfb20 2024-04-24T23:57:44.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.493+0000 7fc71b400640 1 -- 172.21.15.155:0/3643104032 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec46fd06-12ff-48dd-ac6b-2a65da5ec402", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc71001b4f0 con 0x7fc7240cfb20 2024-04-24T23:57:44.492 INFO:teuthology.orchestra.run.smithi155.stdout:7 2024-04-24T23:57:44.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.494+0000 7fc729000640 1 -- 172.21.15.155:0/3643104032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 msgr2=0x7fc724150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.494+0000 7fc729000640 1 --2- 172.21.15.155:0/3643104032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 0x7fc724150430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc71000c480 tx=0x7fc71000c940 comp rx=0 tx=0).stop 2024-04-24T23:57:44.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.494+0000 7fc729000640 1 -- 172.21.15.155:0/3643104032 shutdown_connections 2024-04-24T23:57:44.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.494+0000 7fc729000640 1 --2- 172.21.15.155:0/3643104032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc724161790 0x7fc724153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.494+0000 7fc729000640 1 --2- 172.21.15.155:0/3643104032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7240cfb20 0x7fc724150430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.494+0000 7fc729000640 1 --2- 172.21.15.155:0/3643104032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7240b8260 0x7fc7240b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.494+0000 7fc729000640 1 -- 172.21.15.155:0/3643104032 >> 172.21.15.155:0/3643104032 conn(0x7fc7240d3f70 msgr2=0x7fc7240b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:44.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.494+0000 7fc729000640 1 -- 172.21.15.155:0/3643104032 shutdown_connections 2024-04-24T23:57:44.494 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:44.494+0000 7f076f49a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T23:57:44.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:57:44.494+0000 7fc729000640 1 -- 172.21.15.155:0/3643104032 wait complete. 2024-04-24T23:57:44.510 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T23:57:44.510 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-24T23:57:44.517 INFO:tasks.ceph.osd.0:Started 2024-04-24T23:57:44.517 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T23:57:44.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-24T23:57:44.525 INFO:tasks.ceph.osd.1:Started 2024-04-24T23:57:44.525 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T23:57:44.525 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-24T23:57:44.531 INFO:tasks.ceph.osd.2:Started 2024-04-24T23:57:44.531 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T23:57:44.532 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-24T23:57:44.537 INFO:tasks.ceph.osd.3:Started 2024-04-24T23:57:44.537 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-24T23:57:44.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-24T23:57:44.543 INFO:tasks.ceph.osd.4:Started 2024-04-24T23:57:44.543 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-24T23:57:44.543 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-24T23:57:44.549 INFO:tasks.ceph.osd.5:Started 2024-04-24T23:57:44.550 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-24T23:57:44.550 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-24T23:57:44.554 INFO:tasks.ceph.osd.6:Started 2024-04-24T23:57:44.555 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-24T23:57:44.555 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-24T23:57:44.560 INFO:tasks.ceph.osd.7:Started 2024-04-24T23:57:44.560 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:57:44.581 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:44.580+0000 7fd1ef91b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-24T23:57:44.652 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:44.652+0000 7f076f49a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-24T23:57:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.762+0000 7f859be00640 1 Processor -- start 2024-04-24T23:57:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.762+0000 7f859be00640 1 -- start start 2024-04-24T23:57:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.763+0000 7f859be00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f859c0cf340 0x7f859c0d4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.763+0000 7f859be00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f859c15e6d0 0x7f859c0d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.763+0000 7f859be00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859c0cf7f0 con 0x7f859c15e2f0 2024-04-24T23:57:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.763+0000 7f859be00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f859c0d0400 con 0x7f859c15e6d0 2024-04-24T23:57:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.763+0000 7f859be00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f859c0cfad0 con 0x7f859c0cf340 2024-04-24T23:57:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.763+0000 7f859b400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f859c15e6d0 0x7f859c0d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.763+0000 7f859aa00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f859c15e2f0 0x7f859c0cec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47766/0 (socket says 172.21.15.96:47766) 2024-04-24T23:57:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.763+0000 7f859aa00640 1 -- 172.21.15.96:0/1793723879 learned_addr learned my addr 172.21.15.96:0/1793723879 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:57:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.764+0000 7f859a000640 1 --2- 172.21.15.96:0/1793723879 >> v2:172.21.15.155:3300/0 conn(0x7f859c0cf340 0x7f859c0d4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.764+0000 7f859b400640 1 -- 172.21.15.96:0/1793723879 >> v2:172.21.15.155:3300/0 conn(0x7f859c0cf340 msgr2=0x7f859c0d4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.764+0000 7f8599600640 1 -- 172.21.15.96:0/1793723879 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153394762 0 0) 0x7f859c0cf7f0 con 0x7f859c15e2f0 2024-04-24T23:57:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.764+0000 7f859b400640 1 --2- 172.21.15.96:0/1793723879 >> v2:172.21.15.155:3300/0 conn(0x7f859c0cf340 0x7f859c0d4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.764+0000 7f859b400640 1 -- 172.21.15.96:0/1793723879 >> v1:172.21.15.96:6789/0 conn(0x7f859c15e2f0 legacy=0x7f859c0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.764+0000 7f859b400640 1 -- 172.21.15.96:0/1793723879 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c0cfdb0 con 0x7f859c15e6d0 2024-04-24T23:57:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.766+0000 7f859b400640 1 --2- 172.21.15.96:0/1793723879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 0x7f859c0d47d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f859c0d53a0 tx=0x7f859402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e09ef1da43c8dac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.766+0000 7f8599600640 1 -- 172.21.15.96:0/1793723879 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594007740 con 0x7f859c15e6d0 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.766+0000 7f8599600640 1 -- 172.21.15.96:0/1793723879 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85940078e0 con 0x7f859c15e6d0 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.766+0000 7f8599600640 1 -- 172.21.15.96:0/1793723879 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594007cb0 con 0x7f859c15e6d0 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.766+0000 7f859be00640 1 -- 172.21.15.96:0/1793723879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 msgr2=0x7f859c0d47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.766+0000 7f859be00640 1 --2- 172.21.15.96:0/1793723879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 0x7f859c0d47d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f859c0d53a0 tx=0x7f859402a710 comp rx=0 tx=0).stop 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.767+0000 7f859be00640 1 -- 172.21.15.96:0/1793723879 shutdown_connections 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.767+0000 7f859be00640 1 --2- 172.21.15.96:0/1793723879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 0x7f859c0d47d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.767+0000 7f859be00640 1 --2- 172.21.15.96:0/1793723879 >> v2:172.21.15.155:3300/0 conn(0x7f859c0cf340 0x7f859c0d4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.767+0000 7f859be00640 1 -- 172.21.15.96:0/1793723879 >> 172.21.15.96:0/1793723879 conn(0x7f859c073220 msgr2=0x7f859c09d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.767+0000 7f859be00640 1 -- 172.21.15.96:0/1793723879 shutdown_connections 2024-04-24T23:57:44.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.767+0000 7f859be00640 1 -- 172.21.15.96:0/1793723879 wait complete. 2024-04-24T23:57:44.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.768+0000 7f859be00640 1 Processor -- start 2024-04-24T23:57:44.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.768+0000 7f859be00640 1 -- start start 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.769+0000 7f859be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f859c0cf340 0x7f859c15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.769+0000 7f859be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c15e2f0 0x7f859c0b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.769+0000 7f859be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 0x7f859c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.769+0000 7f859be00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f859c0d0890 con 0x7f859c15e6d0 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.769+0000 7f859be00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f859c0d2a90 con 0x7f859c15e2f0 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.769+0000 7f859be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f859c0d0a10 con 0x7f859c0cf340 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859b400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 0x7f859c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859b400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 0x7f859c0b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36666/0 (socket says 172.21.15.96:36666) 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859b400640 1 -- 172.21.15.96:0/2071605697 learned_addr learned my addr 172.21.15.96:0/2071605697 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:57:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f859c0cf340 0x7f859c15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c15e2f0 0x7f859c0b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859b400640 1 -- 172.21.15.96:0/2071605697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f859c0cf340 msgr2=0x7f859c15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859b400640 1 --2- 172.21.15.96:0/2071605697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f859c0cf340 0x7f859c15bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859b400640 1 -- 172.21.15.96:0/2071605697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c15e2f0 msgr2=0x7f859c0b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859b400640 1 --2- 172.21.15.96:0/2071605697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c15e2f0 0x7f859c0b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859b400640 1 -- 172.21.15.96:0/2071605697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c0cb590 con 0x7f859c15e6d0 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859aa00640 1 --2- 172.21.15.96:0/2071605697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f859c0cf340 0x7f859c15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859a000640 1 --2- 172.21.15.96:0/2071605697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c15e2f0 0x7f859c0b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.770+0000 7f859b400640 1 --2- 172.21.15.96:0/2071605697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 0x7f859c0b3880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f859402ad00 tx=0x7f8594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.771+0000 7f8592a00640 1 -- 172.21.15.96:0/2071605697 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594040030 con 0x7f859c15e6d0 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.771+0000 7f8592a00640 1 -- 172.21.15.96:0/2071605697 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85940319c0 con 0x7f859c15e6d0 2024-04-24T23:57:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.771+0000 7f859be00640 1 -- 172.21.15.96:0/2071605697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859c0cb870 con 0x7f859c15e6d0 2024-04-24T23:57:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.771+0000 7f8592a00640 1 -- 172.21.15.96:0/2071605697 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594009450 con 0x7f859c15e6d0 2024-04-24T23:57:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.771+0000 7f859be00640 1 -- 172.21.15.96:0/2071605697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859c0cbe30 con 0x7f859c15e6d0 2024-04-24T23:57:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.771+0000 7f8592a00640 1 -- 172.21.15.96:0/2071605697 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8594043030 con 0x7f859c15e6d0 2024-04-24T23:57:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.771+0000 7f8592a00640 1 -- 172.21.15.96:0/2071605697 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f859403b410 con 0x7f859c15e6d0 2024-04-24T23:57:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.772+0000 7f859be00640 1 -- 172.21.15.96:0/2071605697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859c067e40 con 0x7f859c15e6d0 2024-04-24T23:57:44.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.775+0000 7f8592a00640 1 -- 172.21.15.96:0/2071605697 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f859403b6f0 con 0x7f859c15e6d0 2024-04-24T23:57:44.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.839+0000 7f859be00640 1 -- 172.21.15.96:0/2071605697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f859c0cc030 con 0x7f859c15e6d0 2024-04-24T23:57:44.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.840+0000 7f8592a00640 1 -- 172.21.15.96:0/2071605697 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f859c0cc030 con 0x7f859c15e6d0 2024-04-24T23:57:44.840 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:57:44.840 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:57:44.483938+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:57:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.840+0000 7f859be00640 1 -- 172.21.15.96:0/2071605697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 msgr2=0x7f859c0b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.840+0000 7f859be00640 1 --2- 172.21.15.96:0/2071605697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 0x7f859c0b3880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f859402ad00 tx=0x7f8594004a40 comp rx=0 tx=0).stop 2024-04-24T23:57:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.841+0000 7f859be00640 1 -- 172.21.15.96:0/2071605697 shutdown_connections 2024-04-24T23:57:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.841+0000 7f859be00640 1 --2- 172.21.15.96:0/2071605697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f859c15e6d0 0x7f859c0b3880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.841+0000 7f859be00640 1 --2- 172.21.15.96:0/2071605697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c15e2f0 0x7f859c0b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.841+0000 7f859be00640 1 --2- 172.21.15.96:0/2071605697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f859c0cf340 0x7f859c15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.841+0000 7f859be00640 1 -- 172.21.15.96:0/2071605697 >> 172.21.15.96:0/2071605697 conn(0x7f859c073220 msgr2=0x7f859c06d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:44.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.841+0000 7f859be00640 1 -- 172.21.15.96:0/2071605697 shutdown_connections 2024-04-24T23:57:44.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:57:44.841+0000 7f859be00640 1 -- 172.21.15.96:0/2071605697 wait complete. 2024-04-24T23:57:44.856 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T23:57:44.856 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T23:57:44.982 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:44.982+0000 7fd1ef91b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T23:57:45.019 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:45.019+0000 7f076f49a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T23:57:45.042 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:45.041+0000 7fd1ef91b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T23:57:45.078 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:45.078+0000 7f076f49a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T23:57:45.218 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-24T23:57:45.218+0000 7fbe20010640 -1 Falling back to public interface 2024-04-24T23:57:45.222 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:45.222+0000 7fd1ef91b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T23:57:45.224 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-24T23:57:45.224+0000 7f3f651c4640 -1 Falling back to public interface 2024-04-24T23:57:45.226 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-24T23:57:45.226+0000 7f5b3b5bc640 -1 Falling back to public interface 2024-04-24T23:57:45.238 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-04-24T23:57:45.239+0000 7fcd84b40640 -1 Falling back to public interface 2024-04-24T23:57:45.252 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-04-24T23:57:45.252+0000 7f6a581fc640 -1 Falling back to public interface 2024-04-24T23:57:45.265 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-24T23:57:45.265+0000 7f1328142640 -1 Falling back to public interface 2024-04-24T23:57:45.265 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:45.265+0000 7f076f49a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T23:57:45.265 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-04-24T23:57:45.266+0000 7fd0cab3b640 -1 Falling back to public interface 2024-04-24T23:57:45.270 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-24T23:57:45.270+0000 7f8285616640 -1 Falling back to public interface 2024-04-24T23:57:45.396 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:45.396+0000 7fd1ef91b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T23:57:45.442 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:45.442+0000 7f076f49a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T23:57:45.454 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:45.453+0000 7fd1ef91b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T23:57:45.501 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:45.501+0000 7f076f49a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T23:57:45.536 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:45.535+0000 7fd1ef91b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T23:57:45.586 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:45.586+0000 7f076f49a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T23:57:45.591 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:45.591+0000 7fd1ef91b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T23:57:45.641 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:45.641+0000 7f076f49a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T23:57:45.662 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T23:57:45.818 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.818+0000 7fecfa000640 1 Processor -- start 2024-04-24T23:57:45.818 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.818+0000 7fecfa000640 1 -- start start 2024-04-24T23:57:45.821 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecfa000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fecf4147a00 0x7fecf40700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:45.821 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecfa000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fecf406b770 0x7fecf40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:45.821 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecfa000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf4070630 con 0x7fecf40b5d00 2024-04-24T23:57:45.821 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecfa000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fecf406f3c0 con 0x7fecf4147a00 2024-04-24T23:57:45.821 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecfa000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fecf406fc60 con 0x7fecf406b770 2024-04-24T23:57:45.821 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecf3400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fecf4147a00 0x7fecf40700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:45.821 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecf3400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fecf4147a00 0x7fecf40700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36672/0 (socket says 172.21.15.96:36672) 2024-04-24T23:57:45.821 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecf3400640 1 -- 172.21.15.96:0/1800612778 learned_addr learned my addr 172.21.15.96:0/1800612778 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:57:45.821 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecf3e00640 1 --2- 172.21.15.96:0/1800612778 >> v2:172.21.15.155:3300/0 conn(0x7fecf406b770 0x7fecf40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:45.822 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecf3400640 1 -- 172.21.15.96:0/1800612778 >> v2:172.21.15.155:3300/0 conn(0x7fecf406b770 msgr2=0x7fecf40b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:45.822 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.820+0000 7fecf3400640 1 --2- 172.21.15.96:0/1800612778 >> v2:172.21.15.155:3300/0 conn(0x7fecf406b770 0x7fecf40b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:45.822 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.821+0000 7fecf3400640 1 -- 172.21.15.96:0/1800612778 >> v1:172.21.15.96:6789/0 conn(0x7fecf40b5d00 legacy=0x7fecf406b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:45.822 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.821+0000 7fecf3400640 1 -- 172.21.15.96:0/1800612778 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf4147de0 con 0x7fecf4147a00 2024-04-24T23:57:45.822 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.821+0000 7fecf2000640 1 -- 172.21.15.96:0/1800612778 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792782593 0 0) 0x7fecf4070630 con 0x7fecf40b5d00 2024-04-24T23:57:45.823 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.822+0000 7fecf3400640 1 --2- 172.21.15.96:0/1800612778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf4147a00 0x7fecf40700f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fecf4161cb0 tx=0x7fece402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7cabe294004c72 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:45.823 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.822+0000 7fecf2000640 1 -- 172.21.15.96:0/1800612778 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4037070 con 0x7fecf4147a00 2024-04-24T23:57:45.823 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.822+0000 7fecf2000640 1 -- 172.21.15.96:0/1800612778 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece4032440 con 0x7fecf4147a00 2024-04-24T23:57:45.824 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.822+0000 7fecf2000640 1 -- 172.21.15.96:0/1800612778 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4032810 con 0x7fecf4147a00 2024-04-24T23:57:45.824 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.822+0000 7fecfa000640 1 -- 172.21.15.96:0/1800612778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf4147a00 msgr2=0x7fecf40700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:45.824 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.822+0000 7fecfa000640 1 --2- 172.21.15.96:0/1800612778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf4147a00 0x7fecf40700f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fecf4161cb0 tx=0x7fece402a270 comp rx=0 tx=0).stop 2024-04-24T23:57:45.824 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.823+0000 7fecfa000640 1 -- 172.21.15.96:0/1800612778 shutdown_connections 2024-04-24T23:57:45.824 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.823+0000 7fecfa000640 1 --2- 172.21.15.96:0/1800612778 >> v2:172.21.15.155:3300/0 conn(0x7fecf406b770 0x7fecf40b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:45.824 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.823+0000 7fecfa000640 1 --2- 172.21.15.96:0/1800612778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf4147a00 0x7fecf40700f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:45.824 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.823+0000 7fecfa000640 1 -- 172.21.15.96:0/1800612778 >> 172.21.15.96:0/1800612778 conn(0x7fecf40b2cd0 msgr2=0x7fecf40b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:45.824 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.823+0000 7fecfa000640 1 -- 172.21.15.96:0/1800612778 shutdown_connections 2024-04-24T23:57:45.824 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.823+0000 7fecfa000640 1 -- 172.21.15.96:0/1800612778 wait complete. 2024-04-24T23:57:45.827 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.824+0000 7fecfa000640 1 Processor -- start 2024-04-24T23:57:45.827 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.824+0000 7fecfa000640 1 -- start start 2024-04-24T23:57:45.827 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.825+0000 7fecfa000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecf406b770 0x7fecf415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:45.827 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.825+0000 7fecfa000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf40b5d00 0x7fecf415f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:45.827 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.825+0000 7fecfa000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4147a00 0x7fecf41f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:45.827 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.825+0000 7fecfa000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fecf406f8f0 con 0x7fecf40b5d00 2024-04-24T23:57:45.827 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.825+0000 7fecfa000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fecf406f610 con 0x7fecf4147a00 2024-04-24T23:57:45.827 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.825+0000 7fecfa000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fecf415f5f0 con 0x7fecf406b770 2024-04-24T23:57:45.827 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf2a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf40b5d00 0x7fecf415f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf2a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf40b5d00 0x7fecf415f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36686/0 (socket says 172.21.15.96:36686) 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf2a00640 1 -- 172.21.15.96:0/3630770641 learned_addr learned my addr 172.21.15.96:0/3630770641 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf3e00640 1 --2- 172.21.15.96:0/3630770641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4147a00 0x7fecf41f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf3400640 1 --2- 172.21.15.96:0/3630770641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecf406b770 0x7fecf415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf2a00640 1 -- 172.21.15.96:0/3630770641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecf406b770 msgr2=0x7fecf415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf2a00640 1 --2- 172.21.15.96:0/3630770641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecf406b770 0x7fecf415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf2a00640 1 -- 172.21.15.96:0/3630770641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4147a00 msgr2=0x7fecf41f7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf2a00640 1 --2- 172.21.15.96:0/3630770641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4147a00 0x7fecf41f7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf2a00640 1 -- 172.21.15.96:0/3630770641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf41600b0 con 0x7fecf40b5d00 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecf2a00640 1 --2- 172.21.15.96:0/3630770641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf40b5d00 0x7fecf415f860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fece000c4e0 tx=0x7fece000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7feceb400640 1 -- 172.21.15.96:0/3630770641 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0017070 con 0x7fecf40b5d00 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7feceb400640 1 -- 172.21.15.96:0/3630770641 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece00035f0 con 0x7fecf40b5d00 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7feceb400640 1 -- 172.21.15.96:0/3630770641 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece00039e0 con 0x7fecf40b5d00 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.826+0000 7fecfa000640 1 -- 172.21.15.96:0/3630770641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf4160390 con 0x7fecf40b5d00 2024-04-24T23:57:45.828 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.827+0000 7fecfa000640 1 -- 172.21.15.96:0/3630770641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf41f76e0 con 0x7fecf40b5d00 2024-04-24T23:57:45.829 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.827+0000 7feceb400640 1 -- 172.21.15.96:0/3630770641 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fece001a070 con 0x7fecf40b5d00 2024-04-24T23:57:45.829 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.827+0000 7feceb400640 1 -- 172.21.15.96:0/3630770641 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fece001cbc0 con 0x7fecf40b5d00 2024-04-24T23:57:45.829 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.828+0000 7fecfa000640 1 -- 172.21.15.96:0/3630770641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf4075490 con 0x7fecf40b5d00 2024-04-24T23:57:45.830 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.830+0000 7feceb400640 1 -- 172.21.15.96:0/3630770641 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fece0003b80 con 0x7fecf40b5d00 2024-04-24T23:57:45.897 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.896+0000 7fecfa000640 1 -- 172.21.15.96:0/3630770641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecf41463a0 con 0x7fecf40b5d00 2024-04-24T23:57:45.897 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.897+0000 7feceb400640 1 -- 172.21.15.96:0/3630770641 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fece0003d60 con 0x7fecf40b5d00 2024-04-24T23:57:45.897 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-24T23:57:45.898 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":10,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:57:44.483938+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:57:45.898 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.898+0000 7fecfa000640 1 -- 172.21.15.96:0/3630770641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf40b5d00 msgr2=0x7fecf415f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:45.899 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.898+0000 7fecfa000640 1 --2- 172.21.15.96:0/3630770641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf40b5d00 0x7fecf415f860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fece000c4e0 tx=0x7fece000c9a0 comp rx=0 tx=0).stop 2024-04-24T23:57:45.899 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.898+0000 7fecfa000640 1 -- 172.21.15.96:0/3630770641 shutdown_connections 2024-04-24T23:57:45.899 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.898+0000 7fecfa000640 1 --2- 172.21.15.96:0/3630770641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4147a00 0x7fecf41f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:45.899 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.898+0000 7fecfa000640 1 --2- 172.21.15.96:0/3630770641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf40b5d00 0x7fecf415f860 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:45.899 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.898+0000 7fecfa000640 1 --2- 172.21.15.96:0/3630770641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecf406b770 0x7fecf415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:45.899 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.898+0000 7fecfa000640 1 -- 172.21.15.96:0/3630770641 >> 172.21.15.96:0/3630770641 conn(0x7fecf40b2cd0 msgr2=0x7fecf4146ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:45.899 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.898+0000 7fecfa000640 1 -- 172.21.15.96:0/3630770641 shutdown_connections 2024-04-24T23:57:45.899 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:45.898+0000 7fecfa000640 1 -- 172.21.15.96:0/3630770641 wait complete. 2024-04-24T23:57:45.911 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-24T23:57:46.147 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:46.147+0000 7fd1ef91b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T23:57:46.196 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:46.196+0000 7f076f49a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T23:57:46.278 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:46.278+0000 7fd1ef91b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T23:57:46.332 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-24T23:57:46.332+0000 7f076f49a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T23:57:47.319 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:47.319+0000 7fd190a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-24T23:57:47.319 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:57:47.319+0000 7fd190a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-24T23:57:48.831 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-24T23:57:48.831+0000 7fbe20010640 -1 osd.4 0 log_to_monitors true 2024-04-24T23:57:48.833 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-04-24T23:57:48.833+0000 7fcd84b40640 -1 osd.3 0 log_to_monitors true 2024-04-24T23:57:48.835 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-24T23:57:48.835+0000 7f5b3b5bc640 -1 osd.6 0 log_to_monitors true 2024-04-24T23:57:48.854 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-24T23:57:48.854+0000 7f1328142640 -1 osd.7 0 log_to_monitors true 2024-04-24T23:57:48.891 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-04-24T23:57:48.891+0000 7f6a581fc640 -1 osd.0 0 log_to_monitors true 2024-04-24T23:57:48.891 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-04-24T23:57:48.891+0000 7fd0cab3b640 -1 osd.2 0 log_to_monitors true 2024-04-24T23:57:48.904 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-24T23:57:48.904+0000 7f8285616640 -1 osd.5 0 log_to_monitors true 2024-04-24T23:57:49.068 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-24T23:57:49.068+0000 7f3f651c4640 -1 osd.1 0 log_to_monitors true 2024-04-24T23:57:52.585 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-04-24T23:57:52.585+0000 7fcd80e00640 -1 osd.3 0 waiting for initial osdmap 2024-04-24T23:57:52.591 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-04-24T23:57:52.591+0000 7fcd75a00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:57:52.600 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-24T23:57:52.600+0000 7f3f5f600640 -1 osd.1 0 waiting for initial osdmap 2024-04-24T23:57:52.607 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-24T23:57:52.607+0000 7f3f56000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:57:52.635 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-24T23:57:52.634+0000 7f827f400640 -1 osd.5 0 waiting for initial osdmap 2024-04-24T23:57:52.642 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-24T23:57:52.642+0000 7f8275e00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:57:52.643 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-24T23:57:52.643+0000 7f1322600640 -1 osd.7 0 waiting for initial osdmap 2024-04-24T23:57:52.653 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-04-24T23:57:52.653+0000 7fd0c5000640 -1 osd.2 0 waiting for initial osdmap 2024-04-24T23:57:52.654 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-24T23:57:52.654+0000 7f1319000640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:57:52.658 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-24T23:57:52.659+0000 7fbe1bc00640 -1 osd.4 0 waiting for initial osdmap 2024-04-24T23:57:52.663 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-24T23:57:52.663+0000 7fbe10800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:57:52.664 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-04-24T23:57:52.664+0000 7fd0bba00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:57:52.678 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-24T23:57:52.678+0000 7f5b35a00640 -1 osd.6 0 waiting for initial osdmap 2024-04-24T23:57:52.690 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-04-24T23:57:52.690+0000 7f6a52600640 -1 osd.0 0 waiting for initial osdmap 2024-04-24T23:57:52.692 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-24T23:57:52.692+0000 7f5b2c400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:57:52.702 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-04-24T23:57:52.702+0000 7f6a49000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:57:52.717 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T23:57:52.875 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.875+0000 7f46ba000640 1 Processor -- start 2024-04-24T23:57:52.876 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.875+0000 7f46ba000640 1 -- start start 2024-04-24T23:57:52.877 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.876+0000 7f46ba000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f46b415e1c0 0x7f46b40d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:52.877 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.877+0000 7f46ba000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b40cecf0 con 0x7f46b40d2ba0 2024-04-24T23:57:52.877 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.877+0000 7f46ba000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b40cefd0 con 0x7f46b40d1c90 2024-04-24T23:57:52.877 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.877+0000 7f46ba000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f46b40ceac0 con 0x7f46b415e1c0 2024-04-24T23:57:52.877 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.877+0000 7f46b9600640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f46b40d2ba0 0x7f46b40b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46448/0 (socket says 172.21.15.96:46448) 2024-04-24T23:57:52.877 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.877+0000 7f46b9600640 1 -- 172.21.15.96:0/4197678272 learned_addr learned my addr 172.21.15.96:0/4197678272 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:57:52.881 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.877+0000 7f46b8c00640 1 --2- 172.21.15.96:0/4197678272 >> v2:172.21.15.155:3300/0 conn(0x7f46b415e1c0 0x7f46b40d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:52.881 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.877+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186952861 0 0) 0x7f46b40cecf0 con 0x7f46b40d2ba0 2024-04-24T23:57:52.882 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.877+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4698003520 con 0x7f46b40d2ba0 2024-04-24T23:57:52.882 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3627254718 0 0) 0x7f4698003520 con 0x7f46b40d2ba0 2024-04-24T23:57:52.882 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 >> v2:172.21.15.155:3300/0 conn(0x7f46b415e1c0 msgr2=0x7f46b40d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:52.882 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 --2- 172.21.15.96:0/4197678272 >> v2:172.21.15.155:3300/0 conn(0x7f46b415e1c0 0x7f46b40d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:52.882 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 >> v1:172.21.15.155:6789/0 conn(0x7f46b40d1c90 legacy=0x7f46b40d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:52.882 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b40cf2b0 con 0x7f46b40d2ba0 2024-04-24T23:57:52.882 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f46ac0019f0 con 0x7f46b40d2ba0 2024-04-24T23:57:52.882 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 >> v1:172.21.15.96:6789/0 conn(0x7f46b40d2ba0 legacy=0x7f46b40b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:52.883 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f4698003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:52.883 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4698004800 0x7f4698004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:52.883 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980052e0 0x7f469800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:52.883 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f469800c180 con 0x7f46980039b0 2024-04-24T23:57:52.883 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f469800c330 con 0x7f46980052e0 2024-04-24T23:57:52.883 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f469800c530 con 0x7f4698004800 2024-04-24T23:57:52.883 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b8c00640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f4698003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:52.884 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b3e00640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4698004800 0x7f4698004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:52.884 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b8c00640 1 -- 172.21.15.96:0/4197678272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4698004800 msgr2=0x7f4698004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:52.884 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b8c00640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4698004800 0x7f4698004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:52.884 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b8c00640 1 -- 172.21.15.96:0/4197678272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980052e0 msgr2=0x7f469800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:57:52.884 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.878+0000 7f46b9600640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980052e0 0x7f469800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:52.884 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.879+0000 7f46b8c00640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980052e0 0x7f469800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:52.885 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.879+0000 7f46b8c00640 1 -- 172.21.15.96:0/4197678272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4698003520 con 0x7f46980039b0 2024-04-24T23:57:52.885 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.879+0000 7f46b9600640 1 -- 172.21.15.96:0/4197678272 reap_dead start 2024-04-24T23:57:52.885 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.879+0000 7f46b8c00640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f4698003dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46a400ba00 tx=0x7f4698005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82653311fa654a80 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:52.885 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4030070 con 0x7f46980039b0 2024-04-24T23:57:52.885 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a402adb0 con 0x7f46980039b0 2024-04-24T23:57:52.885 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46b3400640 1 -- 172.21.15.96:0/4197678272 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a400b600 con 0x7f46980039b0 2024-04-24T23:57:52.886 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46ba000640 1 -- 172.21.15.96:0/4197678272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 msgr2=0x7f4698003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:52.886 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46ba000640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f4698003dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46a400ba00 tx=0x7f4698005830 comp rx=0 tx=0).stop 2024-04-24T23:57:52.886 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46ba000640 1 -- 172.21.15.96:0/4197678272 shutdown_connections 2024-04-24T23:57:52.886 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46ba000640 1 --2- 172.21.15.96:0/4197678272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f4698003dd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:52.886 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46ba000640 1 -- 172.21.15.96:0/4197678272 >> 172.21.15.96:0/4197678272 conn(0x7f46b40d3eb0 msgr2=0x7f46b40d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:52.886 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46ba000640 1 -- 172.21.15.96:0/4197678272 shutdown_connections 2024-04-24T23:57:52.886 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.880+0000 7f46ba000640 1 -- 172.21.15.96:0/4197678272 wait complete. 2024-04-24T23:57:52.890 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.882+0000 7f46ba000640 1 Processor -- start 2024-04-24T23:57:52.890 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.882+0000 7f46ba000640 1 -- start start 2024-04-24T23:57:52.890 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.883+0000 7f46ba000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f46b414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:52.890 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.883+0000 7f46ba000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46b414e2c0 0x7f46b40cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:52.890 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.883+0000 7f46ba000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b40c92c0 0x7f46b414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.883+0000 7f46ba000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f46b40b3530 con 0x7f46980039b0 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.883+0000 7f46ba000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46b40d2230 con 0x7f46b40c92c0 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.883+0000 7f46ba000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46b415e5a0 con 0x7f46b414e2c0 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.883+0000 7f46b8c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f46b414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.883+0000 7f46b8c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f46b414ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35304/0 (socket says 172.21.15.96:35304) 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.883+0000 7f46b8c00640 1 -- 172.21.15.96:0/350531689 learned_addr learned my addr 172.21.15.96:0/350531689 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46b8c00640 1 -- 172.21.15.96:0/350531689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46b414e2c0 msgr2=0x7f46b40cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46b8c00640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46b414e2c0 0x7f46b40cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46b8c00640 1 -- 172.21.15.96:0/350531689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b40c92c0 msgr2=0x7f46b414d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46b8c00640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b40c92c0 0x7f46b414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46b8c00640 1 -- 172.21.15.96:0/350531689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b40b9600 con 0x7f46980039b0 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46b8c00640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f46b414ae70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46a400bb20 tx=0x7f46a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:52.891 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46b0c00640 1 -- 172.21.15.96:0/350531689 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4043020 con 0x7f46980039b0 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46b0c00640 1 -- 172.21.15.96:0/350531689 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a403f680 con 0x7f46980039b0 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46b0c00640 1 -- 172.21.15.96:0/350531689 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a400b600 con 0x7f46980039b0 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b40b98e0 con 0x7f46980039b0 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.884+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b40c8da0 con 0x7f46980039b0 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.886+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b40686c0 con 0x7f46980039b0 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.886+0000 7f46b0c00640 1 -- 172.21.15.96:0/350531689 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f46a4046020 con 0x7f46980039b0 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.887+0000 7f46b0c00640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f469406bda0 0x7f469406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.887+0000 7f46b0c00640 1 -- 172.21.15.96:0/350531689 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f46a40aa860 con 0x7f46980039b0 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.887+0000 7f46b3e00640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f469406bda0 0x7f469406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:57:52.892 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.888+0000 7f46b3e00640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f469406bda0 0x7f469406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46a0007fd0 tx=0x7f46a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:57:52.893 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:52.892+0000 7f46b0c00640 1 -- 172.21.15.96:0/350531689 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f46a404d070 con 0x7f46980039b0 2024-04-24T23:57:53.075 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.075+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46b40b9db0 con 0x7f46980039b0 2024-04-24T23:57:53.076 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.076+0000 7f46b0c00640 1 -- 172.21.15.96:0/350531689 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f46b40b9db0 con 0x7f46980039b0 2024-04-24T23:57:53.077 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-24T23:57:53.077 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":12,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:57:50.321449+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:57:53.079 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f469406bda0 msgr2=0x7f469406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:53.080 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f469406bda0 0x7f469406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46a0007fd0 tx=0x7f46a0009040 comp rx=0 tx=0).stop 2024-04-24T23:57:53.080 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 msgr2=0x7f46b414ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:57:53.080 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f46b414ae70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46a400bb20 tx=0x7f46a4004730 comp rx=0 tx=0).stop 2024-04-24T23:57:53.080 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 shutdown_connections 2024-04-24T23:57:53.080 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46b40c92c0 0x7f46b414d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:53.080 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46b414e2c0 0x7f46b40cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:53.081 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f469406bda0 0x7f469406e260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:53.081 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 --2- 172.21.15.96:0/350531689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980039b0 0x7f46b414ae70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:57:53.081 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 >> 172.21.15.96:0/350531689 conn(0x7f46b40d3eb0 msgr2=0x7f46b415eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:57:53.081 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 shutdown_connections 2024-04-24T23:57:53.081 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:57:53.079+0000 7f46ba000640 1 -- 172.21.15.96:0/350531689 wait complete. 2024-04-24T23:57:53.093 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-24T23:57:56.762 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:57:56.770 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:57:59.900 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:00.085 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.085+0000 7f904f600640 1 Processor -- start 2024-04-24T23:58:00.086 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.085+0000 7f904f600640 1 -- start start 2024-04-24T23:58:00.087 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.087+0000 7f904f600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9048156630 0x7f90480725d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.087 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.087+0000 7f904f600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904815d790 con 0x7f9048072b10 2024-04-24T23:58:00.087 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.087+0000 7f904f600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904815c890 con 0x7f90480cdcf0 2024-04-24T23:58:00.087 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.087+0000 7f904f600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f904815d1c0 con 0x7f9048156630 2024-04-24T23:58:00.087 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.087+0000 7f9047e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9048072b10 0x7f90480cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45536/0 (socket says 172.21.15.96:45536) 2024-04-24T23:58:00.087 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.087+0000 7f9047e00640 1 -- 172.21.15.96:0/1020312924 learned_addr learned my addr 172.21.15.96:0/1020312924 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:00.089 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f904cc00640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9048156630 0x7f90480725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973465374 0 0) 0x7f904815d790 con 0x7f9048072b10 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f902c003520 con 0x7f9048072b10 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1941373197 0 0) 0x7f902c003520 con 0x7f9048072b10 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9048156630 msgr2=0x7f90480725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9048156630 0x7f90480725d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 >> v1:172.21.15.155:6789/0 conn(0x7f90480cdcf0 legacy=0x7f9048070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904815cb70 con 0x7f9048072b10 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f9034001670 con 0x7f9048072b10 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 >> v1:172.21.15.96:6789/0 conn(0x7f9048072b10 legacy=0x7f90480cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f902c0039e0 0x7f902c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c004800 0x7f902c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.088+0000 7f9047400640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9048156630 0x7f902c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.090 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f904815d1c0 con 0x7f902c004800 2024-04-24T23:58:00.091 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f902c00baa0 con 0x7f902c0039e0 2024-04-24T23:58:00.091 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f902c00bca0 con 0x7f9048156630 2024-04-24T23:58:00.091 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f9047e00640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c004800 0x7f902c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.091 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f904cc00640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f902c0039e0 0x7f902c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.091 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f9047e00640 1 -- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9048156630 msgr2=0x7f902c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:00.091 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f9047e00640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9048156630 0x7f902c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.091 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f9047e00640 1 -- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f902c0039e0 msgr2=0x7f902c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:00.091 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f9047e00640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f902c0039e0 0x7f902c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.091 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.089+0000 7f9047e00640 1 -- 172.21.15.96:0/1020312924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c003520 con 0x7f902c004800 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.090+0000 7f9047e00640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c004800 0x7f902c004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f903400c160 tx=0x7f902c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3604c79a0fc1366 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.090+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034007c60 con 0x7f902c004800 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.090+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9034005ad0 con 0x7f902c004800 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.090+0000 7f9047400640 1 -- 172.21.15.96:0/1020312924 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034007070 con 0x7f902c004800 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.091+0000 7f904f600640 1 -- 172.21.15.96:0/1020312924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c004800 msgr2=0x7f902c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.091+0000 7f904f600640 1 --2- 172.21.15.96:0/1020312924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c004800 0x7f902c004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f903400c160 tx=0x7f902c005830 comp rx=0 tx=0).stop 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.091+0000 7f904d600640 1 -- 172.21.15.96:0/1020312924 reap_dead start 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.091+0000 7f904f600640 1 -- 172.21.15.96:0/1020312924 shutdown_connections 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.091+0000 7f904f600640 1 -- 172.21.15.96:0/1020312924 >> 172.21.15.96:0/1020312924 conn(0x7f904806e2b0 msgr2=0x7f904806e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.091+0000 7f904f600640 1 -- 172.21.15.96:0/1020312924 shutdown_connections 2024-04-24T23:58:00.093 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.091+0000 7f904f600640 1 -- 172.21.15.96:0/1020312924 wait complete. 2024-04-24T23:58:00.094 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.094+0000 7f904f600640 1 Processor -- start 2024-04-24T23:58:00.094 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.094+0000 7f904f600640 1 -- start start 2024-04-24T23:58:00.096 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.095+0000 7f904f600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c004800 0x7f9048148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.096 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.095+0000 7f904f600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90480b39f0 0x7f90480b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.096 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.095+0000 7f904f600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f904814c6f0 0x7f904814cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.096 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.095+0000 7f904f600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f90480725d0 con 0x7f904814c6f0 2024-04-24T23:58:00.096 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.095+0000 7f904f600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9048156a10 con 0x7f90480b39f0 2024-04-24T23:58:00.096 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.095+0000 7f904f600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9048072750 con 0x7f902c004800 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.095+0000 7f904d600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f904814c6f0 0x7f904814cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.095+0000 7f904d600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f904814c6f0 0x7f904814cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40622/0 (socket says 172.21.15.96:40622) 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.095+0000 7f904d600640 1 -- 172.21.15.96:0/4081829213 learned_addr learned my addr 172.21.15.96:0/4081829213 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f9047e00640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90480b39f0 0x7f90480b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f904d600640 1 -- 172.21.15.96:0/4081829213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c004800 msgr2=0x7f9048148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f904cc00640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c004800 0x7f9048148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f904d600640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c004800 0x7f9048148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f904d600640 1 -- 172.21.15.96:0/4081829213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90480b39f0 msgr2=0x7f90480b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f904d600640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90480b39f0 0x7f90480b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f904d600640 1 -- 172.21.15.96:0/4081829213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90480b4470 con 0x7f904814c6f0 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f9047e00640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90480b39f0 0x7f90480b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f904d600640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f904814c6f0 0x7f904814cb70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f904000c390 tx=0x7f904000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f9044c00640 1 -- 172.21.15.96:0/4081829213 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040007520 con 0x7f904814c6f0 2024-04-24T23:58:00.097 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f9044c00640 1 -- 172.21.15.96:0/4081829213 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9040004020 con 0x7f904814c6f0 2024-04-24T23:58:00.098 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f9044c00640 1 -- 172.21.15.96:0/4081829213 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040004410 con 0x7f904814c6f0 2024-04-24T23:58:00.098 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90480b4750 con 0x7f904814c6f0 2024-04-24T23:58:00.098 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.096+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904814a340 con 0x7f904814c6f0 2024-04-24T23:58:00.098 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.097+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9048075490 con 0x7f904814c6f0 2024-04-24T23:58:00.098 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.098+0000 7f9044c00640 1 -- 172.21.15.96:0/4081829213 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9040011070 con 0x7f904814c6f0 2024-04-24T23:58:00.100 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.100+0000 7f9044c00640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f902806be30 0x7f902806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.100 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.100+0000 7f9044c00640 1 -- 172.21.15.96:0/4081829213 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9040089930 con 0x7f904814c6f0 2024-04-24T23:58:00.100 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.100+0000 7f904cc00640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f902806be30 0x7f902806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.100 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.101+0000 7f904cc00640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f902806be30 0x7f902806e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f90480ccb00 tx=0x7f903800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:00.105 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.105+0000 7f9044c00640 1 -- 172.21.15.96:0/4081829213 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f904001a030 con 0x7f904814c6f0 2024-04-24T23:58:00.302 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.302+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f904814a510 con 0x7f904814c6f0 2024-04-24T23:58:00.303 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.304+0000 7f9044c00640 1 -- 172.21.15.96:0/4081829213 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7f9040058620 con 0x7f904814c6f0 2024-04-24T23:58:00.304 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-24T23:58:00.304 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":16,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:57:56.646194+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:00.307 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.306+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f902806be30 msgr2=0x7f902806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.307 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.306+0000 7f904f600640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f902806be30 0x7f902806e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f90480ccb00 tx=0x7f903800b040 comp rx=0 tx=0).stop 2024-04-24T23:58:00.307 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.306+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f904814c6f0 msgr2=0x7f904814cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.307 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.306+0000 7f904f600640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f904814c6f0 0x7f904814cb70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f904000c390 tx=0x7f904000c850 comp rx=0 tx=0).stop 2024-04-24T23:58:00.307 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.307+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 shutdown_connections 2024-04-24T23:58:00.307 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.307+0000 7f904f600640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f902806be30 0x7f902806e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.307 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.307+0000 7f904f600640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f904814c6f0 0x7f904814cb70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.307 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.307+0000 7f904f600640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90480b39f0 0x7f90480b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.308 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.307+0000 7f904f600640 1 --2- 172.21.15.96:0/4081829213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c004800 0x7f9048148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.308 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.307+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 >> 172.21.15.96:0/4081829213 conn(0x7f904806e2b0 msgr2=0x7f904815af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:00.308 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.307+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 shutdown_connections 2024-04-24T23:58:00.308 INFO:teuthology.misc.health.smithi096.stderr:2024-04-24T23:58:00.307+0000 7f904f600640 1 -- 172.21.15.96:0/4081829213 wait complete. 2024-04-24T23:58:00.322 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-24T23:58:00.322 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T23:58:00.322 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T23:58:00.323 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T23:58:00.327 INFO:tasks.ceph.mds.a:Started 2024-04-24T23:58:00.327 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-24T23:58:00.327 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-24T23:58:00.332 INFO:tasks.ceph.mds.c:Started 2024-04-24T23:58:00.332 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T23:58:00.332 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T23:58:00.340 INFO:tasks.ceph.mds.b:Started 2024-04-24T23:58:00.340 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-24T23:58:00.340 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-24T23:58:00.348 INFO:tasks.ceph.mds.d:Started 2024-04-24T23:58:00.348 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-24T23:58:00.349 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:00.473 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-04-24T23:58:00.473 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-04-24T23:58:00.500 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-04-24T23:58:00.500 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-04-24T23:58:00.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.527+0000 7fe0ea200640 1 Processor -- start 2024-04-24T23:58:00.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.527+0000 7fe0ea200640 1 -- start start 2024-04-24T23:58:00.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.528+0000 7fe0ea200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0e40af120 0x7fe0e4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.528+0000 7fe0ea200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e40acda0 0x7fe0e406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.528+0000 7fe0ea200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e4160b20 con 0x7fe0e415c230 2024-04-24T23:58:00.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.528+0000 7fe0ea200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e415c610 con 0x7fe0e40af120 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.528+0000 7fe0ea200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e40ad230 con 0x7fe0e40acda0 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.528+0000 7fe0e2a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0e40af120 0x7fe0e4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e2a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0e40af120 0x7fe0e4071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40664/0 (socket says 172.21.15.96:40664) 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e2a00640 1 -- 172.21.15.96:0/941195023 learned_addr learned my addr 172.21.15.96:0/941195023 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e3400640 1 --1- 172.21.15.96:0/941195023 >> v1:172.21.15.96:6789/0 conn(0x7fe0e415c230 0x7fe0e40aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45538/0 (socket says 172.21.15.96:45538) 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e3e00640 1 --2- 172.21.15.96:0/941195023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e40acda0 0x7fe0e406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e2a00640 1 -- 172.21.15.96:0/941195023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e40acda0 msgr2=0x7fe0e406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e2a00640 1 --2- 172.21.15.96:0/941195023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e40acda0 0x7fe0e406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e2a00640 1 -- 172.21.15.96:0/941195023 >> v1:172.21.15.96:6789/0 conn(0x7fe0e415c230 legacy=0x7fe0e40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e2000640 1 -- 172.21.15.96:0/941195023 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607030934 0 0) 0x7fe0e4160b20 con 0x7fe0e415c230 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e2a00640 1 -- 172.21.15.96:0/941195023 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e415fd60 con 0x7fe0e40af120 2024-04-24T23:58:00.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.529+0000 7fe0e3e00640 1 --2- 172.21.15.96:0/941195023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e40acda0 0x7fe0e406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:00.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.530+0000 7fe0e2a00640 1 --2- 172.21.15.96:0/941195023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 0x7fe0e4071800 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009870 tx=0x7fe0d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df129414fd33445 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.530+0000 7fe0e2000640 1 -- 172.21.15.96:0/941195023 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0037070 con 0x7fe0e40af120 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.530+0000 7fe0e2000640 1 -- 172.21.15.96:0/941195023 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d0032440 con 0x7fe0e40af120 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.530+0000 7fe0e2000640 1 -- 172.21.15.96:0/941195023 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0032810 con 0x7fe0e40af120 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.531+0000 7fe0ea200640 1 -- 172.21.15.96:0/941195023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 msgr2=0x7fe0e4071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.531+0000 7fe0ea200640 1 --2- 172.21.15.96:0/941195023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 0x7fe0e4071800 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009870 tx=0x7fe0d002a270 comp rx=0 tx=0).stop 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.531+0000 7fe0ea200640 1 -- 172.21.15.96:0/941195023 shutdown_connections 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.531+0000 7fe0ea200640 1 --2- 172.21.15.96:0/941195023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e40acda0 0x7fe0e406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.531+0000 7fe0ea200640 1 --2- 172.21.15.96:0/941195023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 0x7fe0e4071800 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.531+0000 7fe0ea200640 1 -- 172.21.15.96:0/941195023 >> 172.21.15.96:0/941195023 conn(0x7fe0e40b19c0 msgr2=0x7fe0e40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.531+0000 7fe0ea200640 1 -- 172.21.15.96:0/941195023 shutdown_connections 2024-04-24T23:58:00.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.531+0000 7fe0ea200640 1 -- 172.21.15.96:0/941195023 wait complete. 2024-04-24T23:58:00.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.533+0000 7fe0ea200640 1 Processor -- start 2024-04-24T23:58:00.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.533+0000 7fe0ea200640 1 -- start start 2024-04-24T23:58:00.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0ea200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e40acda0 0x7fe0e41f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0ea200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 0x7fe0e4153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0ea200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e415c230 0x7fe0e41515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0ea200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4160600 con 0x7fe0e40af120 2024-04-24T23:58:00.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0ea200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4160320 con 0x7fe0e40acda0 2024-04-24T23:58:00.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0ea200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e40ad4d0 con 0x7fe0e415c230 2024-04-24T23:58:00.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0e2a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 0x7fe0e4153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0e2a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 0x7fe0e4153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40670/0 (socket says 172.21.15.96:40670) 2024-04-24T23:58:00.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0e2a00640 1 -- 172.21.15.96:0/3420887400 learned_addr learned my addr 172.21.15.96:0/3420887400 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0e3400640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e40acda0 0x7fe0e41f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0e3e00640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e415c230 0x7fe0e41515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.534+0000 7fe0e2a00640 1 -- 172.21.15.96:0/3420887400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e415c230 msgr2=0x7fe0e41515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0e2a00640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e415c230 0x7fe0e41515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0e2a00640 1 -- 172.21.15.96:0/3420887400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e40acda0 msgr2=0x7fe0e41f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0e2a00640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e40acda0 0x7fe0e41f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0e2a00640 1 -- 172.21.15.96:0/3420887400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e4143020 con 0x7fe0e40af120 2024-04-24T23:58:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0e3400640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e40acda0 0x7fe0e41f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0e2a00640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 0x7fe0e4153b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0d002a2b0 tx=0x7fe0d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:00.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0db400640 1 -- 172.21.15.96:0/3420887400 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0037040 con 0x7fe0e40af120 2024-04-24T23:58:00.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0db400640 1 -- 172.21.15.96:0/3420887400 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d0042070 con 0x7fe0e40af120 2024-04-24T23:58:00.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e41424a0 con 0x7fe0e40af120 2024-04-24T23:58:00.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0db400640 1 -- 172.21.15.96:0/3420887400 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0030bd0 con 0x7fe0e40af120 2024-04-24T23:58:00.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.535+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e4142a60 con 0x7fe0e40af120 2024-04-24T23:58:00.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.537+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e4069110 con 0x7fe0e40af120 2024-04-24T23:58:00.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.538+0000 7fe0db400640 1 -- 172.21.15.96:0/3420887400 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0d0047460 con 0x7fe0e40af120 2024-04-24T23:58:00.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.539+0000 7fe0db400640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0c406be30 0x7fe0c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.539+0000 7fe0db400640 1 -- 172.21.15.96:0/3420887400 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe0d00ab790 con 0x7fe0e40af120 2024-04-24T23:58:00.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.540+0000 7fe0e3400640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0c406be30 0x7fe0c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.540+0000 7fe0e3400640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0c406be30 0x7fe0c406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000f60 tx=0x7fe0d4007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:00.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.544+0000 7fe0db400640 1 -- 172.21.15.96:0/3420887400 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe0d0045360 con 0x7fe0e40af120 2024-04-24T23:58:00.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.742+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0e4074880 con 0x7fe0e40af120 2024-04-24T23:58:00.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.744+0000 7fe0db400640 1 -- 172.21.15.96:0/3420887400 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7fe0d007a3f0 con 0x7fe0e40af120 2024-04-24T23:58:00.744 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:00.744 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:57:56.646194+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:00.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0c406be30 msgr2=0x7fe0c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0c406be30 0x7fe0c406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000f60 tx=0x7fe0d4007ca0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 msgr2=0x7fe0e4153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 0x7fe0e4153b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0d002a2b0 tx=0x7fe0d00046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 shutdown_connections 2024-04-24T23:58:00.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0e415c230 0x7fe0e41515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0c406be30 0x7fe0c406e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40af120 0x7fe0e4153b90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 --2- 172.21.15.96:0/3420887400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e40acda0 0x7fe0e41f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 >> 172.21.15.96:0/3420887400 conn(0x7fe0e40b19c0 msgr2=0x7fe0e415a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:00.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 shutdown_connections 2024-04-24T23:58:00.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.747+0000 7fe0ea200640 1 -- 172.21.15.96:0/3420887400 wait complete. 2024-04-24T23:58:00.765 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:00.765 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:00.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.959+0000 7f9476600640 1 Processor -- start 2024-04-24T23:58:00.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.959+0000 7f9476600640 1 -- start start 2024-04-24T23:58:00.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.961+0000 7f9476600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f947015f2b0 0x7f947006ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.961+0000 7f9476600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9470071700 con 0x7f947006d930 2024-04-24T23:58:00.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.961+0000 7f9476600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94700719e0 con 0x7f94700b4630 2024-04-24T23:58:00.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.961+0000 7f9476600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9470071cc0 con 0x7f947015f2b0 2024-04-24T23:58:00.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.961+0000 7f9475200640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f947006d930 0x7f9470070eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45542/0 (socket says 172.21.15.96:45542) 2024-04-24T23:58:00.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.961+0000 7f9475200640 1 -- 172.21.15.96:0/2109025731 learned_addr learned my addr 172.21.15.96:0/2109025731 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:00.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.961+0000 7f9467e00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f947015f2b0 0x7f947006ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.961+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610703801 0 0) 0x7f9470071700 con 0x7f947006d930 2024-04-24T23:58:00.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.961+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9454003520 con 0x7f947006d930 2024-04-24T23:58:00.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 94909366 0 0) 0x7f9454003520 con 0x7f947006d930 2024-04-24T23:58:00.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f947015f2b0 msgr2=0x7f947006ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:00.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f947015f2b0 0x7f947006ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 >> v1:172.21.15.155:6789/0 conn(0x7f94700b4630 legacy=0x7f94700b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94700b3230 con 0x7f947006d930 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f9460001670 con 0x7f947006d930 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 >> v1:172.21.15.96:6789/0 conn(0x7f947006d930 legacy=0x7f9470070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540039e0 0x7f9454003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f947015f2b0 0x7f9454004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9454004d40 0x7f94540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9470071cc0 con 0x7f9454004d40 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f945400bb30 con 0x7f94540039e0 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f945400bd30 con 0x7f947015f2b0 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.962+0000 7f9475c00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9454004d40 0x7f94540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.963+0000 7f9475200640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540039e0 0x7f9454003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.963+0000 7f9467e00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f947015f2b0 0x7f9454004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.963+0000 7f9475c00640 1 -- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f947015f2b0 msgr2=0x7f9454004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.963+0000 7f9475c00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f947015f2b0 0x7f9454004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.963+0000 7f9475c00640 1 -- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540039e0 msgr2=0x7f9454003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:00.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.963+0000 7f9475c00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94540039e0 0x7f9454003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.963+0000 7f9475c00640 1 -- 172.21.15.96:0/2109025731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9454003520 con 0x7f9454004d40 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.964+0000 7f9475c00640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9454004d40 0x7f94540051c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9468001e20 tx=0x7f9454005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b320c8c30e38964c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.964+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468001a70 con 0x7f9454004d40 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.964+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946802ae40 con 0x7f9454004d40 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.964+0000 7f946fe00640 1 -- 172.21.15.96:0/2109025731 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468003bb0 con 0x7f9454004d40 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.964+0000 7f9476600640 1 -- 172.21.15.96:0/2109025731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9454004d40 msgr2=0x7f94540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.964+0000 7f9476600640 1 --2- 172.21.15.96:0/2109025731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9454004d40 0x7f94540051c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9468001e20 tx=0x7f9454005830 comp rx=0 tx=0).stop 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.964+0000 7f9475c00640 1 -- 172.21.15.96:0/2109025731 reap_dead start 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.965+0000 7f9476600640 1 -- 172.21.15.96:0/2109025731 shutdown_connections 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.965+0000 7f9476600640 1 -- 172.21.15.96:0/2109025731 >> 172.21.15.96:0/2109025731 conn(0x7f94700b18b0 msgr2=0x7f94700b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.965+0000 7f9476600640 1 -- 172.21.15.96:0/2109025731 shutdown_connections 2024-04-24T23:58:00.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.965+0000 7f9476600640 1 -- 172.21.15.96:0/2109025731 wait complete. 2024-04-24T23:58:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.966+0000 7f9476600640 1 Processor -- start 2024-04-24T23:58:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.967+0000 7f9476600640 1 -- start start 2024-04-24T23:58:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.967+0000 7f9476600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9454004d40 0x7f94701f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.967+0000 7f9476600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700c7f60 0x7f94700c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9476600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9470160820 0x7f9470160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9476600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f94700b2f40 con 0x7f94700c7f60 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9476600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94700b2dc0 con 0x7f9470160820 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9476600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94700b3e60 con 0x7f9454004d40 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9467e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700c7f60 0x7f94700c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9467e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700c7f60 0x7f94700c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40686/0 (socket says 172.21.15.96:40686) 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9467e00640 1 -- 172.21.15.96:0/931615463 learned_addr learned my addr 172.21.15.96:0/931615463 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9475200640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9454004d40 0x7f94701f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9475c00640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9470160820 0x7f9470160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9467e00640 1 -- 172.21.15.96:0/931615463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9454004d40 msgr2=0x7f94701f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9467e00640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9454004d40 0x7f94701f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9467e00640 1 -- 172.21.15.96:0/931615463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9470160820 msgr2=0x7f9470160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9467e00640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9470160820 0x7f9470160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:00.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9467e00640 1 -- 172.21.15.96:0/931615463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947014c580 con 0x7f94700c7f60 2024-04-24T23:58:00.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.968+0000 7f9475c00640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9470160820 0x7f9470160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:00.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.969+0000 7f9467e00640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700c7f60 0x7f94700c83e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9458011630 tx=0x7f9458011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:00.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.969+0000 7f946d600640 1 -- 172.21.15.96:0/931615463 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945800f920 con 0x7f94700c7f60 2024-04-24T23:58:00.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.969+0000 7f946d600640 1 -- 172.21.15.96:0/931615463 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f945800fac0 con 0x7f94700c7f60 2024-04-24T23:58:00.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.969+0000 7f946d600640 1 -- 172.21.15.96:0/931615463 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945800fe70 con 0x7f94700c7f60 2024-04-24T23:58:00.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.969+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f947014c860 con 0x7f94700c7f60 2024-04-24T23:58:00.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.969+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f947014ce20 con 0x7f94700c7f60 2024-04-24T23:58:00.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.970+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94700755d0 con 0x7f94700c7f60 2024-04-24T23:58:00.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.971+0000 7f946d600640 1 -- 172.21.15.96:0/931615463 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9458015460 con 0x7f94700c7f60 2024-04-24T23:58:00.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.972+0000 7f946d600640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f944c06be60 0x7f944c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:00.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.972+0000 7f946d600640 1 -- 172.21.15.96:0/931615463 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f945808b5c0 con 0x7f94700c7f60 2024-04-24T23:58:00.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.972+0000 7f9475200640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f944c06be60 0x7f944c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:00.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.973+0000 7f9475200640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f944c06be60 0x7f944c06e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9460001cc0 tx=0x7f9460009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:00.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:00.977+0000 7f946d600640 1 -- 172.21.15.96:0/931615463 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9458019030 con 0x7f94700c7f60 2024-04-24T23:58:01.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.176+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f947015b300 con 0x7f94700c7f60 2024-04-24T23:58:01.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.177+0000 7f946d600640 1 -- 172.21.15.96:0/931615463 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f945805a220 con 0x7f94700c7f60 2024-04-24T23:58:01.179 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:01.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f944c06be60 msgr2=0x7f944c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f944c06be60 0x7f944c06e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9460001cc0 tx=0x7f9460009040 comp rx=0 tx=0).stop 2024-04-24T23:58:01.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700c7f60 msgr2=0x7f94700c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700c7f60 0x7f94700c83e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9458011630 tx=0x7f9458011af0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 shutdown_connections 2024-04-24T23:58:01.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9470160820 0x7f9470160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f944c06be60 0x7f944c06e320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700c7f60 0x7f94700c83e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 --2- 172.21.15.96:0/931615463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9454004d40 0x7f94701f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 >> 172.21.15.96:0/931615463 conn(0x7f94700b18b0 msgr2=0x7f94700b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:01.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 shutdown_connections 2024-04-24T23:58:01.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.180+0000 7f9476600640 1 -- 172.21.15.96:0/931615463 wait complete. 2024-04-24T23:58:01.200 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:58:01.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.400+0000 7ff101400640 1 Processor -- start 2024-04-24T23:58:01.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.400+0000 7ff101400640 1 -- start start 2024-04-24T23:58:01.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.402+0000 7ff101400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff0fc0b3cd0 0x7ff0fc165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.402+0000 7ff101400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0fc15fa90 con 0x7ff0fc15b220 2024-04-24T23:58:01.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.402+0000 7ff101400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0fc0713d0 con 0x7ff0fc070df0 2024-04-24T23:58:01.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.402+0000 7ff101400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff0fc0aee00 con 0x7ff0fc0b3cd0 2024-04-24T23:58:01.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.402+0000 7ff0fa800640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff0fc15b220 0x7ff0fc15ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45552/0 (socket says 172.21.15.96:45552) 2024-04-24T23:58:01.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.402+0000 7ff0fa800640 1 -- 172.21.15.96:0/1459009561 learned_addr learned my addr 172.21.15.96:0/1459009561 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:01.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.402+0000 7ff0fb200640 1 --2- 172.21.15.96:0/1459009561 >> v2:172.21.15.96:3300/0 conn(0x7ff0fc0b3cd0 0x7ff0fc165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:01.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.402+0000 7ff0f9400640 1 -- 172.21.15.96:0/1459009561 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125366529 0 0) 0x7ff0fc15fa90 con 0x7ff0fc15b220 2024-04-24T23:58:01.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.403+0000 7ff0f9400640 1 -- 172.21.15.96:0/1459009561 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0e0003520 con 0x7ff0fc15b220 2024-04-24T23:58:01.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.403+0000 7ff0fb200640 1 -- 172.21.15.96:0/1459009561 >> v1:172.21.15.155:6789/0 conn(0x7ff0fc070df0 legacy=0x7ff0fc15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:01.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.403+0000 7ff0fb200640 1 -- 172.21.15.96:0/1459009561 >> v1:172.21.15.96:6789/0 conn(0x7ff0fc15b220 legacy=0x7ff0fc15ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.403+0000 7ff0fb200640 1 -- 172.21.15.96:0/1459009561 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0fc0ae4d0 con 0x7ff0fc0b3cd0 2024-04-24T23:58:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.404+0000 7ff0fb200640 1 --2- 172.21.15.96:0/1459009561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc0b3cd0 0x7ff0fc165fa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009d90 tx=0x7ff0f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df536c6dbe9d175d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.404+0000 7ff0f9400640 1 -- 172.21.15.96:0/1459009561 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4007740 con 0x7ff0fc0b3cd0 2024-04-24T23:58:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.404+0000 7ff0f9400640 1 -- 172.21.15.96:0/1459009561 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f40078e0 con 0x7ff0fc0b3cd0 2024-04-24T23:58:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.404+0000 7ff0f9400640 1 -- 172.21.15.96:0/1459009561 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4007cb0 con 0x7ff0fc0b3cd0 2024-04-24T23:58:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.404+0000 7ff101400640 1 -- 172.21.15.96:0/1459009561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc0b3cd0 msgr2=0x7ff0fc165fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.404+0000 7ff101400640 1 --2- 172.21.15.96:0/1459009561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc0b3cd0 0x7ff0fc165fa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009d90 tx=0x7ff0f402a6a0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.405+0000 7ff101400640 1 -- 172.21.15.96:0/1459009561 shutdown_connections 2024-04-24T23:58:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.405+0000 7ff101400640 1 --2- 172.21.15.96:0/1459009561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc0b3cd0 0x7ff0fc165fa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.405+0000 7ff101400640 1 -- 172.21.15.96:0/1459009561 >> 172.21.15.96:0/1459009561 conn(0x7ff0fc0b19c0 msgr2=0x7ff0fc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:01.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.405+0000 7ff101400640 1 -- 172.21.15.96:0/1459009561 shutdown_connections 2024-04-24T23:58:01.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.405+0000 7ff101400640 1 -- 172.21.15.96:0/1459009561 wait complete. 2024-04-24T23:58:01.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.406+0000 7ff101400640 1 Processor -- start 2024-04-24T23:58:01.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.407+0000 7ff101400640 1 -- start start 2024-04-24T23:58:01.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.407+0000 7ff101400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc070df0 0x7ff0fc153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff101400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0fc0b3cd0 0x7ff0fc1e7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff101400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0fc15b220 0x7ff0fc1e84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff101400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc06eb90 con 0x7ff0fc070df0 2024-04-24T23:58:01.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff101400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc0aea90 con 0x7ff0fc15b220 2024-04-24T23:58:01.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff101400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0fc06ed10 con 0x7ff0fc0b3cd0 2024-04-24T23:58:01.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fa800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc070df0 0x7ff0fc153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:01.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fa800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc070df0 0x7ff0fc153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40706/0 (socket says 172.21.15.96:40706) 2024-04-24T23:58:01.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fa800640 1 -- 172.21.15.96:0/3585081502 learned_addr learned my addr 172.21.15.96:0/3585081502 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fb200640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0fc15b220 0x7ff0fc1e84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fa800640 1 -- 172.21.15.96:0/3585081502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0fc0b3cd0 msgr2=0x7ff0fc1e7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fa800640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0fc0b3cd0 0x7ff0fc1e7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fa800640 1 -- 172.21.15.96:0/3585081502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0fc15b220 msgr2=0x7ff0fc1e84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fa800640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0fc15b220 0x7ff0fc1e84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fa800640 1 -- 172.21.15.96:0/3585081502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0fc1544c0 con 0x7ff0fc070df0 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.408+0000 7ff0fa800640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc070df0 0x7ff0fc153f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c390 tx=0x7ff0ec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.409+0000 7ff0f2a00640 1 -- 172.21.15.96:0/3585081502 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec017070 con 0x7ff0fc070df0 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.409+0000 7ff0f2a00640 1 -- 172.21.15.96:0/3585081502 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec005ce0 con 0x7ff0fc070df0 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.409+0000 7ff0f2a00640 1 -- 172.21.15.96:0/3585081502 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0072f0 con 0x7ff0fc070df0 2024-04-24T23:58:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.409+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0fc1f8a90 con 0x7ff0fc070df0 2024-04-24T23:58:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.409+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0fc146910 con 0x7ff0fc070df0 2024-04-24T23:58:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.410+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0fc0b2800 con 0x7ff0fc070df0 2024-04-24T23:58:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.411+0000 7ff0f2a00640 1 -- 172.21.15.96:0/3585081502 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0ec01a070 con 0x7ff0fc070df0 2024-04-24T23:58:01.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.412+0000 7ff0f2a00640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0d806be30 0x7ff0d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.412+0000 7ff0f2a00640 1 -- 172.21.15.96:0/3585081502 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff0ec089f60 con 0x7ff0fc070df0 2024-04-24T23:58:01.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.412+0000 7ff0f9e00640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0d806be30 0x7ff0d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:01.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.413+0000 7ff0f9e00640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0d806be30 0x7ff0d806e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc1f8ed0 tx=0x7ff0e40079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:01.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.417+0000 7ff0f2a00640 1 -- 172.21.15.96:0/3585081502 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff0fc0b2800 con 0x7ff0fc070df0 2024-04-24T23:58:01.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.653+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0fc146440 con 0x7ff0fc070df0 2024-04-24T23:58:01.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.654+0000 7ff0f2a00640 1 -- 172.21.15.96:0/3585081502 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7ff0ec058c50 con 0x7ff0fc070df0 2024-04-24T23:58:01.654 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:01.655 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1694444006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1694444006},{"type":"v1","addr":"172.21.15.96:6837","nonce":1694444006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3646872561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6833","nonce":3646872561},{"type":"v1","addr":"172.21.15.155:6835","nonce":3646872561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/227257747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":227257747},{"type":"v1","addr":"172.21.15.96:6836","nonce":227257747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/1986626476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1986626476},{"type":"v1","addr":"172.21.15.155:6834","nonce":1986626476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-24T23:58:01.655 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 3 2024-04-24T23:58:01.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0d806be30 msgr2=0x7ff0d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0d806be30 0x7ff0d806e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc1f8ed0 tx=0x7ff0e40079b0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc070df0 msgr2=0x7ff0fc153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc070df0 0x7ff0fc153f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c390 tx=0x7ff0ec00c850 comp rx=0 tx=0).stop 2024-04-24T23:58:01.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 shutdown_connections 2024-04-24T23:58:01.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0fc15b220 0x7ff0fc1e84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0fc0b3cd0 0x7ff0fc1e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0d806be30 0x7ff0d806e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 --2- 172.21.15.96:0/3585081502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0fc070df0 0x7ff0fc153f80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 >> 172.21.15.96:0/3585081502 conn(0x7ff0fc0b19c0 msgr2=0x7ff0fc0b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:01.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 shutdown_connections 2024-04-24T23:58:01.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.657+0000 7ff101400640 1 -- 172.21.15.96:0/3585081502 wait complete. 2024-04-24T23:58:01.675 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:01.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.867+0000 7f17cde00640 1 Processor -- start 2024-04-24T23:58:01.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.867+0000 7f17cde00640 1 -- start start 2024-04-24T23:58:01.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.869+0000 7f17cde00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f17c8070df0 0x7f17c815f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.869+0000 7f17cde00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c80713d0 con 0x7f17c80b2cc0 2024-04-24T23:58:01.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.869+0000 7f17cde00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c80ae4d0 con 0x7f17c815b220 2024-04-24T23:58:01.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.869+0000 7f17cde00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f17c80aee00 con 0x7f17c8070df0 2024-04-24T23:58:01.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.869+0000 7f17c6000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f17c8070df0 0x7f17c815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:01.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.869+0000 7f17c6000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f17c8070df0 0x7f17c815f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40708/0 (socket says 172.21.15.96:40708) 2024-04-24T23:58:01.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.869+0000 7f17c7400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f17c80b2cc0 0x7f17c80b3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45568/0 (socket says 172.21.15.96:45568) 2024-04-24T23:58:01.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.869+0000 7f17c6000640 1 -- 172.21.15.96:0/4101956276 learned_addr learned my addr 172.21.15.96:0/4101956276 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:01.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.870+0000 7f17c6000640 1 -- 172.21.15.96:0/4101956276 >> v1:172.21.15.155:6789/0 conn(0x7f17c815b220 legacy=0x7f17c815ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:01.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.870+0000 7f17c6000640 1 -- 172.21.15.96:0/4101956276 >> v1:172.21.15.96:6789/0 conn(0x7f17c80b2cc0 legacy=0x7f17c80b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.870+0000 7f17c6000640 1 -- 172.21.15.96:0/4101956276 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c80ae7b0 con 0x7f17c8070df0 2024-04-24T23:58:01.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.871+0000 7f17c6000640 1 --2- 172.21.15.96:0/4101956276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 0x7f17c815f380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009870 tx=0x7f17b402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02e0bcafd5c122e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:01.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.871+0000 7f17c5600640 1 -- 172.21.15.96:0/4101956276 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4037070 con 0x7f17c8070df0 2024-04-24T23:58:01.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.871+0000 7f17c5600640 1 -- 172.21.15.96:0/4101956276 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b4032440 con 0x7f17c8070df0 2024-04-24T23:58:01.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.871+0000 7f17c5600640 1 -- 172.21.15.96:0/4101956276 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4032810 con 0x7f17c8070df0 2024-04-24T23:58:01.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.871+0000 7f17cde00640 1 -- 172.21.15.96:0/4101956276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 msgr2=0x7f17c815f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.871+0000 7f17cde00640 1 --2- 172.21.15.96:0/4101956276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 0x7f17c815f380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009870 tx=0x7f17b402a2a0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.872+0000 7f17cde00640 1 -- 172.21.15.96:0/4101956276 shutdown_connections 2024-04-24T23:58:01.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.872+0000 7f17cde00640 1 --2- 172.21.15.96:0/4101956276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 0x7f17c815f380 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.872+0000 7f17cde00640 1 -- 172.21.15.96:0/4101956276 >> 172.21.15.96:0/4101956276 conn(0x7f17c80b19c0 msgr2=0x7f17c80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:01.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.872+0000 7f17cde00640 1 -- 172.21.15.96:0/4101956276 shutdown_connections 2024-04-24T23:58:01.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.872+0000 7f17cde00640 1 -- 172.21.15.96:0/4101956276 wait complete. 2024-04-24T23:58:01.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.873+0000 7f17cde00640 1 Processor -- start 2024-04-24T23:58:01.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.873+0000 7f17cde00640 1 -- start start 2024-04-24T23:58:01.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.874+0000 7f17cde00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 0x7f17c814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.874+0000 7f17cde00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17c80b2cc0 0x7f17c8154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.874+0000 7f17cde00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17c815b220 0x7f17c809bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.874+0000 7f17cde00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f17c806ed10 con 0x7f17c8070df0 2024-04-24T23:58:01.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.874+0000 7f17cde00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17c806eb90 con 0x7f17c80b2cc0 2024-04-24T23:58:01.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.874+0000 7f17cde00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f17c815f8c0 con 0x7f17c815b220 2024-04-24T23:58:01.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.874+0000 7f17c6a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 0x7f17c814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17c6a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 0x7f17c814f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40724/0 (socket says 172.21.15.96:40724) 2024-04-24T23:58:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17c6a00640 1 -- 172.21.15.96:0/2626026360 learned_addr learned my addr 172.21.15.96:0/2626026360 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17c6a00640 1 -- 172.21.15.96:0/2626026360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17c815b220 msgr2=0x7f17c809bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17c6a00640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17c815b220 0x7f17c809bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17c6a00640 1 -- 172.21.15.96:0/2626026360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17c80b2cc0 msgr2=0x7f17c8154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17c6000640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17c80b2cc0 0x7f17c8154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17c6a00640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17c80b2cc0 0x7f17c8154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17c6a00640 1 -- 172.21.15.96:0/2626026360 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c809ae20 con 0x7f17c8070df0 2024-04-24T23:58:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17c6a00640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 0x7f17c814f9e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17b800b3f0 tx=0x7f17b800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:01.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.875+0000 7f17bf400640 1 -- 172.21.15.96:0/2626026360 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8015020 con 0x7f17c8070df0 2024-04-24T23:58:01.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.876+0000 7f17bf400640 1 -- 172.21.15.96:0/2626026360 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b8011830 con 0x7f17c8070df0 2024-04-24T23:58:01.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.876+0000 7f17bf400640 1 -- 172.21.15.96:0/2626026360 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8011c20 con 0x7f17c8070df0 2024-04-24T23:58:01.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.876+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c809b100 con 0x7f17c8070df0 2024-04-24T23:58:01.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.876+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c809b6c0 con 0x7f17c8070df0 2024-04-24T23:58:01.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.877+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c8069110 con 0x7f17c8070df0 2024-04-24T23:58:01.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.878+0000 7f17bf400640 1 -- 172.21.15.96:0/2626026360 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17b8018020 con 0x7f17c8070df0 2024-04-24T23:58:01.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.879+0000 7f17bf400640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f17a806be30 0x7f17a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:01.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.879+0000 7f17bf400640 1 -- 172.21.15.96:0/2626026360 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f17b808a6c0 con 0x7f17c8070df0 2024-04-24T23:58:01.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.879+0000 7f17c6000640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f17a806be30 0x7f17a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:01.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.880+0000 7f17c6000640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f17a806be30 0x7f17a806e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f17b4034000 tx=0x7f17b402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:01.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:01.883+0000 7f17bf400640 1 -- 172.21.15.96:0/2626026360 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f17b801f030 con 0x7f17c8070df0 2024-04-24T23:58:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.086+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17c806e610 con 0x7f17c8070df0 2024-04-24T23:58:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.087+0000 7f17bf400640 1 -- 172.21.15.96:0/2626026360 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7f17b8059450 con 0x7f17c8070df0 2024-04-24T23:58:02.087 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:02.087 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:57:56.646194+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:02.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f17a806be30 msgr2=0x7f17a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f17a806be30 0x7f17a806e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f17b4034000 tx=0x7f17b402e000 comp rx=0 tx=0).stop 2024-04-24T23:58:02.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 msgr2=0x7f17c814f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 0x7f17c814f9e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17b800b3f0 tx=0x7f17b800b8b0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 shutdown_connections 2024-04-24T23:58:02.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17c815b220 0x7f17c809bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17c80b2cc0 0x7f17c8154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f17a806be30 0x7f17a806e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 --2- 172.21.15.96:0/2626026360 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17c8070df0 0x7f17c814f9e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 >> 172.21.15.96:0/2626026360 conn(0x7f17c80b19c0 msgr2=0x7f17c815a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:02.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 shutdown_connections 2024-04-24T23:58:02.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.090+0000 7f17cde00640 1 -- 172.21.15.96:0/2626026360 wait complete. 2024-04-24T23:58:02.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:02.109 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:02.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.313+0000 7fb1dfa00640 1 Processor -- start 2024-04-24T23:58:02.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.313+0000 7fb1dfa00640 1 -- start start 2024-04-24T23:58:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.315+0000 7fb1dfa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1d8156620 0x7fb1d815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.315+0000 7fb1dfa00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d806d100 con 0x7fb1d80ae8e0 2024-04-24T23:58:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.315+0000 7fb1dfa00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d80acda0 con 0x7fb1d806edf0 2024-04-24T23:58:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.315+0000 7fb1dfa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d80ad060 con 0x7fb1d8156620 2024-04-24T23:58:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.315+0000 7fb1dda00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb1d80ae8e0 0x7fb1d80aed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45576/0 (socket says 172.21.15.96:45576) 2024-04-24T23:58:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.315+0000 7fb1dda00640 1 -- 172.21.15.96:0/599745461 learned_addr learned my addr 172.21.15.96:0/599745461 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:02.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1dd000640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1d8156620 0x7fb1d815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393494474 0 0) 0x7fb1d806d100 con 0x7fb1d80ae8e0 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1bc003520 con 0x7fb1d80ae8e0 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1253508515 0 0) 0x7fb1bc003520 con 0x7fb1d80ae8e0 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1d8156620 msgr2=0x7fb1d815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1d8156620 0x7fb1d815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 >> v1:172.21.15.155:6789/0 conn(0x7fb1d806edf0 legacy=0x7fb1d806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d806d3a0 con 0x7fb1d80ae8e0 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fb1d00019f0 con 0x7fb1d80ae8e0 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 >> v1:172.21.15.96:6789/0 conn(0x7fb1d80ae8e0 legacy=0x7fb1d80aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1bc004800 0x7fb1bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1bc005210 0x7fb1bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80ad060 con 0x7fb1bc0039e0 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc00c110 con 0x7fb1bc005210 2024-04-24T23:58:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb1bc00c310 con 0x7fb1bc004800 2024-04-24T23:58:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.316+0000 7fb1dd000640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1d8156620 0x7fb1d815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.317+0000 7fb1dd000640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.317+0000 7fb1dda00640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1bc005210 0x7fb1bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.317+0000 7fb1dd000640 1 -- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1bc004800 msgr2=0x7fb1bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.317+0000 7fb1dd000640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1bc004800 0x7fb1bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.317+0000 7fb1dd000640 1 -- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1bc005210 msgr2=0x7fb1bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.317+0000 7fb1dd000640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1bc005210 0x7fb1bc00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.317+0000 7fb1dd000640 1 -- 172.21.15.96:0/599745461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc003520 con 0x7fb1bc0039e0 2024-04-24T23:58:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.318+0000 7fb1dd000640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1bc003e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8006fd0 tx=0x7fb1bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05f96b865c5c388 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.318+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8037070 con 0x7fb1bc0039e0 2024-04-24T23:58:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.318+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c802aae0 con 0x7fb1bc0039e0 2024-04-24T23:58:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.318+0000 7fb1d7e00640 1 -- 172.21.15.96:0/599745461 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800f040 con 0x7fb1bc0039e0 2024-04-24T23:58:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.319+0000 7fb1dfa00640 1 -- 172.21.15.96:0/599745461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 msgr2=0x7fb1bc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.319+0000 7fb1dfa00640 1 --2- 172.21.15.96:0/599745461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1bc003e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8006fd0 tx=0x7fb1bc005830 comp rx=0 tx=0).stop 2024-04-24T23:58:02.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.319+0000 7fb1dda00640 1 -- 172.21.15.96:0/599745461 reap_dead start 2024-04-24T23:58:02.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.319+0000 7fb1dfa00640 1 -- 172.21.15.96:0/599745461 shutdown_connections 2024-04-24T23:58:02.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.319+0000 7fb1dfa00640 1 -- 172.21.15.96:0/599745461 >> 172.21.15.96:0/599745461 conn(0x7fb1d80b19c0 msgr2=0x7fb1d80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:02.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.319+0000 7fb1dfa00640 1 -- 172.21.15.96:0/599745461 shutdown_connections 2024-04-24T23:58:02.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.319+0000 7fb1dfa00640 1 -- 172.21.15.96:0/599745461 wait complete. 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.321+0000 7fb1dfa00640 1 Processor -- start 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.321+0000 7fb1dfa00640 1 -- start start 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.322+0000 7fb1dfa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1d8150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.322+0000 7fb1dfa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d8156a00 0x7fb1d8154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.322+0000 7fb1dfa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1d80b2dc0 0x7fb1d8154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.322+0000 7fb1dfa00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80ad4c0 con 0x7fb1bc0039e0 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.322+0000 7fb1dfa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80ad340 con 0x7fb1d8156a00 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.322+0000 7fb1dfa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d815cf70 con 0x7fb1d80b2dc0 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.322+0000 7fb1dd000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1d8150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.322+0000 7fb1dd000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1d8150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40744/0 (socket says 172.21.15.96:40744) 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.322+0000 7fb1dd000640 1 -- 172.21.15.96:0/3255342820 learned_addr learned my addr 172.21.15.96:0/3255342820 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1dd000640 1 -- 172.21.15.96:0/3255342820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1d80b2dc0 msgr2=0x7fb1d8154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1dd000640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1d80b2dc0 0x7fb1d8154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1dd000640 1 -- 172.21.15.96:0/3255342820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d8156a00 msgr2=0x7fb1d8154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1dd000640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d8156a00 0x7fb1d8154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1dd000640 1 -- 172.21.15.96:0/3255342820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d81513b0 con 0x7fb1bc0039e0 2024-04-24T23:58:02.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1dd000640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1d8150e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1c802a5d0 tx=0x7fb1c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:02.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1d5600640 1 -- 172.21.15.96:0/3255342820 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8040020 con 0x7fb1bc0039e0 2024-04-24T23:58:02.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1d5600640 1 -- 172.21.15.96:0/3255342820 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c8038040 con 0x7fb1bc0039e0 2024-04-24T23:58:02.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1d5600640 1 -- 172.21.15.96:0/3255342820 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8037070 con 0x7fb1bc0039e0 2024-04-24T23:58:02.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d8156f00 con 0x7fb1bc0039e0 2024-04-24T23:58:02.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.323+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d81574c0 con 0x7fb1bc0039e0 2024-04-24T23:58:02.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.324+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d8069110 con 0x7fb1bc0039e0 2024-04-24T23:58:02.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.325+0000 7fb1d5600640 1 -- 172.21.15.96:0/3255342820 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1c8043020 con 0x7fb1bc0039e0 2024-04-24T23:58:02.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.327+0000 7fb1d5600640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb1b406be60 0x7fb1b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.327+0000 7fb1d5600640 1 -- 172.21.15.96:0/3255342820 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb1c80aada0 con 0x7fb1bc0039e0 2024-04-24T23:58:02.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.327+0000 7fb1cfe00640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb1b406be60 0x7fb1b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.327+0000 7fb1cfe00640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb1b406be60 0x7fb1b406e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80b4080 tx=0x7fb1c0007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:02.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.331+0000 7fb1d5600640 1 -- 172.21.15.96:0/3255342820 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb1c804a020 con 0x7fb1bc0039e0 2024-04-24T23:58:02.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.524+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb1d80b0b90 con 0x7fb1bc0039e0 2024-04-24T23:58:02.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.525+0000 7fb1d5600640 1 -- 172.21.15.96:0/3255342820 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fb1c8079a90 con 0x7fb1bc0039e0 2024-04-24T23:58:02.525 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:02.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.527+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb1b406be60 msgr2=0x7fb1b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.527+0000 7fb1dfa00640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb1b406be60 0x7fb1b406e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80b4080 tx=0x7fb1c0007990 comp rx=0 tx=0).stop 2024-04-24T23:58:02.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.527+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 msgr2=0x7fb1d8150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.527+0000 7fb1dfa00640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1d8150e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1c802a5d0 tx=0x7fb1c8004730 comp rx=0 tx=0).stop 2024-04-24T23:58:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.528+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 shutdown_connections 2024-04-24T23:58:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.528+0000 7fb1dfa00640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1d80b2dc0 0x7fb1d8154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.528+0000 7fb1dfa00640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d8156a00 0x7fb1d8154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.528+0000 7fb1dfa00640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb1b406be60 0x7fb1b406e320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.528+0000 7fb1dfa00640 1 --2- 172.21.15.96:0/3255342820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1bc0039e0 0x7fb1d8150e70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.528+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 >> 172.21.15.96:0/3255342820 conn(0x7fb1d80b19c0 msgr2=0x7fb1d815c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.528+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 shutdown_connections 2024-04-24T23:58:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.528+0000 7fb1dfa00640 1 -- 172.21.15.96:0/3255342820 wait complete. 2024-04-24T23:58:02.545 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T23:58:02.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.725+0000 7f1a3a000640 1 Processor -- start 2024-04-24T23:58:02.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.725+0000 7f1a3a000640 1 -- start start 2024-04-24T23:58:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.726+0000 7f1a3a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415b220 0x7f1a34070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.727+0000 7f1a3a000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a340713d0 con 0x7f1a3415f800 2024-04-24T23:58:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.727+0000 7f1a3a000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a340ae4d0 con 0x7f1a3415ec70 2024-04-24T23:58:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.727+0000 7f1a3a000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1a340aee00 con 0x7f1a3415b220 2024-04-24T23:58:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.727+0000 7f1a33e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1a3415f800 0x7f1a340b2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45588/0 (socket says 172.21.15.96:45588) 2024-04-24T23:58:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.727+0000 7f1a33e00640 1 -- 172.21.15.96:0/3585280998 learned_addr learned my addr 172.21.15.96:0/3585280998 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.727+0000 7f1a33400640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415b220 0x7f1a34070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.727+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492548002 0 0) 0x7f1a340713d0 con 0x7f1a3415f800 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.727+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a18003520 con 0x7f1a3415f800 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2067038709 0 0) 0x7f1a18003520 con 0x7f1a3415f800 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415b220 msgr2=0x7f1a34070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415b220 0x7f1a34070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 >> v1:172.21.15.155:6789/0 conn(0x7f1a3415ec70 legacy=0x7f1a3415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a340ae7b0 con 0x7f1a3415f800 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f1a2c0019f0 con 0x7f1a3415f800 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 >> v1:172.21.15.96:6789/0 conn(0x7f1a3415f800 legacy=0x7f1a340b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a180039e0 0x7f1a18003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a18004800 0x7f1a18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415b220 0x7f1a180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1a340aee00 con 0x7f1a18004800 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1800ba70 con 0x7f1a180039e0 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1800de80 con 0x7f1a3415b220 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32a00640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a18004800 0x7f1a18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a33400640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a180039e0 0x7f1a18003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32a00640 1 -- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415b220 msgr2=0x7f1a180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32a00640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415b220 0x7f1a180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32a00640 1 -- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a180039e0 msgr2=0x7f1a18003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32a00640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a180039e0 0x7f1a18003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a32a00640 1 -- 172.21.15.96:0/3585280998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a18003520 con 0x7f1a18004800 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.728+0000 7f1a33400640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a180039e0 0x7f1a18003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.729+0000 7f1a32a00640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a18004800 0x7f1a18004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a20001720 tx=0x7f1a18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f936ffc62ecc54a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.730+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20001370 con 0x7f1a18004800 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.730+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a200052d0 con 0x7f1a18004800 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.730+0000 7f1a32000640 1 -- 172.21.15.96:0/3585280998 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2002ab90 con 0x7f1a18004800 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.730+0000 7f1a3a000640 1 -- 172.21.15.96:0/3585280998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a18004800 msgr2=0x7f1a18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.730+0000 7f1a3a000640 1 --2- 172.21.15.96:0/3585280998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a18004800 0x7f1a18004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a20001720 tx=0x7f1a18005830 comp rx=0 tx=0).stop 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.730+0000 7f1a33e00640 1 -- 172.21.15.96:0/3585280998 reap_dead start 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.730+0000 7f1a3a000640 1 -- 172.21.15.96:0/3585280998 shutdown_connections 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.730+0000 7f1a3a000640 1 -- 172.21.15.96:0/3585280998 >> 172.21.15.96:0/3585280998 conn(0x7f1a340b19c0 msgr2=0x7f1a340b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.730+0000 7f1a3a000640 1 -- 172.21.15.96:0/3585280998 shutdown_connections 2024-04-24T23:58:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.731+0000 7f1a3a000640 1 -- 172.21.15.96:0/3585280998 wait complete. 2024-04-24T23:58:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.732+0000 7f1a3a000640 1 Processor -- start 2024-04-24T23:58:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.732+0000 7f1a3a000640 1 -- start start 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.733+0000 7f1a3a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18004800 0x7f1a341f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.733+0000 7f1a3a000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a3415bfe0 0x7f1a3414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.733+0000 7f1a3a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415dae0 0x7f1a3415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.733+0000 7f1a3a000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3406ed10 con 0x7f1a3415bfe0 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.733+0000 7f1a3a000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3406eb90 con 0x7f1a18004800 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.733+0000 7f1a3a000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1a34070df0 con 0x7f1a3415dae0 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a32a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a3415bfe0 0x7f1a3414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a32a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a3415bfe0 0x7f1a3414d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40768/0 (socket says 172.21.15.96:40768) 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a32a00640 1 -- 172.21.15.96:0/782291842 learned_addr learned my addr 172.21.15.96:0/782291842 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a32a00640 1 -- 172.21.15.96:0/782291842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415dae0 msgr2=0x7f1a3415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a32a00640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415dae0 0x7f1a3415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a32a00640 1 -- 172.21.15.96:0/782291842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18004800 msgr2=0x7f1a341f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a33400640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18004800 0x7f1a341f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a32a00640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18004800 0x7f1a341f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a32a00640 1 -- 172.21.15.96:0/782291842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a341f5d10 con 0x7f1a3415bfe0 2024-04-24T23:58:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.734+0000 7f1a32a00640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a3415bfe0 0x7f1a3414d670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1a20001840 tx=0x7f1a20001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.735+0000 7f1a2b400640 1 -- 172.21.15.96:0/782291842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20037040 con 0x7f1a3415bfe0 2024-04-24T23:58:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.735+0000 7f1a2b400640 1 -- 172.21.15.96:0/782291842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a20005480 con 0x7f1a3415bfe0 2024-04-24T23:58:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.735+0000 7f1a2b400640 1 -- 172.21.15.96:0/782291842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20007a30 con 0x7f1a3415bfe0 2024-04-24T23:58:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.735+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3415b6a0 con 0x7f1a3415bfe0 2024-04-24T23:58:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.735+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3415bc60 con 0x7f1a3415bfe0 2024-04-24T23:58:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.736+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a34069110 con 0x7f1a3415bfe0 2024-04-24T23:58:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.737+0000 7f1a2b400640 1 -- 172.21.15.96:0/782291842 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a20044020 con 0x7f1a3415bfe0 2024-04-24T23:58:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.738+0000 7f1a2b400640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1a1406be30 0x7f1a1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.738+0000 7f1a2b400640 1 -- 172.21.15.96:0/782291842 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1a200aa780 con 0x7f1a3415bfe0 2024-04-24T23:58:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.738+0000 7f1a33400640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1a1406be30 0x7f1a1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:02.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.739+0000 7f1a33400640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1a1406be30 0x7f1a1406e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1a34158350 tx=0x7f1a24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:02.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.742+0000 7f1a2b400640 1 -- 172.21.15.96:0/782291842 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1a341f5d10 con 0x7f1a3415bfe0 2024-04-24T23:58:02.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.943+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1a3415a940 con 0x7f1a3415bfe0 2024-04-24T23:58:02.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.943+0000 7f1a2b400640 1 -- 172.21.15.96:0/782291842 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f1a20079480 con 0x7f1a3415bfe0 2024-04-24T23:58:02.944 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:02.944 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-04-24T23:58:02.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:58:02.944 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2024-04-24T23:58:02.944 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2024-04-24T23:58:02.944 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:58:02.944 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1a1406be30 msgr2=0x7f1a1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1a1406be30 0x7f1a1406e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1a34158350 tx=0x7f1a24008040 comp rx=0 tx=0).stop 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a3415bfe0 msgr2=0x7f1a3414d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a3415bfe0 0x7f1a3414d670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1a20001840 tx=0x7f1a20001120 comp rx=0 tx=0).stop 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 shutdown_connections 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a3415dae0 0x7f1a3415df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1a1406be30 0x7f1a1406e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a3415bfe0 0x7f1a3414d670 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 --2- 172.21.15.96:0/782291842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a18004800 0x7f1a341f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.946+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 >> 172.21.15.96:0/782291842 conn(0x7f1a340b19c0 msgr2=0x7f1a34071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.947+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 shutdown_connections 2024-04-24T23:58:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:02.947+0000 7f1a3a000640 1 -- 172.21.15.96:0/782291842 wait complete. 2024-04-24T23:58:02.965 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T23:58:02.965 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T23:58:03.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.166+0000 7ff5c6600640 1 Processor -- start 2024-04-24T23:58:03.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.167+0000 7ff5c6600640 1 -- start start 2024-04-24T23:58:03.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.168+0000 7ff5c6600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff5c015e2e0 0x7ff5c00d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.168+0000 7ff5c6600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c006cf80 0x7ff5c00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.168+0000 7ff5c6600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5c00cfff0 con 0x7ff5c006c1d0 2024-04-24T23:58:03.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.168+0000 7ff5c6600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff5c00cf590 con 0x7ff5c015e2e0 2024-04-24T23:58:03.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.168+0000 7ff5c6600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c015e6c0 con 0x7ff5c006cf80 2024-04-24T23:58:03.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bfe00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff5c006c1d0 0x7ff5c006c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45592/0 (socket says 172.21.15.96:45592) 2024-04-24T23:58:03.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bfe00640 1 -- 172.21.15.96:0/1918149671 learned_addr learned my addr 172.21.15.96:0/1918149671 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5c5200640 1 --2- 172.21.15.96:0/1918149671 >> v2:172.21.15.155:3300/0 conn(0x7ff5c015e2e0 0x7ff5c00d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5c5c00640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c006cf80 0x7ff5c00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659144712 0 0) 0x7ff5c00cfff0 con 0x7ff5c006c1d0 2024-04-24T23:58:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a0003520 con 0x7ff5c006c1d0 2024-04-24T23:58:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1097031780 0 0) 0x7ff5a0003520 con 0x7ff5c006c1d0 2024-04-24T23:58:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c006cf80 msgr2=0x7ff5c00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bf400640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c006cf80 0x7ff5c00cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 >> v2:172.21.15.155:3300/0 conn(0x7ff5c015e2e0 msgr2=0x7ff5c00d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bf400640 1 --2- 172.21.15.96:0/1918149671 >> v2:172.21.15.155:3300/0 conn(0x7ff5c015e2e0 0x7ff5c00d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c00d0290 con 0x7ff5c006c1d0 2024-04-24T23:58:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.169+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7ff5a80019f0 con 0x7ff5c006c1d0 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 >> v1:172.21.15.96:6789/0 conn(0x7ff5c006c1d0 legacy=0x7ff5c006c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5bf400640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5bf400640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c006cf80 0x7ff5a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5bf400640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0004d40 0x7ff5a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c00cf590 con 0x7ff5a00039b0 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c015e6c0 con 0x7ff5a0004d40 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a000b9c0 con 0x7ff5c006cf80 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5c5200640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5c5200640 1 -- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c006cf80 msgr2=0x7ff5a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5c5200640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c006cf80 0x7ff5a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5c5c00640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0004d40 0x7ff5a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5c5200640 1 -- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0004d40 msgr2=0x7ff5a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5c5200640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0004d40 0x7ff5a00051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.170+0000 7ff5c5200640 1 -- 172.21.15.96:0/1918149671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a0003520 con 0x7ff5a00039b0 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.171+0000 7ff5c5200640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5a0003dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009ac0 tx=0x7ff5a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792bc79c6dce8d46 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.171+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0036070 con 0x7ff5a00039b0 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.171+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b0031400 con 0x7ff5a00039b0 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.171+0000 7ff5bf400640 1 -- 172.21.15.96:0/1918149671 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0009690 con 0x7ff5a00039b0 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.172+0000 7ff5c6600640 1 -- 172.21.15.96:0/1918149671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 msgr2=0x7ff5a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.172+0000 7ff5c6600640 1 --2- 172.21.15.96:0/1918149671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5a0003dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009ac0 tx=0x7ff5a0005830 comp rx=0 tx=0).stop 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.172+0000 7ff5c5c00640 1 -- 172.21.15.96:0/1918149671 reap_dead start 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.172+0000 7ff5c6600640 1 -- 172.21.15.96:0/1918149671 shutdown_connections 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.172+0000 7ff5c6600640 1 -- 172.21.15.96:0/1918149671 >> 172.21.15.96:0/1918149671 conn(0x7ff5c00d1df0 msgr2=0x7ff5c00d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.172+0000 7ff5c6600640 1 -- 172.21.15.96:0/1918149671 shutdown_connections 2024-04-24T23:58:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.172+0000 7ff5c6600640 1 -- 172.21.15.96:0/1918149671 wait complete. 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.174+0000 7ff5c6600640 1 Processor -- start 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.174+0000 7ff5c6600640 1 -- start start 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.175+0000 7ff5c6600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5c01e69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.175+0000 7ff5c6600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c0155660 0x7ff5c00c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.175+0000 7ff5c6600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5c01f4bb0 0x7ff5c00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.175+0000 7ff5c6600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c00d0850 con 0x7ff5a00039b0 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.175+0000 7ff5c6600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c00d0bc0 con 0x7ff5c01f4bb0 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.175+0000 7ff5c6600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c00cf050 con 0x7ff5c0155660 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.175+0000 7ff5c5200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5c01e69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.175+0000 7ff5c5200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5c01e69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40782/0 (socket says 172.21.15.96:40782) 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.175+0000 7ff5c5200640 1 -- 172.21.15.96:0/1375721090 learned_addr learned my addr 172.21.15.96:0/1375721090 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5c5200640 1 -- 172.21.15.96:0/1375721090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c0155660 msgr2=0x7ff5c00c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5c5200640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c0155660 0x7ff5c00c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5c5200640 1 -- 172.21.15.96:0/1375721090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5c01f4bb0 msgr2=0x7ff5c00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5c5200640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5c01f4bb0 0x7ff5c00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5c5200640 1 -- 172.21.15.96:0/1375721090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c0155f60 con 0x7ff5a00039b0 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5c5200640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5c01e69d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009be0 tx=0x7ff5b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5bcc00640 1 -- 172.21.15.96:0/1375721090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0040020 con 0x7ff5a00039b0 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5bcc00640 1 -- 172.21.15.96:0/1375721090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b0003950 con 0x7ff5a00039b0 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5bcc00640 1 -- 172.21.15.96:0/1375721090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0036040 con 0x7ff5a00039b0 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.176+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c0156240 con 0x7ff5a00039b0 2024-04-24T23:58:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.177+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c0156800 con 0x7ff5a00039b0 2024-04-24T23:58:03.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.178+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c00756b0 con 0x7ff5a00039b0 2024-04-24T23:58:03.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.178+0000 7ff5bcc00640 1 -- 172.21.15.96:0/1375721090 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5b0043020 con 0x7ff5a00039b0 2024-04-24T23:58:03.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.179+0000 7ff5bcc00640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff59c06be60 0x7ff59c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.179+0000 7ff5bcc00640 1 -- 172.21.15.96:0/1375721090 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff5b00aab70 con 0x7ff5a00039b0 2024-04-24T23:58:03.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.180+0000 7ff5bfe00640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff59c06be60 0x7ff59c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.180+0000 7ff5bfe00640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff59c06be60 0x7ff59c06e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80012e0 tx=0x7ff5a8001fc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:03.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.184+0000 7ff5bcc00640 1 -- 172.21.15.96:0/1375721090 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff5b004a070 con 0x7ff5a00039b0 2024-04-24T23:58:03.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.372+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff5c0070dd0 con 0x7ff5a00039b0 2024-04-24T23:58:03.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.722+0000 7ff5bcc00640 1 -- 172.21.15.96:0/1375721090 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7ff5b0079860 con 0x7ff5a00039b0 2024-04-24T23:58:03.723 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2024-04-24T23:58:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff59c06be60 msgr2=0x7ff59c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff59c06be60 0x7ff59c06e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80012e0 tx=0x7ff5a8001fc0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 msgr2=0x7ff5c01e69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5c01e69d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009be0 tx=0x7ff5b0004730 comp rx=0 tx=0).stop 2024-04-24T23:58:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 shutdown_connections 2024-04-24T23:58:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5c01f4bb0 0x7ff5c00c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5c0155660 0x7ff5c00c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff59c06be60 0x7ff59c06e320 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80012e0 tx=0x7ff5a8001fc0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 --2- 172.21.15.96:0/1375721090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5a00039b0 0x7ff5c01e69d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.728+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 >> 172.21.15.96:0/1375721090 conn(0x7ff5c00d1df0 msgr2=0x7ff5c015e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:03.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.729+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 shutdown_connections 2024-04-24T23:58:03.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.729+0000 7ff5c6600640 1 -- 172.21.15.96:0/1375721090 wait complete. 2024-04-24T23:58:03.756 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T23:58:03.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.948+0000 7fd594a00640 1 Processor -- start 2024-04-24T23:58:03.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.948+0000 7fd594a00640 1 -- start start 2024-04-24T23:58:03.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.949+0000 7fd594a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd5900b2c50 0x7fd59015f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.949+0000 7fd594a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 0x7fd590071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd594a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59006ea10 con 0x7fd59015b1a0 2024-04-24T23:58:03.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd594a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd5900b30b0 con 0x7fd5900b2c50 2024-04-24T23:58:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd594a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5900cdc00 con 0x7fd590070d80 2024-04-24T23:58:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd585e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd5900b2c50 0x7fd59015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd585e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd5900b2c50 0x7fd59015f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40784/0 (socket says 172.21.15.96:40784) 2024-04-24T23:58:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd585e00640 1 -- 172.21.15.96:0/311599690 learned_addr learned my addr 172.21.15.96:0/311599690 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd58f200640 1 --2- 172.21.15.96:0/311599690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 0x7fd590071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd585e00640 1 -- 172.21.15.96:0/311599690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 msgr2=0x7fd590071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd585e00640 1 --2- 172.21.15.96:0/311599690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 0x7fd590071210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd585e00640 1 -- 172.21.15.96:0/311599690 >> v1:172.21.15.155:6789/0 conn(0x7fd59015b1a0 legacy=0x7fd59006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.950+0000 7fd585e00640 1 -- 172.21.15.96:0/311599690 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5900cde50 con 0x7fd5900b2c50 2024-04-24T23:58:03.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.951+0000 7fd585e00640 1 --2- 172.21.15.96:0/311599690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5900b2c50 0x7fd59015f700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd57800bb10 tx=0x7fd57802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14bc8974790e978 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:03.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.952+0000 7fd58de00640 1 -- 172.21.15.96:0/311599690 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578032790 con 0x7fd5900b2c50 2024-04-24T23:58:03.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.952+0000 7fd58de00640 1 -- 172.21.15.96:0/311599690 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd578038070 con 0x7fd5900b2c50 2024-04-24T23:58:03.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.952+0000 7fd58de00640 1 -- 172.21.15.96:0/311599690 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578032b50 con 0x7fd5900b2c50 2024-04-24T23:58:03.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.952+0000 7fd594a00640 1 -- 172.21.15.96:0/311599690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5900b2c50 msgr2=0x7fd59015f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.952+0000 7fd594a00640 1 --2- 172.21.15.96:0/311599690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5900b2c50 0x7fd59015f700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd57800bb10 tx=0x7fd57802c890 comp rx=0 tx=0).stop 2024-04-24T23:58:03.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.953+0000 7fd594a00640 1 -- 172.21.15.96:0/311599690 shutdown_connections 2024-04-24T23:58:03.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.953+0000 7fd594a00640 1 --2- 172.21.15.96:0/311599690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 0x7fd590071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.953+0000 7fd594a00640 1 --2- 172.21.15.96:0/311599690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5900b2c50 0x7fd59015f700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.953+0000 7fd594a00640 1 -- 172.21.15.96:0/311599690 >> 172.21.15.96:0/311599690 conn(0x7fd5900b1f80 msgr2=0x7fd5900cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:03.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.953+0000 7fd594a00640 1 -- 172.21.15.96:0/311599690 shutdown_connections 2024-04-24T23:58:03.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.953+0000 7fd594a00640 1 -- 172.21.15.96:0/311599690 wait complete. 2024-04-24T23:58:03.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.954+0000 7fd594a00640 1 Processor -- start 2024-04-24T23:58:03.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.954+0000 7fd594a00640 1 -- start start 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.955+0000 7fd594a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 0x7fd59014da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.955+0000 7fd594a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5900b2c50 0x7fd590152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.955+0000 7fd594a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59015b1a0 0x7fd590152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.955+0000 7fd594a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd5900ce930 con 0x7fd59015b1a0 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.955+0000 7fd594a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5900ce410 con 0x7fd5900b2c50 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.955+0000 7fd594a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5900ceab0 con 0x7fd590070d80 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.955+0000 7fd58f200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59015b1a0 0x7fd590152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58f200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59015b1a0 0x7fd590152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40798/0 (socket says 172.21.15.96:40798) 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58f200640 1 -- 172.21.15.96:0/768529800 learned_addr learned my addr 172.21.15.96:0/768529800 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58e800640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 0x7fd59014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58f200640 1 -- 172.21.15.96:0/768529800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 msgr2=0x7fd59014da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58f200640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 0x7fd59014da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58f200640 1 -- 172.21.15.96:0/768529800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5900b2c50 msgr2=0x7fd590152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58f200640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5900b2c50 0x7fd590152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58f200640 1 -- 172.21.15.96:0/768529800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5900cbbf0 con 0x7fd59015b1a0 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58e800640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 0x7fd59014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd58f200640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59015b1a0 0x7fd590152f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd588007e40 tx=0x7fd58800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd587400640 1 -- 172.21.15.96:0/768529800 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588014620 con 0x7fd59015b1a0 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd587400640 1 -- 172.21.15.96:0/768529800 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd588019070 con 0x7fd59015b1a0 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5900cb630 con 0x7fd59015b1a0 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.956+0000 7fd587400640 1 -- 172.21.15.96:0/768529800 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588014a20 con 0x7fd59015b1a0 2024-04-24T23:58:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.957+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd590155dc0 con 0x7fd59015b1a0 2024-04-24T23:58:03.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.958+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd590067e40 con 0x7fd59015b1a0 2024-04-24T23:58:03.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.959+0000 7fd587400640 1 -- 172.21.15.96:0/768529800 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd588014bc0 con 0x7fd59015b1a0 2024-04-24T23:58:03.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.960+0000 7fd587400640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd56c06be30 0x7fd56c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:03.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.960+0000 7fd587400640 1 -- 172.21.15.96:0/768529800 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fd58808b5b0 con 0x7fd59015b1a0 2024-04-24T23:58:03.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.960+0000 7fd58e800640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd56c06be30 0x7fd56c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:03.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.961+0000 7fd58e800640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd56c06be30 0x7fd56c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd580000f60 tx=0x7fd580009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:03.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:03.965+0000 7fd587400640 1 -- 172.21.15.96:0/768529800 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd58805a0a0 con 0x7fd59015b1a0 2024-04-24T23:58:04.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.163+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd5900756b0 con 0x7fd59015b1a0 2024-04-24T23:58:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.730+0000 7fd587400640 1 -- 172.21.15.96:0/768529800 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fd5880599a0 con 0x7fd59015b1a0 2024-04-24T23:58:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2024-04-24T23:58:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.733+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd56c06be30 msgr2=0x7fd56c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:04.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.733+0000 7fd594a00640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd56c06be30 0x7fd56c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd580000f60 tx=0x7fd580009040 comp rx=0 tx=0).stop 2024-04-24T23:58:04.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.733+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59015b1a0 msgr2=0x7fd590152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:04.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.733+0000 7fd594a00640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59015b1a0 0x7fd590152f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd588007e40 tx=0x7fd58800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.734+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 shutdown_connections 2024-04-24T23:58:04.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.734+0000 7fd594a00640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd56c06be30 0x7fd56c06e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.734+0000 7fd594a00640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59015b1a0 0x7fd590152f60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.734+0000 7fd594a00640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5900b2c50 0x7fd590152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.734+0000 7fd594a00640 1 --2- 172.21.15.96:0/768529800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd590070d80 0x7fd59014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.734+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 >> 172.21.15.96:0/768529800 conn(0x7fd5900b1f80 msgr2=0x7fd5900cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:04.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.734+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 shutdown_connections 2024-04-24T23:58:04.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.734+0000 7fd594a00640 1 -- 172.21.15.96:0/768529800 wait complete. 2024-04-24T23:58:04.768 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T23:58:04.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.945+0000 7f3fc3000640 1 Processor -- start 2024-04-24T23:58:04.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.946+0000 7f3fc3000640 1 -- start start 2024-04-24T23:58:04.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.947+0000 7f3fc3000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fbc0726d0 0x7f3fbc072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:04.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.947+0000 7f3fc3000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc15f750 con 0x7f3fbc06edb0 2024-04-24T23:58:04.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.947+0000 7f3fc3000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc15ef00 con 0x7f3fbc1551c0 2024-04-24T23:58:04.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.947+0000 7f3fc3000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fbc15f190 con 0x7f3fbc0726d0 2024-04-24T23:58:04.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.947+0000 7f3fb3400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3fbc06edb0 0x7f3fbc0b2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45606/0 (socket says 172.21.15.96:45606) 2024-04-24T23:58:04.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.947+0000 7f3fb3400640 1 -- 172.21.15.96:0/2026452475 learned_addr learned my addr 172.21.15.96:0/2026452475 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824816353 0 0) 0x7f3fbc15f750 con 0x7f3fbc06edb0 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa0003520 con 0x7f3fbc06edb0 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fc1000640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fbc0726d0 0x7f3fbc072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1729284160 0 0) 0x7f3fa0003520 con 0x7f3fbc06edb0 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fbc0726d0 msgr2=0x7f3fbc072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fbc0726d0 0x7f3fbc072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 >> v1:172.21.15.155:6789/0 conn(0x7f3fbc1551c0 legacy=0x7f3fbc15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc15f470 con 0x7f3fbc06edb0 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f3fa4001670 con 0x7f3fbc06edb0 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fc1000640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fbc0726d0 0x7f3fbc072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 >> v1:172.21.15.96:6789/0 conn(0x7f3fbc06edb0 legacy=0x7f3fbc0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:04.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.948+0000 7f3fbb400640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fa00039e0 0x7f3fa0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbb400640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fbc0726d0 0x7f3fa0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbb400640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa0004d40 0x7f3fa00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc15f190 con 0x7f3fa00039e0 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa000bb50 con 0x7f3fa0004d40 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa000bd50 con 0x7f3fbc0726d0 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbbe00640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fa00039e0 0x7f3fa0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fc1000640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa0004d40 0x7f3fa00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbbe00640 1 -- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fbc0726d0 msgr2=0x7f3fa0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbbe00640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fbc0726d0 0x7f3fa0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbbe00640 1 -- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa0004d40 msgr2=0x7f3fa00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbbe00640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa0004d40 0x7f3fa00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fbbe00640 1 -- 172.21.15.96:0/2026452475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa0003520 con 0x7f3fa00039e0 2024-04-24T23:58:04.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.949+0000 7f3fc1000640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa0004d40 0x7f3fa00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:04.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.950+0000 7f3fbbe00640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fa00039e0 0x7f3fa0003e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fac001750 tx=0x7f3fa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7429db46ff5076ec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac001370 con 0x7f3fa00039e0 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fac0052d0 con 0x7f3fa00039e0 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fbb400640 1 -- 172.21.15.96:0/2026452475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac02abe0 con 0x7f3fa00039e0 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fc3000640 1 -- 172.21.15.96:0/2026452475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fa00039e0 msgr2=0x7f3fa0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fc3000640 1 --2- 172.21.15.96:0/2026452475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fa00039e0 0x7f3fa0003e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fac001750 tx=0x7f3fa0005830 comp rx=0 tx=0).stop 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fc1000640 1 -- 172.21.15.96:0/2026452475 reap_dead start 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fc3000640 1 -- 172.21.15.96:0/2026452475 shutdown_connections 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fc3000640 1 -- 172.21.15.96:0/2026452475 >> 172.21.15.96:0/2026452475 conn(0x7f3fbc0b19c0 msgr2=0x7f3fbc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fc3000640 1 -- 172.21.15.96:0/2026452475 shutdown_connections 2024-04-24T23:58:04.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.951+0000 7f3fc3000640 1 -- 172.21.15.96:0/2026452475 wait complete. 2024-04-24T23:58:04.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.953+0000 7f3fc3000640 1 Processor -- start 2024-04-24T23:58:04.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.953+0000 7f3fc3000640 1 -- start start 2024-04-24T23:58:04.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.954+0000 7f3fc3000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa00039e0 0x7f3fbc14e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:04.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.954+0000 7f3fc3000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fbc09bfc0 0x7f3fbc153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:04.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.954+0000 7f3fc3000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fbc158e20 0x7f3fbc153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:04.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.954+0000 7f3fc3000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc0b33d0 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.954+0000 7f3fc3000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc071430 con 0x7f3fbc158e20 2024-04-24T23:58:04.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.954+0000 7f3fc3000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fbc1555a0 con 0x7f3fa00039e0 2024-04-24T23:58:04.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.954+0000 7f3fb3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fbc09bfc0 0x7f3fbc153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:04.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.954+0000 7f3fb3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fbc09bfc0 0x7f3fbc153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40802/0 (socket says 172.21.15.96:40802) 2024-04-24T23:58:04.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.954+0000 7f3fb3400640 1 -- 172.21.15.96:0/2139023124 learned_addr learned my addr 172.21.15.96:0/2139023124 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fb3400640 1 -- 172.21.15.96:0/2139023124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa00039e0 msgr2=0x7f3fbc14e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fb3400640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa00039e0 0x7f3fbc14e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fb3400640 1 -- 172.21.15.96:0/2139023124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fbc158e20 msgr2=0x7f3fbc153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fb3400640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fbc158e20 0x7f3fbc153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fb3400640 1 -- 172.21.15.96:0/2139023124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc1f76c0 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fb3400640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fbc09bfc0 0x7f3fbc153530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c730 tx=0x7f3fa400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fb8c00640 1 -- 172.21.15.96:0/2139023124 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4018070 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fb8c00640 1 -- 172.21.15.96:0/2139023124 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa40072d0 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fb8c00640 1 -- 172.21.15.96:0/2139023124 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa40047e0 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.955+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fbc1f79a0 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.956+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fbc1f7f60 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.957+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fbc069110 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.958+0000 7f3fb8c00640 1 -- 172.21.15.96:0/2139023124 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fa4004b90 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.959+0000 7f3fb8c00640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f9806be30 0x7f3f9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:04.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.959+0000 7f3fb8c00640 1 -- 172.21.15.96:0/2139023124 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f3fa408a4d0 con 0x7f3fbc09bfc0 2024-04-24T23:58:04.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.959+0000 7f3fbbe00640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f9806be30 0x7f3f9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:04.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.960+0000 7f3fbbe00640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f9806be30 0x7f3f9806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3fac032000 tx=0x7f3fac02c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:04.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:04.964+0000 7f3fb8c00640 1 -- 172.21.15.96:0/2139023124 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3fa4058e40 con 0x7f3fbc09bfc0 2024-04-24T23:58:05.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.203+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3fbc0b4e00 con 0x7f3fbc09bfc0 2024-04-24T23:58:05.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.751+0000 7f3fb8c00640 1 -- 172.21.15.96:0/2139023124 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f3fa4058740 con 0x7f3fbc09bfc0 2024-04-24T23:58:05.752 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 2 and data pool 3 2024-04-24T23:58:05.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f9806be30 msgr2=0x7f3f9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f9806be30 0x7f3f9806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3fac032000 tx=0x7f3fac02c000 comp rx=0 tx=0).stop 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fbc09bfc0 msgr2=0x7f3fbc153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fbc09bfc0 0x7f3fbc153530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c730 tx=0x7f3fa400cbf0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 shutdown_connections 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fbc158e20 0x7f3fbc153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f9806be30 0x7f3f9806e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fbc09bfc0 0x7f3fbc153530 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 --2- 172.21.15.96:0/2139023124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa00039e0 0x7f3fbc14e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.755+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 >> 172.21.15.96:0/2139023124 conn(0x7f3fbc0b19c0 msgr2=0x7f3fbc0afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.756+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 shutdown_connections 2024-04-24T23:58:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.756+0000 7f3fc3000640 1 -- 172.21.15.96:0/2139023124 wait complete. 2024-04-24T23:58:05.793 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:05.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.967+0000 7f4e42400640 1 Processor -- start 2024-04-24T23:58:05.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.967+0000 7f4e42400640 1 -- start start 2024-04-24T23:58:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.969+0000 7f4e42400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4e3c15c440 0x7f4e3c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.969+0000 7f4e42400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e3c06c620 0x7f4e3c0715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.969+0000 7f4e42400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e3c06f4c0 con 0x7f4e3c071b20 2024-04-24T23:58:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.969+0000 7f4e42400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4e3c0afe10 con 0x7f4e3c15c440 2024-04-24T23:58:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.969+0000 7f4e42400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3c0723c0 con 0x7f4e3c06c620 2024-04-24T23:58:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.969+0000 7f4e3be00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4e3c071b20 0x7f4e3c06b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45616/0 (socket says 172.21.15.96:45616) 2024-04-24T23:58:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.969+0000 7f4e3be00640 1 -- 172.21.15.96:0/3140059168 learned_addr learned my addr 172.21.15.96:0/3140059168 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:05.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3b400640 1 --2- 172.21.15.96:0/3140059168 >> v2:172.21.15.155:3300/0 conn(0x7f4e3c15c440 0x7f4e3c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:05.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3aa00640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e3c06c620 0x7f4e3c0715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:05.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011492988 0 0) 0x7f4e2c001110 con 0x7f4e3c071b20 2024-04-24T23:58:05.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e20003520 con 0x7f4e3c071b20 2024-04-24T23:58:05.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2828457754 0 0) 0x7f4e20003520 con 0x7f4e3c071b20 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e3c06c620 msgr2=0x7f4e3c0715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e3c06c620 0x7f4e3c0715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 >> v2:172.21.15.155:3300/0 conn(0x7f4e3c15c440 msgr2=0x7f4e3c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 --2- 172.21.15.96:0/3140059168 >> v2:172.21.15.155:3300/0 conn(0x7f4e3c15c440 0x7f4e3c0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3c0726a0 con 0x7f4e3c071b20 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f4e2c001840 con 0x7f4e3c071b20 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 >> v1:172.21.15.96:6789/0 conn(0x7f4e3c071b20 legacy=0x7f4e3c06b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e3c06c620 0x7f4e200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e20003f30 0x7f4e20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e20004d40 0x7f4e200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c0afe10 con 0x7f4e20004d40 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c0723c0 con 0x7f4e20003f30 2024-04-24T23:58:05.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2000b9c0 con 0x7f4e3c06c620 2024-04-24T23:58:05.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.970+0000 7f4e3be00640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e20004d40 0x7f4e200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:05.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.971+0000 7f4e3aa00640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e20003f30 0x7f4e20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:05.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.971+0000 7f4e3be00640 1 -- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e3c06c620 msgr2=0x7f4e200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:05.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.971+0000 7f4e3be00640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e3c06c620 0x7f4e200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.971+0000 7f4e3be00640 1 -- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e20003f30 msgr2=0x7f4e20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:05.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.971+0000 7f4e3be00640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e20003f30 0x7f4e20004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.971+0000 7f4e3be00640 1 -- 172.21.15.96:0/3140059168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e20003520 con 0x7f4e20004d40 2024-04-24T23:58:05.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.972+0000 7f4e3be00640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e20004d40 0x7f4e200051c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c3e0 tx=0x7f4e20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbdffbf7ecbac6f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:05.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.972+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c032020 con 0x7f4e20004d40 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.972+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c005af0 con 0x7f4e20004d40 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.972+0000 7f4e3a000640 1 -- 172.21.15.96:0/3140059168 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00c0e0 con 0x7f4e20004d40 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.973+0000 7f4e42400640 1 -- 172.21.15.96:0/3140059168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e20004d40 msgr2=0x7f4e200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.973+0000 7f4e42400640 1 --2- 172.21.15.96:0/3140059168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e20004d40 0x7f4e200051c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c3e0 tx=0x7f4e20005830 comp rx=0 tx=0).stop 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.973+0000 7f4e3be00640 1 -- 172.21.15.96:0/3140059168 reap_dead start 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.973+0000 7f4e42400640 1 -- 172.21.15.96:0/3140059168 shutdown_connections 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.973+0000 7f4e42400640 1 -- 172.21.15.96:0/3140059168 >> 172.21.15.96:0/3140059168 conn(0x7f4e3c0d04f0 msgr2=0x7f4e3c0d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.973+0000 7f4e42400640 1 -- 172.21.15.96:0/3140059168 shutdown_connections 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.973+0000 7f4e42400640 1 -- 172.21.15.96:0/3140059168 wait complete. 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.975+0000 7f4e42400640 1 Processor -- start 2024-04-24T23:58:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.975+0000 7f4e42400640 1 -- start start 2024-04-24T23:58:05.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e42400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20004d40 0x7f4e3c1538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:05.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e42400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e3c143f50 0x7f4e3c150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:05.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e42400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e3c15a070 0x7f4e3c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:05.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e42400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c0cf400 con 0x7f4e3c15a070 2024-04-24T23:58:05.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e42400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c06efa0 con 0x7f4e3c143f50 2024-04-24T23:58:05.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e42400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3c0cf580 con 0x7f4e20004d40 2024-04-24T23:58:05.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e3c15a070 0x7f4e3c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e3c15a070 0x7f4e3c15a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40812/0 (socket says 172.21.15.96:40812) 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3be00640 1 -- 172.21.15.96:0/1797223326 learned_addr learned my addr 172.21.15.96:0/1797223326 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3aa00640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e3c143f50 0x7f4e3c150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3be00640 1 -- 172.21.15.96:0/1797223326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20004d40 msgr2=0x7f4e3c1538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3b400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20004d40 0x7f4e3c1538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3be00640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20004d40 0x7f4e3c1538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3be00640 1 -- 172.21.15.96:0/1797223326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e3c143f50 msgr2=0x7f4e3c150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3be00640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e3c143f50 0x7f4e3c150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.976+0000 7f4e3be00640 1 -- 172.21.15.96:0/1797223326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3c153e90 con 0x7f4e3c15a070 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.977+0000 7f4e3be00640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e3c15a070 0x7f4e3c15a520 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c500 tx=0x7f4e3c072870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.977+0000 7f4e33400640 1 -- 172.21.15.96:0/1797223326 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c032030 con 0x7f4e3c15a070 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.977+0000 7f4e33400640 1 -- 172.21.15.96:0/1797223326 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c004e20 con 0x7f4e3c15a070 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.977+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3c1f58b0 con 0x7f4e3c15a070 2024-04-24T23:58:05.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.977+0000 7f4e33400640 1 -- 172.21.15.96:0/1797223326 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0072b0 con 0x7f4e3c15a070 2024-04-24T23:58:05.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.977+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3c1f5e70 con 0x7f4e3c15a070 2024-04-24T23:58:05.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.978+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e3c069110 con 0x7f4e3c15a070 2024-04-24T23:58:05.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.979+0000 7f4e33400640 1 -- 172.21.15.96:0/1797223326 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e2c035020 con 0x7f4e3c15a070 2024-04-24T23:58:05.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.981+0000 7f4e33400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4e1806be60 0x7f4e1806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:05.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.981+0000 7f4e33400640 1 -- 172.21.15.96:0/1797223326 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f4e2c0aa070 con 0x7f4e3c15a070 2024-04-24T23:58:05.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.981+0000 7f4e3b400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4e1806be60 0x7f4e1806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:05.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.982+0000 7f4e3b400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4e1806be60 0x7f4e1806e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e34004b30 tx=0x7f4e3400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:05.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:05.985+0000 7f4e33400640 1 -- 172.21.15.96:0/1797223326 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4e2c03d070 con 0x7f4e3c15a070 2024-04-24T23:58:06.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.186+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e3c1f6040 con 0x7f4e3c15a070 2024-04-24T23:58:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.189+0000 7f4e33400640 1 -- 172.21.15.96:0/1797223326 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16570 (secure 0 0 0) 0x7f4e3c06f4c0 con 0x7f4e3c15a070 2024-04-24T23:58:06.189 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:06.190 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":19,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:05.204714+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:06.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.191+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4e1806be60 msgr2=0x7f4e1806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.191+0000 7f4e42400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4e1806be60 0x7f4e1806e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e34004b30 tx=0x7f4e3400b040 comp rx=0 tx=0).stop 2024-04-24T23:58:06.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.191+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e3c15a070 msgr2=0x7f4e3c15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.191+0000 7f4e42400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e3c15a070 0x7f4e3c15a520 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c500 tx=0x7f4e3c072870 comp rx=0 tx=0).stop 2024-04-24T23:58:06.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.192+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 shutdown_connections 2024-04-24T23:58:06.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.192+0000 7f4e42400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4e1806be60 0x7f4e1806e320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.192+0000 7f4e42400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e3c15a070 0x7f4e3c15a520 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.192+0000 7f4e42400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e3c143f50 0x7f4e3c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.192+0000 7f4e42400640 1 --2- 172.21.15.96:0/1797223326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20004d40 0x7f4e3c1538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.192+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 >> 172.21.15.96:0/1797223326 conn(0x7f4e3c0d04f0 msgr2=0x7f4e3c0b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:06.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.192+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 shutdown_connections 2024-04-24T23:58:06.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.192+0000 7f4e42400640 1 -- 172.21.15.96:0/1797223326 wait complete. 2024-04-24T23:58:06.210 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.404+0000 7f9aeb200640 1 Processor -- start 2024-04-24T23:58:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.404+0000 7f9aeb200640 1 -- start start 2024-04-24T23:58:06.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.406+0000 7f9aeb200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9aec15f6b0 0x7f9aec0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.406+0000 7f9aeb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec0ccdf0 0x7f9aec070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.406+0000 7f9aeb200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aec15fa90 con 0x7f9aec0b4ec0 2024-04-24T23:58:06.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.406+0000 7f9aeb200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9aec0b4a30 con 0x7f9aec15f6b0 2024-04-24T23:58:06.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.406+0000 7f9aeb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9aec0b3e20 con 0x7f9aec0ccdf0 2024-04-24T23:58:06.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.406+0000 7f9ae3e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9aec0b4ec0 0x7f9aec0cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45630/0 (socket says 172.21.15.96:45630) 2024-04-24T23:58:06.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.406+0000 7f9ae3e00640 1 -- 172.21.15.96:0/241576715 learned_addr learned my addr 172.21.15.96:0/241576715 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.406+0000 7f9ae9e00640 1 --2- 172.21.15.96:0/241576715 >> v2:172.21.15.155:3300/0 conn(0x7f9aec15f6b0 0x7f9aec0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5763125 0 0) 0x7f9aec15fa90 con 0x7f9aec0b4ec0 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9aea800640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec0ccdf0 0x7f9aec070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad0003520 con 0x7f9aec0b4ec0 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2598249957 0 0) 0x7f9ad0003520 con 0x7f9aec0b4ec0 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec0ccdf0 msgr2=0x7f9aec070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec0ccdf0 0x7f9aec070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 >> v2:172.21.15.155:3300/0 conn(0x7f9aec15f6b0 msgr2=0x7f9aec0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 --2- 172.21.15.96:0/241576715 >> v2:172.21.15.155:3300/0 conn(0x7f9aec15f6b0 0x7f9aec0ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aec0b4100 con 0x7f9aec0b4ec0 2024-04-24T23:58:06.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f9ad4001670 con 0x7f9aec0b4ec0 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9e00640 1 --2- 172.21.15.96:0/241576715 >> v2:172.21.15.155:3300/0 conn(0x7f9aec15f6b0 0x7f9aec0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 >> v1:172.21.15.96:6789/0 conn(0x7f9aec0b4ec0 legacy=0x7f9aec0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec0ccdf0 0x7f9ad00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004030 0x7f9ad0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad0004d40 0x7f9ad00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec0b4a30 con 0x7f9ad0004d40 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec0b3e20 con 0x7f9ad0004030 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.407+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad000bb20 con 0x7f9aec0ccdf0 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.408+0000 7f9aea800640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad0004d40 0x7f9ad00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.408+0000 7f9ae3e00640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004030 0x7f9ad0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.408+0000 7f9ae9e00640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec0ccdf0 0x7f9ad00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.408+0000 7f9aea800640 1 -- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec0ccdf0 msgr2=0x7f9ad00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.408+0000 7f9aea800640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec0ccdf0 0x7f9ad00039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.408+0000 7f9aea800640 1 -- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004030 msgr2=0x7f9ad0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:06.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.408+0000 7f9aea800640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004030 0x7f9ad0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.408+0000 7f9aea800640 1 -- 172.21.15.96:0/241576715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad0003520 con 0x7f9ad0004d40 2024-04-24T23:58:06.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.408+0000 7f9ae3e00640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004030 0x7f9ad0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:06.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.409+0000 7f9aea800640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad0004d40 0x7f9ad00051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007360 tx=0x7f9ad0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41df4d784f3216da server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:06.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.409+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4009be0 con 0x7f9ad0004d40 2024-04-24T23:58:06.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.409+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae4036600 con 0x7f9ad0004d40 2024-04-24T23:58:06.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.409+0000 7f9ae9400640 1 -- 172.21.15.96:0/241576715 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40369d0 con 0x7f9ad0004d40 2024-04-24T23:58:06.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.410+0000 7f9aeb200640 1 -- 172.21.15.96:0/241576715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad0004d40 msgr2=0x7f9ad00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.410+0000 7f9aeb200640 1 --2- 172.21.15.96:0/241576715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad0004d40 0x7f9ad00051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007360 tx=0x7f9ad0005830 comp rx=0 tx=0).stop 2024-04-24T23:58:06.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.410+0000 7f9aea800640 1 -- 172.21.15.96:0/241576715 reap_dead start 2024-04-24T23:58:06.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.410+0000 7f9aeb200640 1 -- 172.21.15.96:0/241576715 shutdown_connections 2024-04-24T23:58:06.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.410+0000 7f9aeb200640 1 -- 172.21.15.96:0/241576715 >> 172.21.15.96:0/241576715 conn(0x7f9aec0b1f10 msgr2=0x7f9aec0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:06.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.410+0000 7f9aeb200640 1 -- 172.21.15.96:0/241576715 shutdown_connections 2024-04-24T23:58:06.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.410+0000 7f9aeb200640 1 -- 172.21.15.96:0/241576715 wait complete. 2024-04-24T23:58:06.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.412+0000 7f9aeb200640 1 Processor -- start 2024-04-24T23:58:06.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.412+0000 7f9aeb200640 1 -- start start 2024-04-24T23:58:06.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9aeb200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004d40 0x7f9aec09b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9aeb200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aec09c150 0x7f9aec1466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9aeb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec15c080 0x7f9aec15c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9aeb200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec0ceb20 con 0x7f9aec09c150 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9aeb200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec0b46c0 con 0x7f9ad0004d40 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9aeb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9aec0cf1c0 con 0x7f9aec15c080 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9ae3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aec09c150 0x7f9aec1466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9ae3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aec09c150 0x7f9aec1466e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40822/0 (socket says 172.21.15.96:40822) 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9ae3e00640 1 -- 172.21.15.96:0/2182572459 learned_addr learned my addr 172.21.15.96:0/2182572459 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.413+0000 7f9ae9e00640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004d40 0x7f9aec09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9ae3e00640 1 -- 172.21.15.96:0/2182572459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec15c080 msgr2=0x7f9aec15c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9ae3e00640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec15c080 0x7f9aec15c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9ae3e00640 1 -- 172.21.15.96:0/2182572459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004d40 msgr2=0x7f9aec09b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9ae3e00640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004d40 0x7f9aec09b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9ae3e00640 1 -- 172.21.15.96:0/2182572459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aec09d470 con 0x7f9aec09c150 2024-04-24T23:58:06.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9ae3e00640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aec09c150 0x7f9aec1466e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400d830 tx=0x7f9ad400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:06.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9ae2000640 1 -- 172.21.15.96:0/2182572459 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4019070 con 0x7f9aec09c150 2024-04-24T23:58:06.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9ae2000640 1 -- 172.21.15.96:0/2182572459 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad40074e0 con 0x7f9aec09c150 2024-04-24T23:58:06.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9ae2000640 1 -- 172.21.15.96:0/2182572459 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4004a20 con 0x7f9aec09c150 2024-04-24T23:58:06.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aec09c8f0 con 0x7f9aec09c150 2024-04-24T23:58:06.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.414+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aec09ceb0 con 0x7f9aec09c150 2024-04-24T23:58:06.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.415+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aec067e40 con 0x7f9aec09c150 2024-04-24T23:58:06.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.416+0000 7f9ae2000640 1 -- 172.21.15.96:0/2182572459 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ad401c070 con 0x7f9aec09c150 2024-04-24T23:58:06.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.417+0000 7f9ae2000640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ac806be30 0x7f9ac806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.417+0000 7f9ae2000640 1 -- 172.21.15.96:0/2182572459 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f9ad408a940 con 0x7f9aec09c150 2024-04-24T23:58:06.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.417+0000 7f9ae9e00640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ac806be30 0x7f9ac806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.418+0000 7f9ae9e00640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ac806be30 0x7f9ac806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9adc006fd0 tx=0x7f9adc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:06.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.422+0000 7f9ae2000640 1 -- 172.21.15.96:0/2182572459 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9ad400de20 con 0x7f9aec09c150 2024-04-24T23:58:06.498 INFO:tasks.ceph.mds.b.smithi155.stderr:2024-04-24T23:58:06.497+0000 7f6ac9e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:58:06.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.620+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9aec0ce940 con 0x7f9aec09c150 2024-04-24T23:58:06.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.621+0000 7f9ae2000640 1 -- 172.21.15.96:0/2182572459 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16570 (secure 0 0 0) 0x7f9aec0ce940 con 0x7f9aec09c150 2024-04-24T23:58:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:06.622 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":19,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:05.204714+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:06.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ac806be30 msgr2=0x7f9ac806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ac806be30 0x7f9ac806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9adc006fd0 tx=0x7f9adc008040 comp rx=0 tx=0).stop 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aec09c150 msgr2=0x7f9aec1466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aec09c150 0x7f9aec1466e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400d830 tx=0x7f9ad400dcf0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 shutdown_connections 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9aec15c080 0x7f9aec15c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ac806be30 0x7f9ac806e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aec09c150 0x7f9aec1466e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 --2- 172.21.15.96:0/2182572459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad0004d40 0x7f9aec09b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.624+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 >> 172.21.15.96:0/2182572459 conn(0x7f9aec0b1f10 msgr2=0x7f9aec0adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.625+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 shutdown_connections 2024-04-24T23:58:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.625+0000 7f9aeb200640 1 -- 172.21.15.96:0/2182572459 wait complete. 2024-04-24T23:58:06.643 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:58:06.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.843+0000 7fb79c200640 1 Processor -- start 2024-04-24T23:58:06.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.843+0000 7fb79c200640 1 -- start start 2024-04-24T23:58:06.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.845+0000 7fb79c200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb794156620 0x7fb79415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.845+0000 7fb79c200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb79406edf0 0x7fb79406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.845+0000 7fb79c200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb79406d100 con 0x7fb7940ae8e0 2024-04-24T23:58:06.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.845+0000 7fb79c200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb7940acda0 con 0x7fb794156620 2024-04-24T23:58:06.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.845+0000 7fb79c200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7940ad060 con 0x7fb79406edf0 2024-04-24T23:58:06.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.846+0000 7fb799800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb794156620 0x7fb79415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.846+0000 7fb799800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb794156620 0x7fb79415cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45618/0 (socket says 172.21.15.96:45618) 2024-04-24T23:58:06.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.846+0000 7fb799800640 1 -- 172.21.15.96:0/1098779397 learned_addr learned my addr 172.21.15.96:0/1098779397 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:06.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.846+0000 7fb798e00640 1 --2- 172.21.15.96:0/1098779397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb79406edf0 0x7fb79406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.846+0000 7fb799800640 1 -- 172.21.15.96:0/1098779397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb79406edf0 msgr2=0x7fb79406dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:06.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.846+0000 7fb799800640 1 --2- 172.21.15.96:0/1098779397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb79406edf0 0x7fb79406dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.846+0000 7fb799800640 1 -- 172.21.15.96:0/1098779397 >> v1:172.21.15.155:6789/0 conn(0x7fb7940ae8e0 legacy=0x7fb7940aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.846+0000 7fb799800640 1 -- 172.21.15.96:0/1098779397 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79406d3a0 con 0x7fb794156620 2024-04-24T23:58:06.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.848+0000 7fb799800640 1 --2- 172.21.15.96:0/1098779397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb794156620 0x7fb79415cf70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb788009870 tx=0x7fb78802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=614430a8829df639 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:06.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.849+0000 7fb793e00640 1 -- 172.21.15.96:0/1098779397 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788037070 con 0x7fb794156620 2024-04-24T23:58:06.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.849+0000 7fb793e00640 1 -- 172.21.15.96:0/1098779397 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb788032440 con 0x7fb794156620 2024-04-24T23:58:06.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.849+0000 7fb793e00640 1 -- 172.21.15.96:0/1098779397 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788032810 con 0x7fb794156620 2024-04-24T23:58:06.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.849+0000 7fb79c200640 1 -- 172.21.15.96:0/1098779397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb794156620 msgr2=0x7fb79415cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.849+0000 7fb79c200640 1 --2- 172.21.15.96:0/1098779397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb794156620 0x7fb79415cf70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb788009870 tx=0x7fb78802a250 comp rx=0 tx=0).stop 2024-04-24T23:58:06.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.850+0000 7fb79c200640 1 -- 172.21.15.96:0/1098779397 shutdown_connections 2024-04-24T23:58:06.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.850+0000 7fb79c200640 1 --2- 172.21.15.96:0/1098779397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb79406edf0 0x7fb79406dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.850+0000 7fb79c200640 1 --2- 172.21.15.96:0/1098779397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb794156620 0x7fb79415cf70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.850+0000 7fb79c200640 1 -- 172.21.15.96:0/1098779397 >> 172.21.15.96:0/1098779397 conn(0x7fb7940b19c0 msgr2=0x7fb7940b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:06.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.850+0000 7fb79c200640 1 -- 172.21.15.96:0/1098779397 shutdown_connections 2024-04-24T23:58:06.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.850+0000 7fb79c200640 1 -- 172.21.15.96:0/1098779397 wait complete. 2024-04-24T23:58:06.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.851+0000 7fb79c200640 1 Processor -- start 2024-04-24T23:58:06.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.851+0000 7fb79c200640 1 -- start start 2024-04-24T23:58:06.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.852+0000 7fb79c200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb79406edf0 0x7fb7941f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.852+0000 7fb79c200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940ae8e0 0x7fb794157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.852+0000 7fb79c200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb794156620 0x7fb794158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.852+0000 7fb79c200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb7940ad340 con 0x7fb7940ae8e0 2024-04-24T23:58:06.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.852+0000 7fb79c200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb79406e0e0 con 0x7fb79406edf0 2024-04-24T23:58:06.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.852+0000 7fb79c200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7940ad4c0 con 0x7fb794156620 2024-04-24T23:58:06.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb798e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940ae8e0 0x7fb794157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb798e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940ae8e0 0x7fb794157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58740/0 (socket says 172.21.15.96:58740) 2024-04-24T23:58:06.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb798e00640 1 -- 172.21.15.96:0/4203418983 learned_addr learned my addr 172.21.15.96:0/4203418983 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb799800640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb79406edf0 0x7fb7941f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb79a200640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb794156620 0x7fb794158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb798e00640 1 -- 172.21.15.96:0/4203418983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb794156620 msgr2=0x7fb794158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb798e00640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb794156620 0x7fb794158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb798e00640 1 -- 172.21.15.96:0/4203418983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb79406edf0 msgr2=0x7fb7941f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb798e00640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb79406edf0 0x7fb7941f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb798e00640 1 -- 172.21.15.96:0/4203418983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79415e4f0 con 0x7fb7940ae8e0 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb79a200640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb794156620 0x7fb794158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.853+0000 7fb798e00640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940ae8e0 0x7fb794157430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb78000e980 tx=0x7fb78000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.854+0000 7fb791600640 1 -- 172.21.15.96:0/4203418983 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780017070 con 0x7fb7940ae8e0 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.854+0000 7fb791600640 1 -- 172.21.15.96:0/4203418983 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78000ca00 con 0x7fb7940ae8e0 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.854+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79415e7d0 con 0x7fb7940ae8e0 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.854+0000 7fb791600640 1 -- 172.21.15.96:0/4203418983 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78000cdd0 con 0x7fb7940ae8e0 2024-04-24T23:58:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.854+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79414f700 con 0x7fb7940ae8e0 2024-04-24T23:58:06.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.855+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7940689c0 con 0x7fb7940ae8e0 2024-04-24T23:58:06.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.856+0000 7fb791600640 1 -- 172.21.15.96:0/4203418983 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb78001a070 con 0x7fb7940ae8e0 2024-04-24T23:58:06.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.857+0000 7fb791600640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb77406be30 0x7fb77406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:06.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.857+0000 7fb791600640 1 -- 172.21.15.96:0/4203418983 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb78008b150 con 0x7fb7940ae8e0 2024-04-24T23:58:06.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.857+0000 7fb799800640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb77406be30 0x7fb77406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:06.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.858+0000 7fb799800640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb77406be30 0x7fb77406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb788034000 tx=0x7fb78802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:06.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:06.862+0000 7fb791600640 1 -- 172.21.15.96:0/4203418983 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb7940689c0 con 0x7fb7940ae8e0 2024-04-24T23:58:07.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:07.097+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb7941609c0 con 0x7fb7940ae8e0 2024-04-24T23:58:08.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.028+0000 7fb791600640 1 -- 172.21.15.96:0/4203418983 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7fb7941609c0 con 0x7fb7940ae8e0 2024-04-24T23:58:08.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb77406be30 msgr2=0x7fb77406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:08.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb77406be30 0x7fb77406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb788034000 tx=0x7fb78802e000 comp rx=0 tx=0).stop 2024-04-24T23:58:08.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940ae8e0 msgr2=0x7fb794157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:08.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940ae8e0 0x7fb794157430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb78000e980 tx=0x7fb78000ee40 comp rx=0 tx=0).stop 2024-04-24T23:58:08.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 shutdown_connections 2024-04-24T23:58:08.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb794156620 0x7fb794158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb77406be30 0x7fb77406e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940ae8e0 0x7fb794157430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 --2- 172.21.15.96:0/4203418983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb79406edf0 0x7fb7941f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 >> 172.21.15.96:0/4203418983 conn(0x7fb7940b19c0 msgr2=0x7fb79415fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:08.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 shutdown_connections 2024-04-24T23:58:08.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.032+0000 7fb79c200640 1 -- 172.21.15.96:0/4203418983 wait complete. 2024-04-24T23:58:08.057 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-24T23:58:08.058 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:58:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.254+0000 7fcacf200640 1 Processor -- start 2024-04-24T23:58:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.254+0000 7fcacf200640 1 -- start start 2024-04-24T23:58:08.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.255+0000 7fcacf200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad013ef60 0x7fcad015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:08.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.255+0000 7fcacf200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcad00cf3e0 0x7fcad00cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.255+0000 7fcacf200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcad01415d0 0x7fcad0141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.255+0000 7fcacf200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fcad00ce620 con 0x7fcad00cf3e0 2024-04-24T23:58:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.255+0000 7fcacf200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcad00ce900 con 0x7fcad01415d0 2024-04-24T23:58:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.255+0000 7fcacf200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcad00cebe0 con 0x7fcad013ef60 2024-04-24T23:58:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.255+0000 7fcac7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcad00cf3e0 0x7fcad00cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcac7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcad00cf3e0 0x7fcad00cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58748/0 (socket says 172.21.15.96:58748) 2024-04-24T23:58:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcac7e00640 1 -- 172.21.15.96:0/850942423 learned_addr learned my addr 172.21.15.96:0/850942423 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcacde00640 1 --2- 172.21.15.96:0/850942423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad013ef60 0x7fcad015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcace800640 1 --2- 172.21.15.96:0/850942423 >> v2:172.21.15.155:3300/0 conn(0x7fcad01415d0 0x7fcad0141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcac7e00640 1 -- 172.21.15.96:0/850942423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad013ef60 msgr2=0x7fcad015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcac7e00640 1 --2- 172.21.15.96:0/850942423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad013ef60 0x7fcad015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcac7e00640 1 -- 172.21.15.96:0/850942423 >> v2:172.21.15.155:3300/0 conn(0x7fcad01415d0 msgr2=0x7fcad0141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcac7e00640 1 --2- 172.21.15.96:0/850942423 >> v2:172.21.15.155:3300/0 conn(0x7fcad01415d0 0x7fcad0141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcac7e00640 1 -- 172.21.15.96:0/850942423 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad00ccb10 con 0x7fcad00cf3e0 2024-04-24T23:58:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcacde00640 1 --2- 172.21.15.96:0/850942423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad013ef60 0x7fcad015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.256+0000 7fcace800640 1 --2- 172.21.15.96:0/850942423 >> v2:172.21.15.155:3300/0 conn(0x7fcad01415d0 0x7fcad0141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:08.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.257+0000 7fcac7e00640 1 --2- 172.21.15.96:0/850942423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00cf3e0 0x7fcad00cc5d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcad00cdfb0 tx=0x7fcab802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62110d0912d5c5f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.257+0000 7fcacd400640 1 -- 172.21.15.96:0/850942423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8037070 con 0x7fcad00cf3e0 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.257+0000 7fcacd400640 1 -- 172.21.15.96:0/850942423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab8032440 con 0x7fcad00cf3e0 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.257+0000 7fcacd400640 1 -- 172.21.15.96:0/850942423 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8032810 con 0x7fcad00cf3e0 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.258+0000 7fcacf200640 1 -- 172.21.15.96:0/850942423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00cf3e0 msgr2=0x7fcad00cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.258+0000 7fcacf200640 1 --2- 172.21.15.96:0/850942423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00cf3e0 0x7fcad00cc5d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcad00cdfb0 tx=0x7fcab802a1e0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.258+0000 7fcacf200640 1 -- 172.21.15.96:0/850942423 shutdown_connections 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.258+0000 7fcacf200640 1 --2- 172.21.15.96:0/850942423 >> v2:172.21.15.155:3300/0 conn(0x7fcad01415d0 0x7fcad0141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.258+0000 7fcacf200640 1 --2- 172.21.15.96:0/850942423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00cf3e0 0x7fcad00cc5d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.258+0000 7fcacf200640 1 --2- 172.21.15.96:0/850942423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad013ef60 0x7fcad015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.258+0000 7fcacf200640 1 -- 172.21.15.96:0/850942423 >> 172.21.15.96:0/850942423 conn(0x7fcad00b18b0 msgr2=0x7fcad00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.258+0000 7fcacf200640 1 -- 172.21.15.96:0/850942423 shutdown_connections 2024-04-24T23:58:08.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.258+0000 7fcacf200640 1 -- 172.21.15.96:0/850942423 wait complete. 2024-04-24T23:58:08.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.260+0000 7fcacf200640 1 Processor -- start 2024-04-24T23:58:08.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.260+0000 7fcacf200640 1 -- start start 2024-04-24T23:58:08.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcacf200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad00cf3e0 0x7fcad01f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:08.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcacf200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad013ef60 0x7fcad01593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:08.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcacf200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcad01415d0 0x7fcad0157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:08.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcacf200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcad00cf9e0 con 0x7fcad013ef60 2024-04-24T23:58:08.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcacf200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcad00cf860 con 0x7fcad01415d0 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcacf200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcad015fa20 con 0x7fcad00cf3e0 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcac7e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad013ef60 0x7fcad01593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcac7e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad013ef60 0x7fcad01593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58756/0 (socket says 172.21.15.96:58756) 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcac7e00640 1 -- 172.21.15.96:0/2934015475 learned_addr learned my addr 172.21.15.96:0/2934015475 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.261+0000 7fcacde00640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad00cf3e0 0x7fcad01f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcac7e00640 1 -- 172.21.15.96:0/2934015475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad00cf3e0 msgr2=0x7fcad01f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcace800640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcad01415d0 0x7fcad0157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcac7e00640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad00cf3e0 0x7fcad01f12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcac7e00640 1 -- 172.21.15.96:0/2934015475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcad01415d0 msgr2=0x7fcad0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcac7e00640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcad01415d0 0x7fcad0157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcac7e00640 1 -- 172.21.15.96:0/2934015475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad01f17f0 con 0x7fcad013ef60 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcacde00640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad00cf3e0 0x7fcad01f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcac7e00640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad013ef60 0x7fcad01593a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcab802a220 tx=0x7fcab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:08.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcac6000640 1 -- 172.21.15.96:0/2934015475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8037040 con 0x7fcad013ef60 2024-04-24T23:58:08.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcac6000640 1 -- 172.21.15.96:0/2934015475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab8042070 con 0x7fcad013ef60 2024-04-24T23:58:08.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcac6000640 1 -- 172.21.15.96:0/2934015475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8030bb0 con 0x7fcad013ef60 2024-04-24T23:58:08.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad0156c70 con 0x7fcad013ef60 2024-04-24T23:58:08.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.262+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad0157230 con 0x7fcad013ef60 2024-04-24T23:58:08.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.263+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad00755d0 con 0x7fcad013ef60 2024-04-24T23:58:08.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.264+0000 7fcac6000640 1 -- 172.21.15.96:0/2934015475 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcab8047460 con 0x7fcad013ef60 2024-04-24T23:58:08.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.265+0000 7fcac6000640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcaac06be30 0x7fcaac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:08.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.265+0000 7fcac6000640 1 -- 172.21.15.96:0/2934015475 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcab80abb30 con 0x7fcad013ef60 2024-04-24T23:58:08.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.265+0000 7fcacde00640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcaac06be30 0x7fcaac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:08.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.266+0000 7fcacde00640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcaac06be30 0x7fcaac06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcac00088b0 tx=0x7fcac0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:08.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.270+0000 7fcac6000640 1 -- 172.21.15.96:0/2934015475 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcad01f17f0 con 0x7fcad013ef60 2024-04-24T23:58:08.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:08.500+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcad0140f20 con 0x7fcad013ef60 2024-04-24T23:58:09.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.038+0000 7fcac6000640 1 -- 172.21.15.96:0/2934015475 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7fcab8045360 con 0x7fcad013ef60 2024-04-24T23:58:09.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.043+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcaac06be30 msgr2=0x7fcaac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.043+0000 7fcacf200640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcaac06be30 0x7fcaac06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcac00088b0 tx=0x7fcac0008040 comp rx=0 tx=0).stop 2024-04-24T23:58:09.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.043+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad013ef60 msgr2=0x7fcad01593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.043+0000 7fcacf200640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad013ef60 0x7fcad01593a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcab802a220 tx=0x7fcab80046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.044+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 shutdown_connections 2024-04-24T23:58:09.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.044+0000 7fcacf200640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcad01415d0 0x7fcad0157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.044+0000 7fcacf200640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcaac06be30 0x7fcaac06e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.044+0000 7fcacf200640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad013ef60 0x7fcad01593a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.044+0000 7fcacf200640 1 --2- 172.21.15.96:0/2934015475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcad00cf3e0 0x7fcad01f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.044+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 >> 172.21.15.96:0/2934015475 conn(0x7fcad00b18b0 msgr2=0x7fcad00ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:09.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.044+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 shutdown_connections 2024-04-24T23:58:09.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.044+0000 7fcacf200640 1 -- 172.21.15.96:0/2934015475 wait complete. 2024-04-24T23:58:09.063 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:58:09.063 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:58:09.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.262+0000 7f0a11a00640 1 Processor -- start 2024-04-24T23:58:09.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.262+0000 7f0a11a00640 1 -- start start 2024-04-24T23:58:09.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.263+0000 7f0a11a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a0c071470 0x7f0a0c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.263+0000 7f0a11a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0c0ce100 con 0x7f0a0c0cdbd0 2024-04-24T23:58:09.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.263+0000 7f0a11a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0c0ce3e0 con 0x7f0a0c1553f0 2024-04-24T23:58:09.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.263+0000 7f0a11a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0a0c0ce6c0 con 0x7f0a0c071470 2024-04-24T23:58:09.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a11000640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0a0c0cdbd0 0x7f0a0c06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50898/0 (socket says 172.21.15.96:50898) 2024-04-24T23:58:09.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a11000640 1 -- 172.21.15.96:0/1121414204 learned_addr learned my addr 172.21.15.96:0/1121414204 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:09.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a03400640 1 --2- 172.21.15.96:0/1121414204 >> v2:172.21.15.155:3300/0 conn(0x7f0a0c071470 0x7f0a0c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 257113128 0 0) 0x7f0a0c0ce100 con 0x7f0a0c0cdbd0 2024-04-24T23:58:09.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09f0003520 con 0x7f0a0c0cdbd0 2024-04-24T23:58:09.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3509391823 0 0) 0x7f09f0003520 con 0x7f0a0c0cdbd0 2024-04-24T23:58:09.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 >> v2:172.21.15.155:3300/0 conn(0x7f0a0c071470 msgr2=0x7f0a0c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:09.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a0b400640 1 --2- 172.21.15.96:0/1121414204 >> v2:172.21.15.155:3300/0 conn(0x7f0a0c071470 0x7f0a0c15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 >> v1:172.21.15.155:6789/0 conn(0x7f0a0c1553f0 legacy=0x7f0a0c070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0c0ce9a0 con 0x7f0a0c0cdbd0 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f0a040019f0 con 0x7f0a0c0cdbd0 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.264+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 >> v1:172.21.15.96:6789/0 conn(0x7f0a0c0cdbd0 legacy=0x7f0a0c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a0b400640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f00039b0 0x7f09f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a0b400640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09f0004800 0x7f09f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a0b400640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f00051c0 0x7f09f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c0ce6c0 con 0x7f09f00051c0 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f09f000c060 con 0x7f09f0004800 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f09f000e470 con 0x7f09f00039b0 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a11000640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f00051c0 0x7f09f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a03400640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09f0004800 0x7f09f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a0be00640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f00039b0 0x7f09f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a11000640 1 -- 172.21.15.96:0/1121414204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f00039b0 msgr2=0x7f09f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a11000640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f00039b0 0x7f09f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a11000640 1 -- 172.21.15.96:0/1121414204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09f0004800 msgr2=0x7f09f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:09.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a11000640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09f0004800 0x7f09f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a11000640 1 -- 172.21.15.96:0/1121414204 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f0003520 con 0x7f09f00051c0 2024-04-24T23:58:09.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.265+0000 7f0a0be00640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09f00039b0 0x7f09f0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:09.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.266+0000 7f0a11000640 1 -- 172.21.15.96:0/1121414204 reap_dead start 2024-04-24T23:58:09.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.266+0000 7f0a11000640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f00051c0 0x7f09f000b9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400a840 tx=0x7f09f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf0f6fac20cf597 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:09.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400a460 con 0x7f09f00051c0 2024-04-24T23:58:09.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a0402f070 con 0x7f09f00051c0 2024-04-24T23:58:09.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a0b400640 1 -- 172.21.15.96:0/1121414204 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0402bcb0 con 0x7f09f00051c0 2024-04-24T23:58:09.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a11a00640 1 -- 172.21.15.96:0/1121414204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f00051c0 msgr2=0x7f09f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a11a00640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f00051c0 0x7f09f000b9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400a840 tx=0x7f09f0005830 comp rx=0 tx=0).stop 2024-04-24T23:58:09.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a11a00640 1 -- 172.21.15.96:0/1121414204 shutdown_connections 2024-04-24T23:58:09.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a11a00640 1 --2- 172.21.15.96:0/1121414204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f00051c0 0x7f09f000b9c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a11a00640 1 -- 172.21.15.96:0/1121414204 >> 172.21.15.96:0/1121414204 conn(0x7f0a0c0b1f10 msgr2=0x7f0a0c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:09.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a11a00640 1 -- 172.21.15.96:0/1121414204 shutdown_connections 2024-04-24T23:58:09.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.267+0000 7f0a11a00640 1 -- 172.21.15.96:0/1121414204 wait complete. 2024-04-24T23:58:09.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.269+0000 7f0a11a00640 1 Processor -- start 2024-04-24T23:58:09.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.269+0000 7f0a11a00640 1 -- start start 2024-04-24T23:58:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.270+0000 7f0a11a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09f00051c0 0x7f0a0c144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.270+0000 7f0a11a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a0c1e5d30 0x7f0a0c1e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.270+0000 7f0a11a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c1e6e80 0x7f0a0c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.270+0000 7f0a11a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c155950 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.270+0000 7f0a11a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c1557d0 con 0x7f09f00051c0 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.270+0000 7f0a11a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0a0c15b530 con 0x7f0a0c1e5d30 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.270+0000 7f0a11000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c1e6e80 0x7f0a0c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.270+0000 7f0a11000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c1e6e80 0x7f0a0c159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58774/0 (socket says 172.21.15.96:58774) 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.270+0000 7f0a11000640 1 -- 172.21.15.96:0/1274374548 learned_addr learned my addr 172.21.15.96:0/1274374548 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a11000640 1 -- 172.21.15.96:0/1274374548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a0c1e5d30 msgr2=0x7f0a0c1e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a03400640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a0c1e5d30 0x7f0a0c1e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a0be00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09f00051c0 0x7f0a0c144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a11000640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a0c1e5d30 0x7f0a0c1e6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a11000640 1 -- 172.21.15.96:0/1274374548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09f00051c0 msgr2=0x7f0a0c144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a11000640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09f00051c0 0x7f0a0c144730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a11000640 1 -- 172.21.15.96:0/1274374548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0c144c70 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a11000640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c1e6e80 0x7f0a0c159f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a0402b500 tx=0x7f0a0c0ce2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a08c00640 1 -- 172.21.15.96:0/1274374548 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400a460 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a08c00640 1 -- 172.21.15.96:0/1274374548 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a04001250 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0c1e4c90 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a08c00640 1 -- 172.21.15.96:0/1274374548 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04001fb0 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.271+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a0c1e5250 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.273+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a0c0756b0 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.273+0000 7f0a08c00640 1 -- 172.21.15.96:0/1274374548 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a04034470 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.274+0000 7f0a08c00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f09e806be60 0x7f09e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.274+0000 7f0a08c00640 1 -- 172.21.15.96:0/1274374548 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0a040aadb0 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.275+0000 7f0a0be00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f09e806be60 0x7f09e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.275+0000 7f0a0be00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f09e806be60 0x7f09e806e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0015b0 tx=0x7f09fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:09.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.279+0000 7f0a08c00640 1 -- 172.21.15.96:0/1274374548 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0a040af070 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.516+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a0c15c290 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.516+0000 7f0a08c00640 1 -- 172.21.15.96:0/1274374548 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5178 (secure 0 0 0) 0x7f0a0c144c70 con 0x7f0a0c1e6e80 2024-04-24T23:58:09.517 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:09.517 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1694444006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1694444006},{"type":"v1","addr":"172.21.15.96:6837","nonce":1694444006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3646872561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6833","nonce":3646872561},{"type":"v1","addr":"172.21.15.155:6835","nonce":3646872561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/227257747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":227257747},{"type":"v1","addr":"172.21.15.96:6836","nonce":227257747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:58:05.205304+0000","modified":"2024-04-24T23:58:08.502172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6834/1986626476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1986626476},{"type":"v1","addr":"172.21.15.155:6834","nonce":1986626476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-24T23:58:09.517 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-04-24T23:58:09.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f09e806be60 msgr2=0x7f09e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f09e806be60 0x7f09e806e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0015b0 tx=0x7f09fc009040 comp rx=0 tx=0).stop 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c1e6e80 msgr2=0x7f0a0c159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c1e6e80 0x7f0a0c159f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a0402b500 tx=0x7f0a0c0ce2d0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 shutdown_connections 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f09e806be60 0x7f09e806e320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c1e6e80 0x7f0a0c159f70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a0c1e5d30 0x7f0a0c1e6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 --2- 172.21.15.96:0/1274374548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09f00051c0 0x7f0a0c144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 >> 172.21.15.96:0/1274374548 conn(0x7f0a0c0b1f10 msgr2=0x7f0a0c0ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 shutdown_connections 2024-04-24T23:58:09.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.519+0000 7f0a11a00640 1 -- 172.21.15.96:0/1274374548 wait complete. 2024-04-24T23:58:09.537 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.734+0000 7efc53a00640 1 Processor -- start 2024-04-24T23:58:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.734+0000 7efc53a00640 1 -- start start 2024-04-24T23:58:09.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.735+0000 7efc53a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efc4c0af120 0x7efc4c071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc53a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4c160b20 con 0x7efc4c0acda0 2024-04-24T23:58:09.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc53a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4c15fd60 con 0x7efc4c15c230 2024-04-24T23:58:09.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc53a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7efc4c15c610 con 0x7efc4c0af120 2024-04-24T23:58:09.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc43e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efc4c0af120 0x7efc4c071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc43e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efc4c0af120 0x7efc4c071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58784/0 (socket says 172.21.15.96:58784) 2024-04-24T23:58:09.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc43e00640 1 -- 172.21.15.96:0/2371755037 learned_addr learned my addr 172.21.15.96:0/2371755037 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:09.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc51a00640 1 --1- 172.21.15.96:0/2371755037 >> v1:172.21.15.96:6789/0 conn(0x7efc4c0acda0 0x7efc4c06cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50914/0 (socket says 172.21.15.96:50914) 2024-04-24T23:58:09.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc43e00640 1 -- 172.21.15.96:0/2371755037 >> v1:172.21.15.155:6789/0 conn(0x7efc4c15c230 legacy=0x7efc4c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:09.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc43e00640 1 -- 172.21.15.96:0/2371755037 >> v1:172.21.15.96:6789/0 conn(0x7efc4c0acda0 legacy=0x7efc4c06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc43e00640 1 -- 172.21.15.96:0/2371755037 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4c160040 con 0x7efc4c0af120 2024-04-24T23:58:09.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.736+0000 7efc4be00640 1 -- 172.21.15.96:0/2371755037 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 82313510 0 0) 0x7efc4c160b20 con 0x7efc4c0acda0 2024-04-24T23:58:09.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.737+0000 7efc43e00640 1 --2- 172.21.15.96:0/2371755037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0af120 0x7efc4c071800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc34009870 tx=0x7efc3402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3055b559d496bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:09.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc4be00640 1 -- 172.21.15.96:0/2371755037 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34037070 con 0x7efc4c0af120 2024-04-24T23:58:09.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc4be00640 1 -- 172.21.15.96:0/2371755037 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc34032440 con 0x7efc4c0af120 2024-04-24T23:58:09.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc4be00640 1 -- 172.21.15.96:0/2371755037 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34032810 con 0x7efc4c0af120 2024-04-24T23:58:09.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc53a00640 1 -- 172.21.15.96:0/2371755037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0af120 msgr2=0x7efc4c071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc53a00640 1 --2- 172.21.15.96:0/2371755037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0af120 0x7efc4c071800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc34009870 tx=0x7efc3402a2a0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc53a00640 1 -- 172.21.15.96:0/2371755037 shutdown_connections 2024-04-24T23:58:09.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc53a00640 1 --2- 172.21.15.96:0/2371755037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0af120 0x7efc4c071800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc53a00640 1 -- 172.21.15.96:0/2371755037 >> 172.21.15.96:0/2371755037 conn(0x7efc4c0b19c0 msgr2=0x7efc4c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:09.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc53a00640 1 -- 172.21.15.96:0/2371755037 shutdown_connections 2024-04-24T23:58:09.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.738+0000 7efc53a00640 1 -- 172.21.15.96:0/2371755037 wait complete. 2024-04-24T23:58:09.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.740+0000 7efc53a00640 1 Processor -- start 2024-04-24T23:58:09.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.740+0000 7efc53a00640 1 -- start start 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.741+0000 7efc53a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0acda0 0x7efc4c151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.741+0000 7efc53a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc4c0af120 0x7efc4c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.741+0000 7efc53a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc4c15c230 0x7efc4c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.741+0000 7efc53a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c0ad1f0 con 0x7efc4c0acda0 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.741+0000 7efc53a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c160600 con 0x7efc4c15c230 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.741+0000 7efc53a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc4c0ad4d0 con 0x7efc4c0af120 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.741+0000 7efc51000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0acda0 0x7efc4c151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.741+0000 7efc51000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0acda0 0x7efc4c151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58788/0 (socket says 172.21.15.96:58788) 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.741+0000 7efc51000640 1 -- 172.21.15.96:0/738787485 learned_addr learned my addr 172.21.15.96:0/738787485 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc51000640 1 -- 172.21.15.96:0/738787485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc4c0af120 msgr2=0x7efc4c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc51000640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc4c0af120 0x7efc4c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc51000640 1 -- 172.21.15.96:0/738787485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc4c15c230 msgr2=0x7efc4c0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc51000640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc4c15c230 0x7efc4c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc51000640 1 -- 172.21.15.96:0/738787485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4c151dd0 con 0x7efc4c0acda0 2024-04-24T23:58:09.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc51000640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0acda0 0x7efc4c151890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00c430 tx=0x7efc3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:09.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc49600640 1 -- 172.21.15.96:0/738787485 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c011790 con 0x7efc4c0acda0 2024-04-24T23:58:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc49600640 1 -- 172.21.15.96:0/738787485 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3c017070 con 0x7efc4c0acda0 2024-04-24T23:58:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc49600640 1 -- 172.21.15.96:0/738787485 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c011b70 con 0x7efc4c0acda0 2024-04-24T23:58:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.742+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4c09b960 con 0x7efc4c0acda0 2024-04-24T23:58:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.743+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc4c0c93c0 con 0x7efc4c0acda0 2024-04-24T23:58:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.744+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4c069110 con 0x7efc4c0acda0 2024-04-24T23:58:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.745+0000 7efc49600640 1 -- 172.21.15.96:0/738787485 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc3c011d10 con 0x7efc4c0acda0 2024-04-24T23:58:09.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.745+0000 7efc49600640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efc2806be60 0x7efc2806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:09.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.745+0000 7efc49600640 1 -- 172.21.15.96:0/738787485 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efc3c08ace0 con 0x7efc4c0acda0 2024-04-24T23:58:09.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.746+0000 7efc43e00640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efc2806be60 0x7efc2806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:09.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.746+0000 7efc43e00640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efc2806be60 0x7efc2806e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc34034000 tx=0x7efc3402c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:09.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.750+0000 7efc49600640 1 -- 172.21.15.96:0/738787485 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efc4c151dd0 con 0x7efc4c0acda0 2024-04-24T23:58:09.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.951+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc4c0cc190 con 0x7efc4c0acda0 2024-04-24T23:58:09.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.953+0000 7efc49600640 1 -- 172.21.15.96:0/738787485 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7efc3c059690 con 0x7efc4c0acda0 2024-04-24T23:58:09.954 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:09.954 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.956+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efc2806be60 msgr2=0x7efc2806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.956+0000 7efc53a00640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efc2806be60 0x7efc2806e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc34034000 tx=0x7efc3402c000 comp rx=0 tx=0).stop 2024-04-24T23:58:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.956+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0acda0 msgr2=0x7efc4c151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.956+0000 7efc53a00640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0acda0 0x7efc4c151890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00c430 tx=0x7efc3c00c8f0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.957+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 shutdown_connections 2024-04-24T23:58:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.957+0000 7efc53a00640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc4c15c230 0x7efc4c0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.957+0000 7efc53a00640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc4c0af120 0x7efc4c0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.957+0000 7efc53a00640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efc2806be60 0x7efc2806e320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.957+0000 7efc53a00640 1 --2- 172.21.15.96:0/738787485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0acda0 0x7efc4c151890 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.957+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 >> 172.21.15.96:0/738787485 conn(0x7efc4c0b19c0 msgr2=0x7efc4c06cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.957+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 shutdown_connections 2024-04-24T23:58:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:09.957+0000 7efc53a00640 1 -- 172.21.15.96:0/738787485 wait complete. 2024-04-24T23:58:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:58:09.976 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:58:10.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.172+0000 7f4d71800640 1 Processor -- start 2024-04-24T23:58:10.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.172+0000 7f4d71800640 1 -- start start 2024-04-24T23:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.174+0000 7f4d71800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4d6c071800 0x7f4d6c0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.174+0000 7f4d71800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c160b20 con 0x7f4d6c0af120 2024-04-24T23:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.174+0000 7f4d71800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c15fd60 con 0x7f4d6c15c230 2024-04-24T23:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.174+0000 7f4d71800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4d6c15c610 con 0x7f4d6c071800 2024-04-24T23:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.174+0000 7f4d62000640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4d6c0af120 0x7f4d6c06cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50928/0 (socket says 172.21.15.96:50928) 2024-04-24T23:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.174+0000 7f4d62000640 1 -- 172.21.15.96:0/4282706573 learned_addr learned my addr 172.21.15.96:0/4282706573 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.174+0000 7f4d6b400640 1 --2- 172.21.15.96:0/4282706573 >> v2:172.21.15.96:3300/0 conn(0x7f4d6c071800 0x7f4d6c0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.175+0000 7f4d6a000640 1 -- 172.21.15.96:0/4282706573 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855767876 0 0) 0x7f4d6c160b20 con 0x7f4d6c0af120 2024-04-24T23:58:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.175+0000 7f4d6a000640 1 -- 172.21.15.96:0/4282706573 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d50003520 con 0x7f4d6c0af120 2024-04-24T23:58:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.175+0000 7f4d6b400640 1 -- 172.21.15.96:0/4282706573 >> v1:172.21.15.155:6789/0 conn(0x7f4d6c15c230 legacy=0x7f4d6c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.175+0000 7f4d6b400640 1 -- 172.21.15.96:0/4282706573 >> v1:172.21.15.96:6789/0 conn(0x7f4d6c0af120 legacy=0x7f4d6c06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.175+0000 7f4d6b400640 1 -- 172.21.15.96:0/4282706573 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c160040 con 0x7f4d6c071800 2024-04-24T23:58:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.176+0000 7f4d6b400640 1 --2- 172.21.15.96:0/4282706573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c071800 0x7f4d6c0acda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009d90 tx=0x7f4d6402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c795fadd70c1128 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.176+0000 7f4d6a000640 1 -- 172.21.15.96:0/4282706573 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64007740 con 0x7f4d6c071800 2024-04-24T23:58:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.176+0000 7f4d6a000640 1 -- 172.21.15.96:0/4282706573 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d640078e0 con 0x7f4d6c071800 2024-04-24T23:58:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.176+0000 7f4d6a000640 1 -- 172.21.15.96:0/4282706573 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64007cb0 con 0x7f4d6c071800 2024-04-24T23:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.177+0000 7f4d71800640 1 -- 172.21.15.96:0/4282706573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c071800 msgr2=0x7f4d6c0acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.177+0000 7f4d71800640 1 --2- 172.21.15.96:0/4282706573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c071800 0x7f4d6c0acda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009d90 tx=0x7f4d6402a6f0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.177+0000 7f4d71800640 1 -- 172.21.15.96:0/4282706573 shutdown_connections 2024-04-24T23:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.177+0000 7f4d71800640 1 --2- 172.21.15.96:0/4282706573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c071800 0x7f4d6c0acda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.177+0000 7f4d71800640 1 -- 172.21.15.96:0/4282706573 >> 172.21.15.96:0/4282706573 conn(0x7f4d6c0b19c0 msgr2=0x7f4d6c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.177+0000 7f4d71800640 1 -- 172.21.15.96:0/4282706573 shutdown_connections 2024-04-24T23:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.177+0000 7f4d71800640 1 -- 172.21.15.96:0/4282706573 wait complete. 2024-04-24T23:58:10.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.178+0000 7f4d71800640 1 Processor -- start 2024-04-24T23:58:10.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.179+0000 7f4d71800640 1 -- start start 2024-04-24T23:58:10.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.179+0000 7f4d71800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d6c071800 0x7f4d6c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d71800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c0af120 0x7f4d6c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d71800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d6c15c230 0x7f4d6c09afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d71800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c160600 con 0x7f4d6c0af120 2024-04-24T23:58:10.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d71800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c071c50 con 0x7f4d6c071800 2024-04-24T23:58:10.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d71800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c0ad4d0 con 0x7f4d6c15c230 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d62000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c0af120 0x7f4d6c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d62000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c0af120 0x7f4d6c09aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58800/0 (socket says 172.21.15.96:58800) 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d62000640 1 -- 172.21.15.96:0/2010109780 learned_addr learned my addr 172.21.15.96:0/2010109780 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d62000640 1 -- 172.21.15.96:0/2010109780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d6c15c230 msgr2=0x7f4d6c09afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d6b400640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d6c15c230 0x7f4d6c09afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d6aa00640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d6c071800 0x7f4d6c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d62000640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d6c15c230 0x7f4d6c09afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d62000640 1 -- 172.21.15.96:0/2010109780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d6c071800 msgr2=0x7f4d6c153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d62000640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d6c071800 0x7f4d6c153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d62000640 1 -- 172.21.15.96:0/2010109780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c0cb990 con 0x7f4d6c0af120 2024-04-24T23:58:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.180+0000 7f4d6aa00640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d6c071800 0x7f4d6c153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:10.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.181+0000 7f4d62000640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c0af120 0x7f4d6c09aa70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400c530 tx=0x7f4d5400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:10.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.181+0000 7f4d63400640 1 -- 172.21.15.96:0/2010109780 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54017070 con 0x7f4d6c0af120 2024-04-24T23:58:10.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.181+0000 7f4d63400640 1 -- 172.21.15.96:0/2010109780 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d54005ce0 con 0x7f4d6c0af120 2024-04-24T23:58:10.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.181+0000 7f4d63400640 1 -- 172.21.15.96:0/2010109780 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d540072b0 con 0x7f4d6c0af120 2024-04-24T23:58:10.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.181+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c0cbc70 con 0x7f4d6c0af120 2024-04-24T23:58:10.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.181+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c09d0b0 con 0x7f4d6c0af120 2024-04-24T23:58:10.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.182+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c0ad220 con 0x7f4d6c0af120 2024-04-24T23:58:10.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.183+0000 7f4d63400640 1 -- 172.21.15.96:0/2010109780 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d5401a070 con 0x7f4d6c0af120 2024-04-24T23:58:10.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.184+0000 7f4d63400640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d4806be30 0x7f4d4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.184+0000 7f4d63400640 1 -- 172.21.15.96:0/2010109780 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4d5408a1f0 con 0x7f4d6c0af120 2024-04-24T23:58:10.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.184+0000 7f4d6aa00640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d4806be30 0x7f4d4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.185+0000 7f4d6aa00640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d4806be30 0x7f4d4806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c000f60 tx=0x7f4d5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:10.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.188+0000 7f4d63400640 1 -- 172.21.15.96:0/2010109780 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4d6c0ad220 con 0x7f4d6c0af120 2024-04-24T23:58:10.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.384+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d6c069110 con 0x7f4d4806be30 2024-04-24T23:58:10.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.407+0000 7f4d63400640 1 -- 172.21.15.96:0/2010109780 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f4d6c069110 con 0x7f4d4806be30 2024-04-24T23:58:10.411 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-24T23:58:10.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d4806be30 msgr2=0x7f4d4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d4806be30 0x7f4d4806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c000f60 tx=0x7f4d5c009040 comp rx=0 tx=0).stop 2024-04-24T23:58:10.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c0af120 msgr2=0x7f4d6c09aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c0af120 0x7f4d6c09aa70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400c530 tx=0x7f4d5400c9f0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 shutdown_connections 2024-04-24T23:58:10.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d6c15c230 0x7f4d6c09afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d4806be30 0x7f4d4806e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d6c0af120 0x7f4d6c09aa70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 --2- 172.21.15.96:0/2010109780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d6c071800 0x7f4d6c153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.412+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 >> 172.21.15.96:0/2010109780 conn(0x7f4d6c0b19c0 msgr2=0x7f4d6c0af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:10.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.413+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 shutdown_connections 2024-04-24T23:58:10.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.413+0000 7f4d71800640 1 -- 172.21.15.96:0/2010109780 wait complete. 2024-04-24T23:58:10.432 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-24T23:58:10.301437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001647"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552582+0000","last_change":"2024-04-24T23:58:05.798222+0000","last_active":"2024-04-24T23:58:07.552582+0000","last_peered":"2024-04-24T23:58:07.552582+0000","last_clean":"2024-04-24T23:58:07.552582+0000","last_became_active":"2024-04-24T23:58:05.797677+0000","last_became_peered":"2024-04-24T23:58:05.797677+0000","last_unstale":"2024-04-24T23:58:07.552582+0000","last_undegraded":"2024-04-24T23:58:07.552582+0000","last_fullsized":"2024-04-24T23:58:07.552582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:52.401878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779963+0000","last_change":"2024-04-24T23:58:05.795987+0000","last_active":"2024-04-24T23:58:06.779963+0000","last_peered":"2024-04-24T23:58:06.779963+0000","last_clean":"2024-04-24T23:58:06.779963+0000","last_became_active":"2024-04-24T23:58:05.794693+0000","last_became_peered":"2024-04-24T23:58:05.794693+0000","last_unstale":"2024-04-24T23:58:06.779963+0000","last_undegraded":"2024-04-24T23:58:06.779963+0000","last_fullsized":"2024-04-24T23:58:06.779963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549565+0000","last_change":"2024-04-24T23:58:05.792670+0000","last_active":"2024-04-24T23:58:07.549565+0000","last_peered":"2024-04-24T23:58:07.549565+0000","last_clean":"2024-04-24T23:58:07.549565+0000","last_became_active":"2024-04-24T23:58:05.792250+0000","last_became_peered":"2024-04-24T23:58:05.792250+0000","last_unstale":"2024-04-24T23:58:07.549565+0000","last_undegraded":"2024-04-24T23:58:07.549565+0000","last_fullsized":"2024-04-24T23:58:07.549565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549094+0000","last_change":"2024-04-24T23:58:05.797139+0000","last_active":"2024-04-24T23:58:07.549094+0000","last_peered":"2024-04-24T23:58:07.549094+0000","last_clean":"2024-04-24T23:58:07.549094+0000","last_became_active":"2024-04-24T23:58:05.796582+0000","last_became_peered":"2024-04-24T23:58:05.796582+0000","last_unstale":"2024-04-24T23:58:07.549094+0000","last_undegraded":"2024-04-24T23:58:07.549094+0000","last_fullsized":"2024-04-24T23:58:07.549094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:00.726837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548416+0000","last_change":"2024-04-24T23:58:05.800388+0000","last_active":"2024-04-24T23:58:07.548416+0000","last_peered":"2024-04-24T23:58:07.548416+0000","last_clean":"2024-04-24T23:58:07.548416+0000","last_became_active":"2024-04-24T23:58:05.799461+0000","last_became_peered":"2024-04-24T23:58:05.799461+0000","last_unstale":"2024-04-24T23:58:07.548416+0000","last_undegraded":"2024-04-24T23:58:07.548416+0000","last_fullsized":"2024-04-24T23:58:07.548416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548380+0000","last_change":"2024-04-24T23:58:05.790511+0000","last_active":"2024-04-24T23:58:07.548380+0000","last_peered":"2024-04-24T23:58:07.548380+0000","last_clean":"2024-04-24T23:58:07.548380+0000","last_became_active":"2024-04-24T23:58:05.790204+0000","last_became_peered":"2024-04-24T23:58:05.790204+0000","last_unstale":"2024-04-24T23:58:07.548380+0000","last_undegraded":"2024-04-24T23:58:07.548380+0000","last_fullsized":"2024-04-24T23:58:07.548380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549559+0000","last_change":"2024-04-24T23:58:05.803344+0000","last_active":"2024-04-24T23:58:07.549559+0000","last_peered":"2024-04-24T23:58:07.549559+0000","last_clean":"2024-04-24T23:58:07.549559+0000","last_became_active":"2024-04-24T23:58:05.802869+0000","last_became_peered":"2024-04-24T23:58:05.802869+0000","last_unstale":"2024-04-24T23:58:07.549559+0000","last_undegraded":"2024-04-24T23:58:07.549559+0000","last_fullsized":"2024-04-24T23:58:07.549559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548557+0000","last_change":"2024-04-24T23:58:05.796780+0000","last_active":"2024-04-24T23:58:07.548557+0000","last_peered":"2024-04-24T23:58:07.548557+0000","last_clean":"2024-04-24T23:58:07.548557+0000","last_became_active":"2024-04-24T23:58:05.796123+0000","last_became_peered":"2024-04-24T23:58:05.796123+0000","last_unstale":"2024-04-24T23:58:07.548557+0000","last_undegraded":"2024-04-24T23:58:07.548557+0000","last_fullsized":"2024-04-24T23:58:07.548557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552618+0000","last_change":"2024-04-24T23:58:05.798676+0000","last_active":"2024-04-24T23:58:07.552618+0000","last_peered":"2024-04-24T23:58:07.552618+0000","last_clean":"2024-04-24T23:58:07.552618+0000","last_became_active":"2024-04-24T23:58:05.798460+0000","last_became_peered":"2024-04-24T23:58:05.798460+0000","last_unstale":"2024-04-24T23:58:07.552618+0000","last_undegraded":"2024-04-24T23:58:07.552618+0000","last_fullsized":"2024-04-24T23:58:07.552618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:42.009820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780359+0000","last_change":"2024-04-24T23:58:05.790270+0000","last_active":"2024-04-24T23:58:06.780359+0000","last_peered":"2024-04-24T23:58:06.780359+0000","last_clean":"2024-04-24T23:58:06.780359+0000","last_became_active":"2024-04-24T23:58:05.789979+0000","last_became_peered":"2024-04-24T23:58:05.789979+0000","last_unstale":"2024-04-24T23:58:06.780359+0000","last_undegraded":"2024-04-24T23:58:06.780359+0000","last_fullsized":"2024-04-24T23:58:06.780359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781124+0000","last_change":"2024-04-24T23:58:05.793710+0000","last_active":"2024-04-24T23:58:06.781124+0000","last_peered":"2024-04-24T23:58:06.781124+0000","last_clean":"2024-04-24T23:58:06.781124+0000","last_became_active":"2024-04-24T23:58:05.793402+0000","last_became_peered":"2024-04-24T23:58:05.793402+0000","last_unstale":"2024-04-24T23:58:06.781124+0000","last_undegraded":"2024-04-24T23:58:06.781124+0000","last_fullsized":"2024-04-24T23:58:06.781124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782467+0000","last_change":"2024-04-24T23:58:05.768478+0000","last_active":"2024-04-24T23:58:06.782467+0000","last_peered":"2024-04-24T23:58:06.782467+0000","last_clean":"2024-04-24T23:58:06.782467+0000","last_became_active":"2024-04-24T23:58:05.768060+0000","last_became_peered":"2024-04-24T23:58:05.768060+0000","last_unstale":"2024-04-24T23:58:06.782467+0000","last_undegraded":"2024-04-24T23:58:06.782467+0000","last_fullsized":"2024-04-24T23:58:06.782467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:45.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550107+0000","last_change":"2024-04-24T23:58:05.801426+0000","last_active":"2024-04-24T23:58:07.550107+0000","last_peered":"2024-04-24T23:58:07.550107+0000","last_clean":"2024-04-24T23:58:07.550107+0000","last_became_active":"2024-04-24T23:58:05.801082+0000","last_became_peered":"2024-04-24T23:58:05.801082+0000","last_unstale":"2024-04-24T23:58:07.550107+0000","last_undegraded":"2024-04-24T23:58:07.550107+0000","last_fullsized":"2024-04-24T23:58:07.550107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548534+0000","last_change":"2024-04-24T23:58:05.790329+0000","last_active":"2024-04-24T23:58:07.548534+0000","last_peered":"2024-04-24T23:58:07.548534+0000","last_clean":"2024-04-24T23:58:07.548534+0000","last_became_active":"2024-04-24T23:58:05.787856+0000","last_became_peered":"2024-04-24T23:58:05.787856+0000","last_unstale":"2024-04-24T23:58:07.548534+0000","last_undegraded":"2024-04-24T23:58:07.548534+0000","last_fullsized":"2024-04-24T23:58:07.548534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:18.652571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779257+0000","last_change":"2024-04-24T23:58:05.784612+0000","last_active":"2024-04-24T23:58:06.779257+0000","last_peered":"2024-04-24T23:58:06.779257+0000","last_clean":"2024-04-24T23:58:06.779257+0000","last_became_active":"2024-04-24T23:58:05.784318+0000","last_became_peered":"2024-04-24T23:58:05.784318+0000","last_unstale":"2024-04-24T23:58:06.779257+0000","last_undegraded":"2024-04-24T23:58:06.779257+0000","last_fullsized":"2024-04-24T23:58:06.779257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547845+0000","last_change":"2024-04-24T23:58:05.802993+0000","last_active":"2024-04-24T23:58:07.547845+0000","last_peered":"2024-04-24T23:58:07.547845+0000","last_clean":"2024-04-24T23:58:07.547845+0000","last_became_active":"2024-04-24T23:58:05.802728+0000","last_became_peered":"2024-04-24T23:58:05.802728+0000","last_unstale":"2024-04-24T23:58:07.547845+0000","last_undegraded":"2024-04-24T23:58:07.547845+0000","last_fullsized":"2024-04-24T23:58:07.547845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550212+0000","last_change":"2024-04-24T23:58:05.804677+0000","last_active":"2024-04-24T23:58:07.550212+0000","last_peered":"2024-04-24T23:58:07.550212+0000","last_clean":"2024-04-24T23:58:07.550212+0000","last_became_active":"2024-04-24T23:58:05.804348+0000","last_became_peered":"2024-04-24T23:58:05.804348+0000","last_unstale":"2024-04-24T23:58:07.550212+0000","last_undegraded":"2024-04-24T23:58:07.550212+0000","last_fullsized":"2024-04-24T23:58:07.550212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:52.401878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549898+0000","last_change":"2024-04-24T23:58:05.791215+0000","last_active":"2024-04-24T23:58:07.549898+0000","last_peered":"2024-04-24T23:58:07.549898+0000","last_clean":"2024-04-24T23:58:07.549898+0000","last_became_active":"2024-04-24T23:58:05.790911+0000","last_became_peered":"2024-04-24T23:58:05.790911+0000","last_unstale":"2024-04-24T23:58:07.549898+0000","last_undegraded":"2024-04-24T23:58:07.549898+0000","last_fullsized":"2024-04-24T23:58:07.549898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:06.860406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552329+0000","last_change":"2024-04-24T23:58:05.799646+0000","last_active":"2024-04-24T23:58:07.552329+0000","last_peered":"2024-04-24T23:58:07.552329+0000","last_clean":"2024-04-24T23:58:07.552329+0000","last_became_active":"2024-04-24T23:58:05.799361+0000","last_became_peered":"2024-04-24T23:58:05.799361+0000","last_unstale":"2024-04-24T23:58:07.552329+0000","last_undegraded":"2024-04-24T23:58:07.552329+0000","last_fullsized":"2024-04-24T23:58:07.552329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:12.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779220+0000","last_change":"2024-04-24T23:58:05.772550+0000","last_active":"2024-04-24T23:58:06.779220+0000","last_peered":"2024-04-24T23:58:06.779220+0000","last_clean":"2024-04-24T23:58:06.779220+0000","last_became_active":"2024-04-24T23:58:05.772271+0000","last_became_peered":"2024-04-24T23:58:05.772271+0000","last_unstale":"2024-04-24T23:58:06.779220+0000","last_undegraded":"2024-04-24T23:58:06.779220+0000","last_fullsized":"2024-04-24T23:58:06.779220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548310+0000","last_change":"2024-04-24T23:58:05.787389+0000","last_active":"2024-04-24T23:58:07.548310+0000","last_peered":"2024-04-24T23:58:07.548310+0000","last_clean":"2024-04-24T23:58:07.548310+0000","last_became_active":"2024-04-24T23:58:05.786872+0000","last_became_peered":"2024-04-24T23:58:05.786872+0000","last_unstale":"2024-04-24T23:58:07.548310+0000","last_undegraded":"2024-04-24T23:58:07.548310+0000","last_fullsized":"2024-04-24T23:58:07.548310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:31.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548638+0000","last_change":"2024-04-24T23:58:05.798911+0000","last_active":"2024-04-24T23:58:07.548638+0000","last_peered":"2024-04-24T23:58:07.548638+0000","last_clean":"2024-04-24T23:58:07.548638+0000","last_became_active":"2024-04-24T23:58:05.798629+0000","last_became_peered":"2024-04-24T23:58:05.798629+0000","last_unstale":"2024-04-24T23:58:07.548638+0000","last_undegraded":"2024-04-24T23:58:07.548638+0000","last_fullsized":"2024-04-24T23:58:07.548638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551279+0000","last_change":"2024-04-24T23:58:05.788291+0000","last_active":"2024-04-24T23:58:07.551279+0000","last_peered":"2024-04-24T23:58:07.551279+0000","last_clean":"2024-04-24T23:58:07.551279+0000","last_became_active":"2024-04-24T23:58:05.787971+0000","last_became_peered":"2024-04-24T23:58:05.787971+0000","last_unstale":"2024-04-24T23:58:07.551279+0000","last_undegraded":"2024-04-24T23:58:07.551279+0000","last_fullsized":"2024-04-24T23:58:07.551279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548331+0000","last_change":"2024-04-24T23:58:05.786883+0000","last_active":"2024-04-24T23:58:07.548331+0000","last_peered":"2024-04-24T23:58:07.548331+0000","last_clean":"2024-04-24T23:58:07.548331+0000","last_became_active":"2024-04-24T23:58:05.786637+0000","last_became_peered":"2024-04-24T23:58:05.786637+0000","last_unstale":"2024-04-24T23:58:07.548331+0000","last_undegraded":"2024-04-24T23:58:07.548331+0000","last_fullsized":"2024-04-24T23:58:07.548331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552055+0000","last_change":"2024-04-24T23:58:05.797334+0000","last_active":"2024-04-24T23:58:07.552055+0000","last_peered":"2024-04-24T23:58:07.552055+0000","last_clean":"2024-04-24T23:58:07.552055+0000","last_became_active":"2024-04-24T23:58:05.797038+0000","last_became_peered":"2024-04-24T23:58:05.797038+0000","last_unstale":"2024-04-24T23:58:07.552055+0000","last_undegraded":"2024-04-24T23:58:07.552055+0000","last_fullsized":"2024-04-24T23:58:07.552055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780792+0000","last_change":"2024-04-24T23:58:05.786537+0000","last_active":"2024-04-24T23:58:06.780792+0000","last_peered":"2024-04-24T23:58:06.780792+0000","last_clean":"2024-04-24T23:58:06.780792+0000","last_became_active":"2024-04-24T23:58:05.780787+0000","last_became_peered":"2024-04-24T23:58:05.780787+0000","last_unstale":"2024-04-24T23:58:06.780792+0000","last_undegraded":"2024-04-24T23:58:06.780792+0000","last_fullsized":"2024-04-24T23:58:06.780792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780454+0000","last_change":"2024-04-24T23:58:05.797680+0000","last_active":"2024-04-24T23:58:06.780454+0000","last_peered":"2024-04-24T23:58:06.780454+0000","last_clean":"2024-04-24T23:58:06.780454+0000","last_became_active":"2024-04-24T23:58:05.796878+0000","last_became_peered":"2024-04-24T23:58:05.796878+0000","last_unstale":"2024-04-24T23:58:06.780454+0000","last_undegraded":"2024-04-24T23:58:06.780454+0000","last_fullsized":"2024-04-24T23:58:06.780454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551634+0000","last_change":"2024-04-24T23:58:05.794457+0000","last_active":"2024-04-24T23:58:07.551634+0000","last_peered":"2024-04-24T23:58:07.551634+0000","last_clean":"2024-04-24T23:58:07.551634+0000","last_became_active":"2024-04-24T23:58:05.794121+0000","last_became_peered":"2024-04-24T23:58:05.794121+0000","last_unstale":"2024-04-24T23:58:07.551634+0000","last_undegraded":"2024-04-24T23:58:07.551634+0000","last_fullsized":"2024-04-24T23:58:07.551634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548655+0000","last_change":"2024-04-24T23:58:05.787183+0000","last_active":"2024-04-24T23:58:07.548655+0000","last_peered":"2024-04-24T23:58:07.548655+0000","last_clean":"2024-04-24T23:58:07.548655+0000","last_became_active":"2024-04-24T23:58:05.786561+0000","last_became_peered":"2024-04-24T23:58:05.786561+0000","last_unstale":"2024-04-24T23:58:07.548655+0000","last_undegraded":"2024-04-24T23:58:07.548655+0000","last_fullsized":"2024-04-24T23:58:07.548655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:20.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548872+0000","last_change":"2024-04-24T23:58:05.785799+0000","last_active":"2024-04-24T23:58:07.548872+0000","last_peered":"2024-04-24T23:58:07.548872+0000","last_clean":"2024-04-24T23:58:07.548872+0000","last_became_active":"2024-04-24T23:58:05.785513+0000","last_became_peered":"2024-04-24T23:58:05.785513+0000","last_unstale":"2024-04-24T23:58:07.548872+0000","last_undegraded":"2024-04-24T23:58:07.548872+0000","last_fullsized":"2024-04-24T23:58:07.548872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549958+0000","last_change":"2024-04-24T23:58:05.786627+0000","last_active":"2024-04-24T23:58:07.549958+0000","last_peered":"2024-04-24T23:58:07.549958+0000","last_clean":"2024-04-24T23:58:07.549958+0000","last_became_active":"2024-04-24T23:58:05.786354+0000","last_became_peered":"2024-04-24T23:58:05.786354+0000","last_unstale":"2024-04-24T23:58:07.549958+0000","last_undegraded":"2024-04-24T23:58:07.549958+0000","last_fullsized":"2024-04-24T23:58:07.549958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:43.209580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778470+0000","last_change":"2024-04-24T23:58:05.774049+0000","last_active":"2024-04-24T23:58:06.778470+0000","last_peered":"2024-04-24T23:58:06.778470+0000","last_clean":"2024-04-24T23:58:06.778470+0000","last_became_active":"2024-04-24T23:58:05.773704+0000","last_became_peered":"2024-04-24T23:58:05.773704+0000","last_unstale":"2024-04-24T23:58:06.778470+0000","last_undegraded":"2024-04-24T23:58:06.778470+0000","last_fullsized":"2024-04-24T23:58:06.778470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:20.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781658+0000","last_change":"2024-04-24T23:58:05.790510+0000","last_active":"2024-04-24T23:58:06.781658+0000","last_peered":"2024-04-24T23:58:06.781658+0000","last_clean":"2024-04-24T23:58:06.781658+0000","last_became_active":"2024-04-24T23:58:05.790154+0000","last_became_peered":"2024-04-24T23:58:05.790154+0000","last_unstale":"2024-04-24T23:58:06.781658+0000","last_undegraded":"2024-04-24T23:58:06.781658+0000","last_fullsized":"2024-04-24T23:58:06.781658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:19.886869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550429+0000","last_change":"2024-04-24T23:58:04.771651+0000","last_active":"2024-04-24T23:58:07.550429+0000","last_peered":"2024-04-24T23:58:07.550429+0000","last_clean":"2024-04-24T23:58:07.550429+0000","last_became_active":"2024-04-24T23:58:04.771304+0000","last_became_peered":"2024-04-24T23:58:04.771304+0000","last_unstale":"2024-04-24T23:58:07.550429+0000","last_undegraded":"2024-04-24T23:58:07.550429+0000","last_fullsized":"2024-04-24T23:58:07.550429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548744+0000","last_change":"2024-04-24T23:58:05.770296+0000","last_active":"2024-04-24T23:58:07.548744+0000","last_peered":"2024-04-24T23:58:07.548744+0000","last_clean":"2024-04-24T23:58:07.548744+0000","last_became_active":"2024-04-24T23:58:05.769888+0000","last_became_peered":"2024-04-24T23:58:05.769888+0000","last_unstale":"2024-04-24T23:58:07.548744+0000","last_undegraded":"2024-04-24T23:58:07.548744+0000","last_fullsized":"2024-04-24T23:58:07.548744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780802+0000","last_change":"2024-04-24T23:58:04.776522+0000","last_active":"2024-04-24T23:58:06.780802+0000","last_peered":"2024-04-24T23:58:06.780802+0000","last_clean":"2024-04-24T23:58:06.780802+0000","last_became_active":"2024-04-24T23:58:04.776214+0000","last_became_peered":"2024-04-24T23:58:04.776214+0000","last_unstale":"2024-04-24T23:58:06.780802+0000","last_undegraded":"2024-04-24T23:58:06.780802+0000","last_fullsized":"2024-04-24T23:58:06.780802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551072+0000","last_change":"2024-04-24T23:58:04.763540+0000","last_active":"2024-04-24T23:58:07.551072+0000","last_peered":"2024-04-24T23:58:07.551072+0000","last_clean":"2024-04-24T23:58:07.551072+0000","last_became_active":"2024-04-24T23:58:04.763262+0000","last_became_peered":"2024-04-24T23:58:04.763262+0000","last_unstale":"2024-04-24T23:58:07.551072+0000","last_undegraded":"2024-04-24T23:58:07.551072+0000","last_fullsized":"2024-04-24T23:58:07.551072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:33.619150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550335+0000","last_change":"2024-04-24T23:58:05.803405+0000","last_active":"2024-04-24T23:58:07.550335+0000","last_peered":"2024-04-24T23:58:07.550335+0000","last_clean":"2024-04-24T23:58:07.550335+0000","last_became_active":"2024-04-24T23:58:05.802932+0000","last_became_peered":"2024-04-24T23:58:05.802932+0000","last_unstale":"2024-04-24T23:58:07.550335+0000","last_undegraded":"2024-04-24T23:58:07.550335+0000","last_fullsized":"2024-04-24T23:58:07.550335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548491+0000","last_change":"2024-04-24T23:58:04.776492+0000","last_active":"2024-04-24T23:58:07.548491+0000","last_peered":"2024-04-24T23:58:07.548491+0000","last_clean":"2024-04-24T23:58:07.548491+0000","last_became_active":"2024-04-24T23:58:04.776141+0000","last_became_peered":"2024-04-24T23:58:04.776141+0000","last_unstale":"2024-04-24T23:58:07.548491+0000","last_undegraded":"2024-04-24T23:58:07.548491+0000","last_fullsized":"2024-04-24T23:58:07.548491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779315+0000","last_change":"2024-04-24T23:58:05.784472+0000","last_active":"2024-04-24T23:58:06.779315+0000","last_peered":"2024-04-24T23:58:06.779315+0000","last_clean":"2024-04-24T23:58:06.779315+0000","last_became_active":"2024-04-24T23:58:05.784189+0000","last_became_peered":"2024-04-24T23:58:05.784189+0000","last_unstale":"2024-04-24T23:58:06.779315+0000","last_undegraded":"2024-04-24T23:58:06.779315+0000","last_fullsized":"2024-04-24T23:58:06.779315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778959+0000","last_change":"2024-04-24T23:58:04.770884+0000","last_active":"2024-04-24T23:58:06.778959+0000","last_peered":"2024-04-24T23:58:06.778959+0000","last_clean":"2024-04-24T23:58:06.778959+0000","last_became_active":"2024-04-24T23:58:04.770285+0000","last_became_peered":"2024-04-24T23:58:04.770285+0000","last_unstale":"2024-04-24T23:58:06.778959+0000","last_undegraded":"2024-04-24T23:58:06.778959+0000","last_fullsized":"2024-04-24T23:58:06.778959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548778+0000","last_change":"2024-04-24T23:58:05.784538+0000","last_active":"2024-04-24T23:58:07.548778+0000","last_peered":"2024-04-24T23:58:07.548778+0000","last_clean":"2024-04-24T23:58:07.548778+0000","last_became_active":"2024-04-24T23:58:05.784301+0000","last_became_peered":"2024-04-24T23:58:05.784301+0000","last_unstale":"2024-04-24T23:58:07.548778+0000","last_undegraded":"2024-04-24T23:58:07.548778+0000","last_fullsized":"2024-04-24T23:58:07.548778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548917+0000","last_change":"2024-04-24T23:58:04.769622+0000","last_active":"2024-04-24T23:58:07.548917+0000","last_peered":"2024-04-24T23:58:07.548917+0000","last_clean":"2024-04-24T23:58:07.548917+0000","last_became_active":"2024-04-24T23:58:04.769264+0000","last_became_peered":"2024-04-24T23:58:04.769264+0000","last_unstale":"2024-04-24T23:58:07.548917+0000","last_undegraded":"2024-04-24T23:58:07.548917+0000","last_fullsized":"2024-04-24T23:58:07.548917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549427+0000","last_change":"2024-04-24T23:58:05.785033+0000","last_active":"2024-04-24T23:58:07.549427+0000","last_peered":"2024-04-24T23:58:07.549427+0000","last_clean":"2024-04-24T23:58:07.549427+0000","last_became_active":"2024-04-24T23:58:05.784760+0000","last_became_peered":"2024-04-24T23:58:05.784760+0000","last_unstale":"2024-04-24T23:58:07.549427+0000","last_undegraded":"2024-04-24T23:58:07.549427+0000","last_fullsized":"2024-04-24T23:58:07.549427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779774+0000","last_change":"2024-04-24T23:58:04.770638+0000","last_active":"2024-04-24T23:58:06.779774+0000","last_peered":"2024-04-24T23:58:06.779774+0000","last_clean":"2024-04-24T23:58:06.779774+0000","last_became_active":"2024-04-24T23:58:04.770332+0000","last_became_peered":"2024-04-24T23:58:04.770332+0000","last_unstale":"2024-04-24T23:58:06.779774+0000","last_undegraded":"2024-04-24T23:58:06.779774+0000","last_fullsized":"2024-04-24T23:58:06.779774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782618+0000","last_change":"2024-04-24T23:58:05.786124+0000","last_active":"2024-04-24T23:58:06.782618+0000","last_peered":"2024-04-24T23:58:06.782618+0000","last_clean":"2024-04-24T23:58:06.782618+0000","last_became_active":"2024-04-24T23:58:05.785737+0000","last_became_peered":"2024-04-24T23:58:05.785737+0000","last_unstale":"2024-04-24T23:58:06.782618+0000","last_undegraded":"2024-04-24T23:58:06.782618+0000","last_fullsized":"2024-04-24T23:58:06.782618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:48.097493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779149+0000","last_change":"2024-04-24T23:58:04.759666+0000","last_active":"2024-04-24T23:58:06.779149+0000","last_peered":"2024-04-24T23:58:06.779149+0000","last_clean":"2024-04-24T23:58:06.779149+0000","last_became_active":"2024-04-24T23:58:04.759342+0000","last_became_peered":"2024-04-24T23:58:04.759342+0000","last_unstale":"2024-04-24T23:58:06.779149+0000","last_undegraded":"2024-04-24T23:58:06.779149+0000","last_fullsized":"2024-04-24T23:58:06.779149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551828+0000","last_change":"2024-04-24T23:58:05.793926+0000","last_active":"2024-04-24T23:58:07.551828+0000","last_peered":"2024-04-24T23:58:07.551828+0000","last_clean":"2024-04-24T23:58:07.551828+0000","last_became_active":"2024-04-24T23:58:05.792484+0000","last_became_peered":"2024-04-24T23:58:05.792484+0000","last_unstale":"2024-04-24T23:58:07.551828+0000","last_undegraded":"2024-04-24T23:58:07.551828+0000","last_fullsized":"2024-04-24T23:58:07.551828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:11.381479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548797+0000","last_change":"2024-04-24T23:58:04.776767+0000","last_active":"2024-04-24T23:58:07.548797+0000","last_peered":"2024-04-24T23:58:07.548797+0000","last_clean":"2024-04-24T23:58:07.548797+0000","last_became_active":"2024-04-24T23:58:04.776452+0000","last_became_peered":"2024-04-24T23:58:04.776452+0000","last_unstale":"2024-04-24T23:58:07.548797+0000","last_undegraded":"2024-04-24T23:58:07.548797+0000","last_fullsized":"2024-04-24T23:58:07.548797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:07:03.630911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549293+0000","last_change":"2024-04-24T23:58:05.790152+0000","last_active":"2024-04-24T23:58:07.549293+0000","last_peered":"2024-04-24T23:58:07.549293+0000","last_clean":"2024-04-24T23:58:07.549293+0000","last_became_active":"2024-04-24T23:58:05.789858+0000","last_became_peered":"2024-04-24T23:58:05.789858+0000","last_unstale":"2024-04-24T23:58:07.549293+0000","last_undegraded":"2024-04-24T23:58:07.549293+0000","last_fullsized":"2024-04-24T23:58:07.549293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548956+0000","last_change":"2024-04-24T23:58:04.771292+0000","last_active":"2024-04-24T23:58:07.548956+0000","last_peered":"2024-04-24T23:58:07.548956+0000","last_clean":"2024-04-24T23:58:07.548956+0000","last_became_active":"2024-04-24T23:58:04.770724+0000","last_became_peered":"2024-04-24T23:58:04.770724+0000","last_unstale":"2024-04-24T23:58:07.548956+0000","last_undegraded":"2024-04-24T23:58:07.548956+0000","last_fullsized":"2024-04-24T23:58:07.548956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548794+0000","last_change":"2024-04-24T23:58:05.802304+0000","last_active":"2024-04-24T23:58:07.548794+0000","last_peered":"2024-04-24T23:58:07.548794+0000","last_clean":"2024-04-24T23:58:07.548794+0000","last_became_active":"2024-04-24T23:58:05.799845+0000","last_became_peered":"2024-04-24T23:58:05.799845+0000","last_unstale":"2024-04-24T23:58:07.548794+0000","last_undegraded":"2024-04-24T23:58:07.548794+0000","last_fullsized":"2024-04-24T23:58:07.548794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778378+0000","last_change":"2024-04-24T23:58:04.765718+0000","last_active":"2024-04-24T23:58:06.778378+0000","last_peered":"2024-04-24T23:58:06.778378+0000","last_clean":"2024-04-24T23:58:06.778378+0000","last_became_active":"2024-04-24T23:58:04.765445+0000","last_became_peered":"2024-04-24T23:58:04.765445+0000","last_unstale":"2024-04-24T23:58:06.778378+0000","last_undegraded":"2024-04-24T23:58:06.778378+0000","last_fullsized":"2024-04-24T23:58:06.778378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780131+0000","last_change":"2024-04-24T23:58:05.775138+0000","last_active":"2024-04-24T23:58:06.780131+0000","last_peered":"2024-04-24T23:58:06.780131+0000","last_clean":"2024-04-24T23:58:06.780131+0000","last_became_active":"2024-04-24T23:58:05.774820+0000","last_became_peered":"2024-04-24T23:58:05.774820+0000","last_unstale":"2024-04-24T23:58:06.780131+0000","last_undegraded":"2024-04-24T23:58:06.780131+0000","last_fullsized":"2024-04-24T23:58:06.780131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547528+0000","last_change":"2024-04-24T23:58:04.756238+0000","last_active":"2024-04-24T23:58:07.547528+0000","last_peered":"2024-04-24T23:58:07.547528+0000","last_clean":"2024-04-24T23:58:07.547528+0000","last_became_active":"2024-04-24T23:58:04.755948+0000","last_became_peered":"2024-04-24T23:58:04.755948+0000","last_unstale":"2024-04-24T23:58:07.547528+0000","last_undegraded":"2024-04-24T23:58:07.547528+0000","last_fullsized":"2024-04-24T23:58:07.547528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549775+0000","last_change":"2024-04-24T23:58:05.792006+0000","last_active":"2024-04-24T23:58:07.549775+0000","last_peered":"2024-04-24T23:58:07.549775+0000","last_clean":"2024-04-24T23:58:07.549775+0000","last_became_active":"2024-04-24T23:58:05.791717+0000","last_became_peered":"2024-04-24T23:58:05.791717+0000","last_unstale":"2024-04-24T23:58:07.549775+0000","last_undegraded":"2024-04-24T23:58:07.549775+0000","last_fullsized":"2024-04-24T23:58:07.549775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782855+0000","last_change":"2024-04-24T23:58:04.762742+0000","last_active":"2024-04-24T23:58:06.782855+0000","last_peered":"2024-04-24T23:58:06.782855+0000","last_clean":"2024-04-24T23:58:06.782855+0000","last_became_active":"2024-04-24T23:58:04.757739+0000","last_became_peered":"2024-04-24T23:58:04.757739+0000","last_unstale":"2024-04-24T23:58:06.782855+0000","last_undegraded":"2024-04-24T23:58:06.782855+0000","last_fullsized":"2024-04-24T23:58:06.782855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:32:19.430261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552485+0000","last_change":"2024-04-24T23:58:05.804538+0000","last_active":"2024-04-24T23:58:07.552485+0000","last_peered":"2024-04-24T23:58:07.552485+0000","last_clean":"2024-04-24T23:58:07.552485+0000","last_became_active":"2024-04-24T23:58:05.804208+0000","last_became_peered":"2024-04-24T23:58:05.804208+0000","last_unstale":"2024-04-24T23:58:07.552485+0000","last_undegraded":"2024-04-24T23:58:07.552485+0000","last_fullsized":"2024-04-24T23:58:07.552485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.648636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549908+0000","last_change":"2024-04-24T23:58:04.760983+0000","last_active":"2024-04-24T23:58:07.549908+0000","last_peered":"2024-04-24T23:58:07.549908+0000","last_clean":"2024-04-24T23:58:07.549908+0000","last_became_active":"2024-04-24T23:58:04.760235+0000","last_became_peered":"2024-04-24T23:58:04.760235+0000","last_unstale":"2024-04-24T23:58:07.549908+0000","last_undegraded":"2024-04-24T23:58:07.549908+0000","last_fullsized":"2024-04-24T23:58:07.549908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552862+0000","last_change":"2024-04-24T23:58:05.803645+0000","last_active":"2024-04-24T23:58:07.552862+0000","last_peered":"2024-04-24T23:58:07.552862+0000","last_clean":"2024-04-24T23:58:07.552862+0000","last_became_active":"2024-04-24T23:58:05.803374+0000","last_became_peered":"2024-04-24T23:58:05.803374+0000","last_unstale":"2024-04-24T23:58:07.552862+0000","last_undegraded":"2024-04-24T23:58:07.552862+0000","last_fullsized":"2024-04-24T23:58:07.552862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:04:24.025118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780094+0000","last_change":"2024-04-24T23:58:04.773468+0000","last_active":"2024-04-24T23:58:06.780094+0000","last_peered":"2024-04-24T23:58:06.780094+0000","last_clean":"2024-04-24T23:58:06.780094+0000","last_became_active":"2024-04-24T23:58:04.773164+0000","last_became_peered":"2024-04-24T23:58:04.773164+0000","last_unstale":"2024-04-24T23:58:06.780094+0000","last_undegraded":"2024-04-24T23:58:06.780094+0000","last_fullsized":"2024-04-24T23:58:06.780094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549683+0000","last_change":"2024-04-24T23:58:05.796911+0000","last_active":"2024-04-24T23:58:07.549683+0000","last_peered":"2024-04-24T23:58:07.549683+0000","last_clean":"2024-04-24T23:58:07.549683+0000","last_became_active":"2024-04-24T23:58:05.796117+0000","last_became_peered":"2024-04-24T23:58:05.796117+0000","last_unstale":"2024-04-24T23:58:07.549683+0000","last_undegraded":"2024-04-24T23:58:07.549683+0000","last_fullsized":"2024-04-24T23:58:07.549683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:12.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550141+0000","last_change":"2024-04-24T23:58:04.772549+0000","last_active":"2024-04-24T23:58:07.550141+0000","last_peered":"2024-04-24T23:58:07.550141+0000","last_clean":"2024-04-24T23:58:07.550141+0000","last_became_active":"2024-04-24T23:58:04.771951+0000","last_became_peered":"2024-04-24T23:58:04.771951+0000","last_unstale":"2024-04-24T23:58:07.550141+0000","last_undegraded":"2024-04-24T23:58:07.550141+0000","last_fullsized":"2024-04-24T23:58:07.550141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:16:27.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551720+0000","last_change":"2024-04-24T23:58:05.793353+0000","last_active":"2024-04-24T23:58:07.551720+0000","last_peered":"2024-04-24T23:58:07.551720+0000","last_clean":"2024-04-24T23:58:07.551720+0000","last_became_active":"2024-04-24T23:58:05.793021+0000","last_became_peered":"2024-04-24T23:58:05.793021+0000","last_unstale":"2024-04-24T23:58:07.551720+0000","last_undegraded":"2024-04-24T23:58:07.551720+0000","last_fullsized":"2024-04-24T23:58:07.551720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:00.726837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547872+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:58:07.547872+0000","last_peered":"2024-04-24T23:58:07.547872+0000","last_clean":"2024-04-24T23:58:07.547872+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:58:07.547872+0000","last_undegraded":"2024-04-24T23:58:07.547872+0000","last_fullsized":"2024-04-24T23:58:07.547872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547780+0000","last_change":"2024-04-24T23:58:04.772159+0000","last_active":"2024-04-24T23:58:07.547780+0000","last_peered":"2024-04-24T23:58:07.547780+0000","last_clean":"2024-04-24T23:58:07.547780+0000","last_became_active":"2024-04-24T23:58:04.771791+0000","last_became_peered":"2024-04-24T23:58:04.771791+0000","last_unstale":"2024-04-24T23:58:07.547780+0000","last_undegraded":"2024-04-24T23:58:07.547780+0000","last_fullsized":"2024-04-24T23:58:07.547780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:16:27.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549665+0000","last_change":"2024-04-24T23:58:05.798331+0000","last_active":"2024-04-24T23:58:07.549665+0000","last_peered":"2024-04-24T23:58:07.549665+0000","last_clean":"2024-04-24T23:58:07.549665+0000","last_became_active":"2024-04-24T23:58:05.797998+0000","last_became_peered":"2024-04-24T23:58:05.797998+0000","last_unstale":"2024-04-24T23:58:07.549665+0000","last_undegraded":"2024-04-24T23:58:07.549665+0000","last_fullsized":"2024-04-24T23:58:07.549665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547517+0000","last_change":"2024-04-24T23:58:04.774140+0000","last_active":"2024-04-24T23:58:07.547517+0000","last_peered":"2024-04-24T23:58:07.547517+0000","last_clean":"2024-04-24T23:58:07.547517+0000","last_became_active":"2024-04-24T23:58:04.773822+0000","last_became_peered":"2024-04-24T23:58:04.773822+0000","last_unstale":"2024-04-24T23:58:07.547517+0000","last_undegraded":"2024-04-24T23:58:07.547517+0000","last_fullsized":"2024-04-24T23:58:07.547517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548141+0000","last_change":"2024-04-24T23:58:05.770614+0000","last_active":"2024-04-24T23:58:07.548141+0000","last_peered":"2024-04-24T23:58:07.548141+0000","last_clean":"2024-04-24T23:58:07.548141+0000","last_became_active":"2024-04-24T23:58:05.770229+0000","last_became_peered":"2024-04-24T23:58:05.770229+0000","last_unstale":"2024-04-24T23:58:07.548141+0000","last_undegraded":"2024-04-24T23:58:07.548141+0000","last_fullsized":"2024-04-24T23:58:07.548141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.247528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550130+0000","last_change":"2024-04-24T23:58:04.754168+0000","last_active":"2024-04-24T23:58:07.550130+0000","last_peered":"2024-04-24T23:58:07.550130+0000","last_clean":"2024-04-24T23:58:07.550130+0000","last_became_active":"2024-04-24T23:58:04.753801+0000","last_became_peered":"2024-04-24T23:58:04.753801+0000","last_unstale":"2024-04-24T23:58:07.550130+0000","last_undegraded":"2024-04-24T23:58:07.550130+0000","last_fullsized":"2024-04-24T23:58:07.550130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779072+0000","last_change":"2024-04-24T23:58:05.797159+0000","last_active":"2024-04-24T23:58:06.779072+0000","last_peered":"2024-04-24T23:58:06.779072+0000","last_clean":"2024-04-24T23:58:06.779072+0000","last_became_active":"2024-04-24T23:58:05.796588+0000","last_became_peered":"2024-04-24T23:58:05.796588+0000","last_unstale":"2024-04-24T23:58:06.779072+0000","last_undegraded":"2024-04-24T23:58:06.779072+0000","last_fullsized":"2024-04-24T23:58:06.779072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549111+0000","last_change":"2024-04-24T23:58:04.771298+0000","last_active":"2024-04-24T23:58:07.549111+0000","last_peered":"2024-04-24T23:58:07.549111+0000","last_clean":"2024-04-24T23:58:07.549111+0000","last_became_active":"2024-04-24T23:58:04.770304+0000","last_became_peered":"2024-04-24T23:58:04.770304+0000","last_unstale":"2024-04-24T23:58:07.549111+0000","last_undegraded":"2024-04-24T23:58:07.549111+0000","last_fullsized":"2024-04-24T23:58:07.549111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782155+0000","last_change":"2024-04-24T23:58:05.776073+0000","last_active":"2024-04-24T23:58:06.782155+0000","last_peered":"2024-04-24T23:58:06.782155+0000","last_clean":"2024-04-24T23:58:06.782155+0000","last_became_active":"2024-04-24T23:58:05.775750+0000","last_became_peered":"2024-04-24T23:58:05.775750+0000","last_unstale":"2024-04-24T23:58:06.782155+0000","last_undegraded":"2024-04-24T23:58:06.782155+0000","last_fullsized":"2024-04-24T23:58:06.782155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:39.153771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779645+0000","last_change":"2024-04-24T23:58:04.758156+0000","last_active":"2024-04-24T23:58:06.779645+0000","last_peered":"2024-04-24T23:58:06.779645+0000","last_clean":"2024-04-24T23:58:06.779645+0000","last_became_active":"2024-04-24T23:58:04.757677+0000","last_became_peered":"2024-04-24T23:58:04.757677+0000","last_unstale":"2024-04-24T23:58:06.779645+0000","last_undegraded":"2024-04-24T23:58:06.779645+0000","last_fullsized":"2024-04-24T23:58:06.779645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:05.846034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549139+0000","last_change":"2024-04-24T23:58:05.796265+0000","last_active":"2024-04-24T23:58:07.549139+0000","last_peered":"2024-04-24T23:58:07.549139+0000","last_clean":"2024-04-24T23:58:07.549139+0000","last_became_active":"2024-04-24T23:58:05.795946+0000","last_became_peered":"2024-04-24T23:58:05.795946+0000","last_unstale":"2024-04-24T23:58:07.549139+0000","last_undegraded":"2024-04-24T23:58:07.549139+0000","last_fullsized":"2024-04-24T23:58:07.549139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:11.381479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551980+0000","last_change":"2024-04-24T23:58:04.779614+0000","last_active":"2024-04-24T23:58:07.551980+0000","last_peered":"2024-04-24T23:58:07.551980+0000","last_clean":"2024-04-24T23:58:07.551980+0000","last_became_active":"2024-04-24T23:58:04.779349+0000","last_became_peered":"2024-04-24T23:58:04.779349+0000","last_unstale":"2024-04-24T23:58:07.551980+0000","last_undegraded":"2024-04-24T23:58:07.551980+0000","last_fullsized":"2024-04-24T23:58:07.551980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:03.060917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779784+0000","last_change":"2024-04-24T23:58:05.797066+0000","last_active":"2024-04-24T23:58:06.779784+0000","last_peered":"2024-04-24T23:58:06.779784+0000","last_clean":"2024-04-24T23:58:06.779784+0000","last_became_active":"2024-04-24T23:58:05.796781+0000","last_became_peered":"2024-04-24T23:58:05.796781+0000","last_unstale":"2024-04-24T23:58:06.779784+0000","last_undegraded":"2024-04-24T23:58:06.779784+0000","last_fullsized":"2024-04-24T23:58:06.779784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779750+0000","last_change":"2024-04-24T23:58:04.762718+0000","last_active":"2024-04-24T23:58:06.779750+0000","last_peered":"2024-04-24T23:58:06.779750+0000","last_clean":"2024-04-24T23:58:06.779750+0000","last_became_active":"2024-04-24T23:58:04.762332+0000","last_became_peered":"2024-04-24T23:58:04.762332+0000","last_unstale":"2024-04-24T23:58:06.779750+0000","last_undegraded":"2024-04-24T23:58:06.779750+0000","last_fullsized":"2024-04-24T23:58:06.779750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:42.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552274+0000","last_change":"2024-04-24T23:58:05.804598+0000","last_active":"2024-04-24T23:58:07.552274+0000","last_peered":"2024-04-24T23:58:07.552274+0000","last_clean":"2024-04-24T23:58:07.552274+0000","last_became_active":"2024-04-24T23:58:05.804304+0000","last_became_peered":"2024-04-24T23:58:05.804304+0000","last_unstale":"2024-04-24T23:58:07.552274+0000","last_undegraded":"2024-04-24T23:58:07.552274+0000","last_fullsized":"2024-04-24T23:58:07.552274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778978+0000","last_change":"2024-04-24T23:58:04.771715+0000","last_active":"2024-04-24T23:58:06.778978+0000","last_peered":"2024-04-24T23:58:06.778978+0000","last_clean":"2024-04-24T23:58:06.778978+0000","last_became_active":"2024-04-24T23:58:04.771411+0000","last_became_peered":"2024-04-24T23:58:04.771411+0000","last_unstale":"2024-04-24T23:58:06.778978+0000","last_undegraded":"2024-04-24T23:58:06.778978+0000","last_fullsized":"2024-04-24T23:58:06.778978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549805+0000","last_change":"2024-04-24T23:58:05.790643+0000","last_active":"2024-04-24T23:58:07.549805+0000","last_peered":"2024-04-24T23:58:07.549805+0000","last_clean":"2024-04-24T23:58:07.549805+0000","last_became_active":"2024-04-24T23:58:05.789742+0000","last_became_peered":"2024-04-24T23:58:05.789742+0000","last_unstale":"2024-04-24T23:58:07.549805+0000","last_undegraded":"2024-04-24T23:58:07.549805+0000","last_fullsized":"2024-04-24T23:58:07.549805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547503+0000","last_change":"2024-04-24T23:58:04.778586+0000","last_active":"2024-04-24T23:58:07.547503+0000","last_peered":"2024-04-24T23:58:07.547503+0000","last_clean":"2024-04-24T23:58:07.547503+0000","last_became_active":"2024-04-24T23:58:04.778296+0000","last_became_peered":"2024-04-24T23:58:04.778296+0000","last_unstale":"2024-04-24T23:58:07.547503+0000","last_undegraded":"2024-04-24T23:58:07.547503+0000","last_fullsized":"2024-04-24T23:58:07.547503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781615+0000","last_change":"2024-04-24T23:58:05.793469+0000","last_active":"2024-04-24T23:58:06.781615+0000","last_peered":"2024-04-24T23:58:06.781615+0000","last_clean":"2024-04-24T23:58:06.781615+0000","last_became_active":"2024-04-24T23:58:05.793129+0000","last_became_peered":"2024-04-24T23:58:05.793129+0000","last_unstale":"2024-04-24T23:58:06.781615+0000","last_undegraded":"2024-04-24T23:58:06.781615+0000","last_fullsized":"2024-04-24T23:58:06.781615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:23.767095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779337+0000","last_change":"2024-04-24T23:58:04.769158+0000","last_active":"2024-04-24T23:58:06.779337+0000","last_peered":"2024-04-24T23:58:06.779337+0000","last_clean":"2024-04-24T23:58:06.779337+0000","last_became_active":"2024-04-24T23:58:04.768707+0000","last_became_peered":"2024-04-24T23:58:04.768707+0000","last_unstale":"2024-04-24T23:58:06.779337+0000","last_undegraded":"2024-04-24T23:58:06.779337+0000","last_fullsized":"2024-04-24T23:58:06.779337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550571+0000","last_change":"2024-04-24T23:58:05.797038+0000","last_active":"2024-04-24T23:58:07.550571+0000","last_peered":"2024-04-24T23:58:07.550571+0000","last_clean":"2024-04-24T23:58:07.550571+0000","last_became_active":"2024-04-24T23:58:05.796524+0000","last_became_peered":"2024-04-24T23:58:05.796524+0000","last_unstale":"2024-04-24T23:58:07.550571+0000","last_undegraded":"2024-04-24T23:58:07.550571+0000","last_fullsized":"2024-04-24T23:58:07.550571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779397+0000","last_change":"2024-04-24T23:58:04.767745+0000","last_active":"2024-04-24T23:58:06.779397+0000","last_peered":"2024-04-24T23:58:06.779397+0000","last_clean":"2024-04-24T23:58:06.779397+0000","last_became_active":"2024-04-24T23:58:04.767416+0000","last_became_peered":"2024-04-24T23:58:04.767416+0000","last_unstale":"2024-04-24T23:58:06.779397+0000","last_undegraded":"2024-04-24T23:58:06.779397+0000","last_fullsized":"2024-04-24T23:58:06.779397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:47.083120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550336+0000","last_change":"2024-04-24T23:58:05.792064+0000","last_active":"2024-04-24T23:58:07.550336+0000","last_peered":"2024-04-24T23:58:07.550336+0000","last_clean":"2024-04-24T23:58:07.550336+0000","last_became_active":"2024-04-24T23:58:05.790769+0000","last_became_peered":"2024-04-24T23:58:05.790769+0000","last_unstale":"2024-04-24T23:58:07.550336+0000","last_undegraded":"2024-04-24T23:58:07.550336+0000","last_fullsized":"2024-04-24T23:58:07.550336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549106+0000","last_change":"2024-04-24T23:58:04.778697+0000","last_active":"2024-04-24T23:58:07.549106+0000","last_peered":"2024-04-24T23:58:07.549106+0000","last_clean":"2024-04-24T23:58:07.549106+0000","last_became_active":"2024-04-24T23:58:04.778416+0000","last_became_peered":"2024-04-24T23:58:04.778416+0000","last_unstale":"2024-04-24T23:58:07.549106+0000","last_undegraded":"2024-04-24T23:58:07.549106+0000","last_fullsized":"2024-04-24T23:58:07.549106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:05.846034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780654+0000","last_change":"2024-04-24T23:58:05.771222+0000","last_active":"2024-04-24T23:58:06.780654+0000","last_peered":"2024-04-24T23:58:06.780654+0000","last_clean":"2024-04-24T23:58:06.780654+0000","last_became_active":"2024-04-24T23:58:05.769336+0000","last_became_peered":"2024-04-24T23:58:05.769336+0000","last_unstale":"2024-04-24T23:58:06.780654+0000","last_undegraded":"2024-04-24T23:58:06.780654+0000","last_fullsized":"2024-04-24T23:58:06.780654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548707+0000","last_change":"2024-04-24T23:58:05.788629+0000","last_active":"2024-04-24T23:58:07.548707+0000","last_peered":"2024-04-24T23:58:07.548707+0000","last_clean":"2024-04-24T23:58:07.548707+0000","last_became_active":"2024-04-24T23:58:05.788319+0000","last_became_peered":"2024-04-24T23:58:05.788319+0000","last_unstale":"2024-04-24T23:58:07.548707+0000","last_undegraded":"2024-04-24T23:58:07.548707+0000","last_fullsized":"2024-04-24T23:58:07.548707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551482+0000","last_change":"2024-04-24T23:58:04.777211+0000","last_active":"2024-04-24T23:58:07.551482+0000","last_peered":"2024-04-24T23:58:07.551482+0000","last_clean":"2024-04-24T23:58:07.551482+0000","last_became_active":"2024-04-24T23:58:04.776698+0000","last_became_peered":"2024-04-24T23:58:04.776698+0000","last_unstale":"2024-04-24T23:58:07.551482+0000","last_undegraded":"2024-04-24T23:58:07.551482+0000","last_fullsized":"2024-04-24T23:58:07.551482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:47.083120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549778+0000","last_change":"2024-04-24T23:58:05.792287+0000","last_active":"2024-04-24T23:58:07.549778+0000","last_peered":"2024-04-24T23:58:07.549778+0000","last_clean":"2024-04-24T23:58:07.549778+0000","last_became_active":"2024-04-24T23:58:05.791111+0000","last_became_peered":"2024-04-24T23:58:05.791111+0000","last_unstale":"2024-04-24T23:58:07.549778+0000","last_undegraded":"2024-04-24T23:58:07.549778+0000","last_fullsized":"2024-04-24T23:58:07.549778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.648636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551807+0000","last_change":"2024-04-24T23:58:04.777424+0000","last_active":"2024-04-24T23:58:07.551807+0000","last_peered":"2024-04-24T23:58:07.551807+0000","last_clean":"2024-04-24T23:58:07.551807+0000","last_became_active":"2024-04-24T23:58:04.777129+0000","last_became_peered":"2024-04-24T23:58:04.777129+0000","last_unstale":"2024-04-24T23:58:07.551807+0000","last_undegraded":"2024-04-24T23:58:07.551807+0000","last_fullsized":"2024-04-24T23:58:07.551807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:42.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549197+0000","last_change":"2024-04-24T23:58:05.783822+0000","last_active":"2024-04-24T23:58:07.549197+0000","last_peered":"2024-04-24T23:58:07.549197+0000","last_clean":"2024-04-24T23:58:07.549197+0000","last_became_active":"2024-04-24T23:58:05.783517+0000","last_became_peered":"2024-04-24T23:58:05.783517+0000","last_unstale":"2024-04-24T23:58:07.549197+0000","last_undegraded":"2024-04-24T23:58:07.549197+0000","last_fullsized":"2024-04-24T23:58:07.549197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551826+0000","last_change":"2024-04-24T23:58:04.760821+0000","last_active":"2024-04-24T23:58:07.551826+0000","last_peered":"2024-04-24T23:58:07.551826+0000","last_clean":"2024-04-24T23:58:07.551826+0000","last_became_active":"2024-04-24T23:58:04.760384+0000","last_became_peered":"2024-04-24T23:58:04.760384+0000","last_unstale":"2024-04-24T23:58:07.551826+0000","last_undegraded":"2024-04-24T23:58:07.551826+0000","last_fullsized":"2024-04-24T23:58:07.551826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551776+0000","last_change":"2024-04-24T23:58:05.800284+0000","last_active":"2024-04-24T23:58:07.551776+0000","last_peered":"2024-04-24T23:58:07.551776+0000","last_clean":"2024-04-24T23:58:07.551776+0000","last_became_active":"2024-04-24T23:58:05.799756+0000","last_became_peered":"2024-04-24T23:58:05.799756+0000","last_unstale":"2024-04-24T23:58:07.551776+0000","last_undegraded":"2024-04-24T23:58:07.551776+0000","last_fullsized":"2024-04-24T23:58:07.551776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549323+0000","last_change":"2024-04-24T23:58:04.770489+0000","last_active":"2024-04-24T23:58:07.549323+0000","last_peered":"2024-04-24T23:58:07.549323+0000","last_clean":"2024-04-24T23:58:07.549323+0000","last_became_active":"2024-04-24T23:58:04.770181+0000","last_became_peered":"2024-04-24T23:58:04.770181+0000","last_unstale":"2024-04-24T23:58:07.549323+0000","last_undegraded":"2024-04-24T23:58:07.549323+0000","last_fullsized":"2024-04-24T23:58:07.549323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:44.729552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:58:10.437 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:58:10.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.676+0000 7fce84000640 1 Processor -- start 2024-04-24T23:58:10.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.676+0000 7fce84000640 1 -- start start 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.678+0000 7fce84000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c15c230 0x7fce7c071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.678+0000 7fce84000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fce7c0acda0 0x7fce7c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.678+0000 7fce84000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce7c160b20 con 0x7fce7c0aef50 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.678+0000 7fce84000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fce7c15c610 con 0x7fce7c0acda0 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.678+0000 7fce84000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c0ad200 con 0x7fce7c15c230 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.678+0000 7fce80c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fce7c0acda0 0x7fce7c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.678+0000 7fce80c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fce7c0acda0 0x7fce7c0aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58804/0 (socket says 172.21.15.96:58804) 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.678+0000 7fce80c00640 1 -- 172.21.15.96:0/1122309648 learned_addr learned my addr 172.21.15.96:0/1122309648 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.678+0000 7fce81600640 1 --2- 172.21.15.96:0/1122309648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c15c230 0x7fce7c071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.679+0000 7fce80c00640 1 -- 172.21.15.96:0/1122309648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c15c230 msgr2=0x7fce7c071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:10.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.679+0000 7fce80c00640 1 --2- 172.21.15.96:0/1122309648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c15c230 0x7fce7c071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.679+0000 7fce80c00640 1 -- 172.21.15.96:0/1122309648 >> v1:172.21.15.96:6789/0 conn(0x7fce7c0aef50 legacy=0x7fce7c0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.679+0000 7fce80c00640 1 -- 172.21.15.96:0/1122309648 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c15fd60 con 0x7fce7c0acda0 2024-04-24T23:58:10.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.680+0000 7fce80c00640 1 --2- 172.21.15.96:0/1122309648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0acda0 0x7fce7c0aea10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce68009870 tx=0x7fce6802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8714c498acd1840 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:10.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.680+0000 7fce7be00640 1 -- 172.21.15.96:0/1122309648 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68037070 con 0x7fce7c0acda0 2024-04-24T23:58:10.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.680+0000 7fce7be00640 1 -- 172.21.15.96:0/1122309648 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce68032440 con 0x7fce7c0acda0 2024-04-24T23:58:10.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.680+0000 7fce7be00640 1 -- 172.21.15.96:0/1122309648 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68032810 con 0x7fce7c0acda0 2024-04-24T23:58:10.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.681+0000 7fce84000640 1 -- 172.21.15.96:0/1122309648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0acda0 msgr2=0x7fce7c0aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.681+0000 7fce84000640 1 --2- 172.21.15.96:0/1122309648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0acda0 0x7fce7c0aea10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce68009870 tx=0x7fce6802a250 comp rx=0 tx=0).stop 2024-04-24T23:58:10.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.681+0000 7fce84000640 1 -- 172.21.15.96:0/1122309648 shutdown_connections 2024-04-24T23:58:10.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.681+0000 7fce84000640 1 --2- 172.21.15.96:0/1122309648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0acda0 0x7fce7c0aea10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.681+0000 7fce84000640 1 --2- 172.21.15.96:0/1122309648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c15c230 0x7fce7c071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.681+0000 7fce84000640 1 -- 172.21.15.96:0/1122309648 >> 172.21.15.96:0/1122309648 conn(0x7fce7c0b19c0 msgr2=0x7fce7c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:10.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.681+0000 7fce84000640 1 -- 172.21.15.96:0/1122309648 shutdown_connections 2024-04-24T23:58:10.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.681+0000 7fce84000640 1 -- 172.21.15.96:0/1122309648 wait complete. 2024-04-24T23:58:10.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.682+0000 7fce84000640 1 Processor -- start 2024-04-24T23:58:10.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.683+0000 7fce84000640 1 -- start start 2024-04-24T23:58:10.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.683+0000 7fce84000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce7c0acda0 0x7fce7c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.683+0000 7fce84000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c0aef50 0x7fce7c0b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.683+0000 7fce84000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c15c230 0x7fce7c1f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.683+0000 7fce84000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c160600 con 0x7fce7c15c230 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.683+0000 7fce84000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c160320 con 0x7fce7c0acda0 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.683+0000 7fce84000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c0af3e0 con 0x7fce7c0aef50 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce82000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c15c230 0x7fce7c1f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce82000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c15c230 0x7fce7c1f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58810/0 (socket says 172.21.15.96:58810) 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce82000640 1 -- 172.21.15.96:0/4011447454 learned_addr learned my addr 172.21.15.96:0/4011447454 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce81600640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce7c0acda0 0x7fce7c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce82000640 1 -- 172.21.15.96:0/4011447454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c0aef50 msgr2=0x7fce7c0b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce80c00640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c0aef50 0x7fce7c0b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce82000640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c0aef50 0x7fce7c0b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce82000640 1 -- 172.21.15.96:0/4011447454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce7c0acda0 msgr2=0x7fce7c155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce82000640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce7c0acda0 0x7fce7c155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce82000640 1 -- 172.21.15.96:0/4011447454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c09bd60 con 0x7fce7c15c230 2024-04-24T23:58:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce81600640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce7c0acda0 0x7fce7c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.684+0000 7fce82000640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c15c230 0x7fce7c1f3e20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c730 tx=0x7fce7400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.685+0000 7fce79600640 1 -- 172.21.15.96:0/4011447454 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74003b70 con 0x7fce7c15c230 2024-04-24T23:58:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.685+0000 7fce79600640 1 -- 172.21.15.96:0/4011447454 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce74003d30 con 0x7fce7c15c230 2024-04-24T23:58:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.685+0000 7fce79600640 1 -- 172.21.15.96:0/4011447454 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74005310 con 0x7fce7c15c230 2024-04-24T23:58:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.685+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7c09c040 con 0x7fce7c15c230 2024-04-24T23:58:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.685+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7c09c600 con 0x7fce7c15c230 2024-04-24T23:58:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.686+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce7c069110 con 0x7fce7c15c230 2024-04-24T23:58:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.687+0000 7fce79600640 1 -- 172.21.15.96:0/4011447454 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce740056c0 con 0x7fce7c15c230 2024-04-24T23:58:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.688+0000 7fce79600640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fce5c06be60 0x7fce5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.688+0000 7fce79600640 1 -- 172.21.15.96:0/4011447454 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fce7408ae80 con 0x7fce7c15c230 2024-04-24T23:58:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.688+0000 7fce81600640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fce5c06be60 0x7fce5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:10.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.689+0000 7fce81600640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fce5c06be60 0x7fce5c06e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce70006fd0 tx=0x7fce70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:10.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.692+0000 7fce79600640 1 -- 172.21.15.96:0/4011447454 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fce74059820 con 0x7fce7c15c230 2024-04-24T23:58:10.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.890+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce7c0008d0 con 0x7fce5c06be60 2024-04-24T23:58:10.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.900+0000 7fce79600640 1 -- 172.21.15.96:0/4011447454 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7fce7c0008d0 con 0x7fce5c06be60 2024-04-24T23:58:10.904 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-24T23:58:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.906+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fce5c06be60 msgr2=0x7fce5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.906+0000 7fce84000640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fce5c06be60 0x7fce5c06e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce70006fd0 tx=0x7fce70008040 comp rx=0 tx=0).stop 2024-04-24T23:58:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.906+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c15c230 msgr2=0x7fce7c1f3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.906+0000 7fce84000640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c15c230 0x7fce7c1f3e20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c730 tx=0x7fce7400cbf0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.907+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 shutdown_connections 2024-04-24T23:58:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.907+0000 7fce84000640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fce5c06be60 0x7fce5c06e320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.907+0000 7fce84000640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c15c230 0x7fce7c1f3e20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.907+0000 7fce84000640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce7c0aef50 0x7fce7c0b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.907+0000 7fce84000640 1 --2- 172.21.15.96:0/4011447454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce7c0acda0 0x7fce7c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.907+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 >> 172.21.15.96:0/4011447454 conn(0x7fce7c0b19c0 msgr2=0x7fce7c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.907+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 shutdown_connections 2024-04-24T23:58:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:10.907+0000 7fce84000640 1 -- 172.21.15.96:0/4011447454 wait complete. 2024-04-24T23:58:10.926 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-24T23:58:10.301437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001647"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552582+0000","last_change":"2024-04-24T23:58:05.798222+0000","last_active":"2024-04-24T23:58:07.552582+0000","last_peered":"2024-04-24T23:58:07.552582+0000","last_clean":"2024-04-24T23:58:07.552582+0000","last_became_active":"2024-04-24T23:58:05.797677+0000","last_became_peered":"2024-04-24T23:58:05.797677+0000","last_unstale":"2024-04-24T23:58:07.552582+0000","last_undegraded":"2024-04-24T23:58:07.552582+0000","last_fullsized":"2024-04-24T23:58:07.552582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:52.401878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779963+0000","last_change":"2024-04-24T23:58:05.795987+0000","last_active":"2024-04-24T23:58:06.779963+0000","last_peered":"2024-04-24T23:58:06.779963+0000","last_clean":"2024-04-24T23:58:06.779963+0000","last_became_active":"2024-04-24T23:58:05.794693+0000","last_became_peered":"2024-04-24T23:58:05.794693+0000","last_unstale":"2024-04-24T23:58:06.779963+0000","last_undegraded":"2024-04-24T23:58:06.779963+0000","last_fullsized":"2024-04-24T23:58:06.779963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549565+0000","last_change":"2024-04-24T23:58:05.792670+0000","last_active":"2024-04-24T23:58:07.549565+0000","last_peered":"2024-04-24T23:58:07.549565+0000","last_clean":"2024-04-24T23:58:07.549565+0000","last_became_active":"2024-04-24T23:58:05.792250+0000","last_became_peered":"2024-04-24T23:58:05.792250+0000","last_unstale":"2024-04-24T23:58:07.549565+0000","last_undegraded":"2024-04-24T23:58:07.549565+0000","last_fullsized":"2024-04-24T23:58:07.549565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549094+0000","last_change":"2024-04-24T23:58:05.797139+0000","last_active":"2024-04-24T23:58:07.549094+0000","last_peered":"2024-04-24T23:58:07.549094+0000","last_clean":"2024-04-24T23:58:07.549094+0000","last_became_active":"2024-04-24T23:58:05.796582+0000","last_became_peered":"2024-04-24T23:58:05.796582+0000","last_unstale":"2024-04-24T23:58:07.549094+0000","last_undegraded":"2024-04-24T23:58:07.549094+0000","last_fullsized":"2024-04-24T23:58:07.549094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:00.726837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548416+0000","last_change":"2024-04-24T23:58:05.800388+0000","last_active":"2024-04-24T23:58:07.548416+0000","last_peered":"2024-04-24T23:58:07.548416+0000","last_clean":"2024-04-24T23:58:07.548416+0000","last_became_active":"2024-04-24T23:58:05.799461+0000","last_became_peered":"2024-04-24T23:58:05.799461+0000","last_unstale":"2024-04-24T23:58:07.548416+0000","last_undegraded":"2024-04-24T23:58:07.548416+0000","last_fullsized":"2024-04-24T23:58:07.548416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548380+0000","last_change":"2024-04-24T23:58:05.790511+0000","last_active":"2024-04-24T23:58:07.548380+0000","last_peered":"2024-04-24T23:58:07.548380+0000","last_clean":"2024-04-24T23:58:07.548380+0000","last_became_active":"2024-04-24T23:58:05.790204+0000","last_became_peered":"2024-04-24T23:58:05.790204+0000","last_unstale":"2024-04-24T23:58:07.548380+0000","last_undegraded":"2024-04-24T23:58:07.548380+0000","last_fullsized":"2024-04-24T23:58:07.548380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549559+0000","last_change":"2024-04-24T23:58:05.803344+0000","last_active":"2024-04-24T23:58:07.549559+0000","last_peered":"2024-04-24T23:58:07.549559+0000","last_clean":"2024-04-24T23:58:07.549559+0000","last_became_active":"2024-04-24T23:58:05.802869+0000","last_became_peered":"2024-04-24T23:58:05.802869+0000","last_unstale":"2024-04-24T23:58:07.549559+0000","last_undegraded":"2024-04-24T23:58:07.549559+0000","last_fullsized":"2024-04-24T23:58:07.549559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548557+0000","last_change":"2024-04-24T23:58:05.796780+0000","last_active":"2024-04-24T23:58:07.548557+0000","last_peered":"2024-04-24T23:58:07.548557+0000","last_clean":"2024-04-24T23:58:07.548557+0000","last_became_active":"2024-04-24T23:58:05.796123+0000","last_became_peered":"2024-04-24T23:58:05.796123+0000","last_unstale":"2024-04-24T23:58:07.548557+0000","last_undegraded":"2024-04-24T23:58:07.548557+0000","last_fullsized":"2024-04-24T23:58:07.548557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552618+0000","last_change":"2024-04-24T23:58:05.798676+0000","last_active":"2024-04-24T23:58:07.552618+0000","last_peered":"2024-04-24T23:58:07.552618+0000","last_clean":"2024-04-24T23:58:07.552618+0000","last_became_active":"2024-04-24T23:58:05.798460+0000","last_became_peered":"2024-04-24T23:58:05.798460+0000","last_unstale":"2024-04-24T23:58:07.552618+0000","last_undegraded":"2024-04-24T23:58:07.552618+0000","last_fullsized":"2024-04-24T23:58:07.552618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:42.009820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780359+0000","last_change":"2024-04-24T23:58:05.790270+0000","last_active":"2024-04-24T23:58:06.780359+0000","last_peered":"2024-04-24T23:58:06.780359+0000","last_clean":"2024-04-24T23:58:06.780359+0000","last_became_active":"2024-04-24T23:58:05.789979+0000","last_became_peered":"2024-04-24T23:58:05.789979+0000","last_unstale":"2024-04-24T23:58:06.780359+0000","last_undegraded":"2024-04-24T23:58:06.780359+0000","last_fullsized":"2024-04-24T23:58:06.780359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781124+0000","last_change":"2024-04-24T23:58:05.793710+0000","last_active":"2024-04-24T23:58:06.781124+0000","last_peered":"2024-04-24T23:58:06.781124+0000","last_clean":"2024-04-24T23:58:06.781124+0000","last_became_active":"2024-04-24T23:58:05.793402+0000","last_became_peered":"2024-04-24T23:58:05.793402+0000","last_unstale":"2024-04-24T23:58:06.781124+0000","last_undegraded":"2024-04-24T23:58:06.781124+0000","last_fullsized":"2024-04-24T23:58:06.781124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782467+0000","last_change":"2024-04-24T23:58:05.768478+0000","last_active":"2024-04-24T23:58:06.782467+0000","last_peered":"2024-04-24T23:58:06.782467+0000","last_clean":"2024-04-24T23:58:06.782467+0000","last_became_active":"2024-04-24T23:58:05.768060+0000","last_became_peered":"2024-04-24T23:58:05.768060+0000","last_unstale":"2024-04-24T23:58:06.782467+0000","last_undegraded":"2024-04-24T23:58:06.782467+0000","last_fullsized":"2024-04-24T23:58:06.782467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:45.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550107+0000","last_change":"2024-04-24T23:58:05.801426+0000","last_active":"2024-04-24T23:58:07.550107+0000","last_peered":"2024-04-24T23:58:07.550107+0000","last_clean":"2024-04-24T23:58:07.550107+0000","last_became_active":"2024-04-24T23:58:05.801082+0000","last_became_peered":"2024-04-24T23:58:05.801082+0000","last_unstale":"2024-04-24T23:58:07.550107+0000","last_undegraded":"2024-04-24T23:58:07.550107+0000","last_fullsized":"2024-04-24T23:58:07.550107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548534+0000","last_change":"2024-04-24T23:58:05.790329+0000","last_active":"2024-04-24T23:58:07.548534+0000","last_peered":"2024-04-24T23:58:07.548534+0000","last_clean":"2024-04-24T23:58:07.548534+0000","last_became_active":"2024-04-24T23:58:05.787856+0000","last_became_peered":"2024-04-24T23:58:05.787856+0000","last_unstale":"2024-04-24T23:58:07.548534+0000","last_undegraded":"2024-04-24T23:58:07.548534+0000","last_fullsized":"2024-04-24T23:58:07.548534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:18.652571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779257+0000","last_change":"2024-04-24T23:58:05.784612+0000","last_active":"2024-04-24T23:58:06.779257+0000","last_peered":"2024-04-24T23:58:06.779257+0000","last_clean":"2024-04-24T23:58:06.779257+0000","last_became_active":"2024-04-24T23:58:05.784318+0000","last_became_peered":"2024-04-24T23:58:05.784318+0000","last_unstale":"2024-04-24T23:58:06.779257+0000","last_undegraded":"2024-04-24T23:58:06.779257+0000","last_fullsized":"2024-04-24T23:58:06.779257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547845+0000","last_change":"2024-04-24T23:58:05.802993+0000","last_active":"2024-04-24T23:58:07.547845+0000","last_peered":"2024-04-24T23:58:07.547845+0000","last_clean":"2024-04-24T23:58:07.547845+0000","last_became_active":"2024-04-24T23:58:05.802728+0000","last_became_peered":"2024-04-24T23:58:05.802728+0000","last_unstale":"2024-04-24T23:58:07.547845+0000","last_undegraded":"2024-04-24T23:58:07.547845+0000","last_fullsized":"2024-04-24T23:58:07.547845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550212+0000","last_change":"2024-04-24T23:58:05.804677+0000","last_active":"2024-04-24T23:58:07.550212+0000","last_peered":"2024-04-24T23:58:07.550212+0000","last_clean":"2024-04-24T23:58:07.550212+0000","last_became_active":"2024-04-24T23:58:05.804348+0000","last_became_peered":"2024-04-24T23:58:05.804348+0000","last_unstale":"2024-04-24T23:58:07.550212+0000","last_undegraded":"2024-04-24T23:58:07.550212+0000","last_fullsized":"2024-04-24T23:58:07.550212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:52.401878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549898+0000","last_change":"2024-04-24T23:58:05.791215+0000","last_active":"2024-04-24T23:58:07.549898+0000","last_peered":"2024-04-24T23:58:07.549898+0000","last_clean":"2024-04-24T23:58:07.549898+0000","last_became_active":"2024-04-24T23:58:05.790911+0000","last_became_peered":"2024-04-24T23:58:05.790911+0000","last_unstale":"2024-04-24T23:58:07.549898+0000","last_undegraded":"2024-04-24T23:58:07.549898+0000","last_fullsized":"2024-04-24T23:58:07.549898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:06.860406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552329+0000","last_change":"2024-04-24T23:58:05.799646+0000","last_active":"2024-04-24T23:58:07.552329+0000","last_peered":"2024-04-24T23:58:07.552329+0000","last_clean":"2024-04-24T23:58:07.552329+0000","last_became_active":"2024-04-24T23:58:05.799361+0000","last_became_peered":"2024-04-24T23:58:05.799361+0000","last_unstale":"2024-04-24T23:58:07.552329+0000","last_undegraded":"2024-04-24T23:58:07.552329+0000","last_fullsized":"2024-04-24T23:58:07.552329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:12.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779220+0000","last_change":"2024-04-24T23:58:05.772550+0000","last_active":"2024-04-24T23:58:06.779220+0000","last_peered":"2024-04-24T23:58:06.779220+0000","last_clean":"2024-04-24T23:58:06.779220+0000","last_became_active":"2024-04-24T23:58:05.772271+0000","last_became_peered":"2024-04-24T23:58:05.772271+0000","last_unstale":"2024-04-24T23:58:06.779220+0000","last_undegraded":"2024-04-24T23:58:06.779220+0000","last_fullsized":"2024-04-24T23:58:06.779220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548310+0000","last_change":"2024-04-24T23:58:05.787389+0000","last_active":"2024-04-24T23:58:07.548310+0000","last_peered":"2024-04-24T23:58:07.548310+0000","last_clean":"2024-04-24T23:58:07.548310+0000","last_became_active":"2024-04-24T23:58:05.786872+0000","last_became_peered":"2024-04-24T23:58:05.786872+0000","last_unstale":"2024-04-24T23:58:07.548310+0000","last_undegraded":"2024-04-24T23:58:07.548310+0000","last_fullsized":"2024-04-24T23:58:07.548310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:31.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548638+0000","last_change":"2024-04-24T23:58:05.798911+0000","last_active":"2024-04-24T23:58:07.548638+0000","last_peered":"2024-04-24T23:58:07.548638+0000","last_clean":"2024-04-24T23:58:07.548638+0000","last_became_active":"2024-04-24T23:58:05.798629+0000","last_became_peered":"2024-04-24T23:58:05.798629+0000","last_unstale":"2024-04-24T23:58:07.548638+0000","last_undegraded":"2024-04-24T23:58:07.548638+0000","last_fullsized":"2024-04-24T23:58:07.548638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551279+0000","last_change":"2024-04-24T23:58:05.788291+0000","last_active":"2024-04-24T23:58:07.551279+0000","last_peered":"2024-04-24T23:58:07.551279+0000","last_clean":"2024-04-24T23:58:07.551279+0000","last_became_active":"2024-04-24T23:58:05.787971+0000","last_became_peered":"2024-04-24T23:58:05.787971+0000","last_unstale":"2024-04-24T23:58:07.551279+0000","last_undegraded":"2024-04-24T23:58:07.551279+0000","last_fullsized":"2024-04-24T23:58:07.551279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548331+0000","last_change":"2024-04-24T23:58:05.786883+0000","last_active":"2024-04-24T23:58:07.548331+0000","last_peered":"2024-04-24T23:58:07.548331+0000","last_clean":"2024-04-24T23:58:07.548331+0000","last_became_active":"2024-04-24T23:58:05.786637+0000","last_became_peered":"2024-04-24T23:58:05.786637+0000","last_unstale":"2024-04-24T23:58:07.548331+0000","last_undegraded":"2024-04-24T23:58:07.548331+0000","last_fullsized":"2024-04-24T23:58:07.548331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552055+0000","last_change":"2024-04-24T23:58:05.797334+0000","last_active":"2024-04-24T23:58:07.552055+0000","last_peered":"2024-04-24T23:58:07.552055+0000","last_clean":"2024-04-24T23:58:07.552055+0000","last_became_active":"2024-04-24T23:58:05.797038+0000","last_became_peered":"2024-04-24T23:58:05.797038+0000","last_unstale":"2024-04-24T23:58:07.552055+0000","last_undegraded":"2024-04-24T23:58:07.552055+0000","last_fullsized":"2024-04-24T23:58:07.552055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780792+0000","last_change":"2024-04-24T23:58:05.786537+0000","last_active":"2024-04-24T23:58:06.780792+0000","last_peered":"2024-04-24T23:58:06.780792+0000","last_clean":"2024-04-24T23:58:06.780792+0000","last_became_active":"2024-04-24T23:58:05.780787+0000","last_became_peered":"2024-04-24T23:58:05.780787+0000","last_unstale":"2024-04-24T23:58:06.780792+0000","last_undegraded":"2024-04-24T23:58:06.780792+0000","last_fullsized":"2024-04-24T23:58:06.780792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780454+0000","last_change":"2024-04-24T23:58:05.797680+0000","last_active":"2024-04-24T23:58:06.780454+0000","last_peered":"2024-04-24T23:58:06.780454+0000","last_clean":"2024-04-24T23:58:06.780454+0000","last_became_active":"2024-04-24T23:58:05.796878+0000","last_became_peered":"2024-04-24T23:58:05.796878+0000","last_unstale":"2024-04-24T23:58:06.780454+0000","last_undegraded":"2024-04-24T23:58:06.780454+0000","last_fullsized":"2024-04-24T23:58:06.780454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551634+0000","last_change":"2024-04-24T23:58:05.794457+0000","last_active":"2024-04-24T23:58:07.551634+0000","last_peered":"2024-04-24T23:58:07.551634+0000","last_clean":"2024-04-24T23:58:07.551634+0000","last_became_active":"2024-04-24T23:58:05.794121+0000","last_became_peered":"2024-04-24T23:58:05.794121+0000","last_unstale":"2024-04-24T23:58:07.551634+0000","last_undegraded":"2024-04-24T23:58:07.551634+0000","last_fullsized":"2024-04-24T23:58:07.551634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548655+0000","last_change":"2024-04-24T23:58:05.787183+0000","last_active":"2024-04-24T23:58:07.548655+0000","last_peered":"2024-04-24T23:58:07.548655+0000","last_clean":"2024-04-24T23:58:07.548655+0000","last_became_active":"2024-04-24T23:58:05.786561+0000","last_became_peered":"2024-04-24T23:58:05.786561+0000","last_unstale":"2024-04-24T23:58:07.548655+0000","last_undegraded":"2024-04-24T23:58:07.548655+0000","last_fullsized":"2024-04-24T23:58:07.548655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:20.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548872+0000","last_change":"2024-04-24T23:58:05.785799+0000","last_active":"2024-04-24T23:58:07.548872+0000","last_peered":"2024-04-24T23:58:07.548872+0000","last_clean":"2024-04-24T23:58:07.548872+0000","last_became_active":"2024-04-24T23:58:05.785513+0000","last_became_peered":"2024-04-24T23:58:05.785513+0000","last_unstale":"2024-04-24T23:58:07.548872+0000","last_undegraded":"2024-04-24T23:58:07.548872+0000","last_fullsized":"2024-04-24T23:58:07.548872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549958+0000","last_change":"2024-04-24T23:58:05.786627+0000","last_active":"2024-04-24T23:58:07.549958+0000","last_peered":"2024-04-24T23:58:07.549958+0000","last_clean":"2024-04-24T23:58:07.549958+0000","last_became_active":"2024-04-24T23:58:05.786354+0000","last_became_peered":"2024-04-24T23:58:05.786354+0000","last_unstale":"2024-04-24T23:58:07.549958+0000","last_undegraded":"2024-04-24T23:58:07.549958+0000","last_fullsized":"2024-04-24T23:58:07.549958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:43.209580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778470+0000","last_change":"2024-04-24T23:58:05.774049+0000","last_active":"2024-04-24T23:58:06.778470+0000","last_peered":"2024-04-24T23:58:06.778470+0000","last_clean":"2024-04-24T23:58:06.778470+0000","last_became_active":"2024-04-24T23:58:05.773704+0000","last_became_peered":"2024-04-24T23:58:05.773704+0000","last_unstale":"2024-04-24T23:58:06.778470+0000","last_undegraded":"2024-04-24T23:58:06.778470+0000","last_fullsized":"2024-04-24T23:58:06.778470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:20.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781658+0000","last_change":"2024-04-24T23:58:05.790510+0000","last_active":"2024-04-24T23:58:06.781658+0000","last_peered":"2024-04-24T23:58:06.781658+0000","last_clean":"2024-04-24T23:58:06.781658+0000","last_became_active":"2024-04-24T23:58:05.790154+0000","last_became_peered":"2024-04-24T23:58:05.790154+0000","last_unstale":"2024-04-24T23:58:06.781658+0000","last_undegraded":"2024-04-24T23:58:06.781658+0000","last_fullsized":"2024-04-24T23:58:06.781658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:19.886869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550429+0000","last_change":"2024-04-24T23:58:04.771651+0000","last_active":"2024-04-24T23:58:07.550429+0000","last_peered":"2024-04-24T23:58:07.550429+0000","last_clean":"2024-04-24T23:58:07.550429+0000","last_became_active":"2024-04-24T23:58:04.771304+0000","last_became_peered":"2024-04-24T23:58:04.771304+0000","last_unstale":"2024-04-24T23:58:07.550429+0000","last_undegraded":"2024-04-24T23:58:07.550429+0000","last_fullsized":"2024-04-24T23:58:07.550429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548744+0000","last_change":"2024-04-24T23:58:05.770296+0000","last_active":"2024-04-24T23:58:07.548744+0000","last_peered":"2024-04-24T23:58:07.548744+0000","last_clean":"2024-04-24T23:58:07.548744+0000","last_became_active":"2024-04-24T23:58:05.769888+0000","last_became_peered":"2024-04-24T23:58:05.769888+0000","last_unstale":"2024-04-24T23:58:07.548744+0000","last_undegraded":"2024-04-24T23:58:07.548744+0000","last_fullsized":"2024-04-24T23:58:07.548744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780802+0000","last_change":"2024-04-24T23:58:04.776522+0000","last_active":"2024-04-24T23:58:06.780802+0000","last_peered":"2024-04-24T23:58:06.780802+0000","last_clean":"2024-04-24T23:58:06.780802+0000","last_became_active":"2024-04-24T23:58:04.776214+0000","last_became_peered":"2024-04-24T23:58:04.776214+0000","last_unstale":"2024-04-24T23:58:06.780802+0000","last_undegraded":"2024-04-24T23:58:06.780802+0000","last_fullsized":"2024-04-24T23:58:06.780802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551072+0000","last_change":"2024-04-24T23:58:04.763540+0000","last_active":"2024-04-24T23:58:07.551072+0000","last_peered":"2024-04-24T23:58:07.551072+0000","last_clean":"2024-04-24T23:58:07.551072+0000","last_became_active":"2024-04-24T23:58:04.763262+0000","last_became_peered":"2024-04-24T23:58:04.763262+0000","last_unstale":"2024-04-24T23:58:07.551072+0000","last_undegraded":"2024-04-24T23:58:07.551072+0000","last_fullsized":"2024-04-24T23:58:07.551072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:33.619150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550335+0000","last_change":"2024-04-24T23:58:05.803405+0000","last_active":"2024-04-24T23:58:07.550335+0000","last_peered":"2024-04-24T23:58:07.550335+0000","last_clean":"2024-04-24T23:58:07.550335+0000","last_became_active":"2024-04-24T23:58:05.802932+0000","last_became_peered":"2024-04-24T23:58:05.802932+0000","last_unstale":"2024-04-24T23:58:07.550335+0000","last_undegraded":"2024-04-24T23:58:07.550335+0000","last_fullsized":"2024-04-24T23:58:07.550335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548491+0000","last_change":"2024-04-24T23:58:04.776492+0000","last_active":"2024-04-24T23:58:07.548491+0000","last_peered":"2024-04-24T23:58:07.548491+0000","last_clean":"2024-04-24T23:58:07.548491+0000","last_became_active":"2024-04-24T23:58:04.776141+0000","last_became_peered":"2024-04-24T23:58:04.776141+0000","last_unstale":"2024-04-24T23:58:07.548491+0000","last_undegraded":"2024-04-24T23:58:07.548491+0000","last_fullsized":"2024-04-24T23:58:07.548491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779315+0000","last_change":"2024-04-24T23:58:05.784472+0000","last_active":"2024-04-24T23:58:06.779315+0000","last_peered":"2024-04-24T23:58:06.779315+0000","last_clean":"2024-04-24T23:58:06.779315+0000","last_became_active":"2024-04-24T23:58:05.784189+0000","last_became_peered":"2024-04-24T23:58:05.784189+0000","last_unstale":"2024-04-24T23:58:06.779315+0000","last_undegraded":"2024-04-24T23:58:06.779315+0000","last_fullsized":"2024-04-24T23:58:06.779315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778959+0000","last_change":"2024-04-24T23:58:04.770884+0000","last_active":"2024-04-24T23:58:06.778959+0000","last_peered":"2024-04-24T23:58:06.778959+0000","last_clean":"2024-04-24T23:58:06.778959+0000","last_became_active":"2024-04-24T23:58:04.770285+0000","last_became_peered":"2024-04-24T23:58:04.770285+0000","last_unstale":"2024-04-24T23:58:06.778959+0000","last_undegraded":"2024-04-24T23:58:06.778959+0000","last_fullsized":"2024-04-24T23:58:06.778959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548778+0000","last_change":"2024-04-24T23:58:05.784538+0000","last_active":"2024-04-24T23:58:07.548778+0000","last_peered":"2024-04-24T23:58:07.548778+0000","last_clean":"2024-04-24T23:58:07.548778+0000","last_became_active":"2024-04-24T23:58:05.784301+0000","last_became_peered":"2024-04-24T23:58:05.784301+0000","last_unstale":"2024-04-24T23:58:07.548778+0000","last_undegraded":"2024-04-24T23:58:07.548778+0000","last_fullsized":"2024-04-24T23:58:07.548778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548917+0000","last_change":"2024-04-24T23:58:04.769622+0000","last_active":"2024-04-24T23:58:07.548917+0000","last_peered":"2024-04-24T23:58:07.548917+0000","last_clean":"2024-04-24T23:58:07.548917+0000","last_became_active":"2024-04-24T23:58:04.769264+0000","last_became_peered":"2024-04-24T23:58:04.769264+0000","last_unstale":"2024-04-24T23:58:07.548917+0000","last_undegraded":"2024-04-24T23:58:07.548917+0000","last_fullsized":"2024-04-24T23:58:07.548917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549427+0000","last_change":"2024-04-24T23:58:05.785033+0000","last_active":"2024-04-24T23:58:07.549427+0000","last_peered":"2024-04-24T23:58:07.549427+0000","last_clean":"2024-04-24T23:58:07.549427+0000","last_became_active":"2024-04-24T23:58:05.784760+0000","last_became_peered":"2024-04-24T23:58:05.784760+0000","last_unstale":"2024-04-24T23:58:07.549427+0000","last_undegraded":"2024-04-24T23:58:07.549427+0000","last_fullsized":"2024-04-24T23:58:07.549427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779774+0000","last_change":"2024-04-24T23:58:04.770638+0000","last_active":"2024-04-24T23:58:06.779774+0000","last_peered":"2024-04-24T23:58:06.779774+0000","last_clean":"2024-04-24T23:58:06.779774+0000","last_became_active":"2024-04-24T23:58:04.770332+0000","last_became_peered":"2024-04-24T23:58:04.770332+0000","last_unstale":"2024-04-24T23:58:06.779774+0000","last_undegraded":"2024-04-24T23:58:06.779774+0000","last_fullsized":"2024-04-24T23:58:06.779774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782618+0000","last_change":"2024-04-24T23:58:05.786124+0000","last_active":"2024-04-24T23:58:06.782618+0000","last_peered":"2024-04-24T23:58:06.782618+0000","last_clean":"2024-04-24T23:58:06.782618+0000","last_became_active":"2024-04-24T23:58:05.785737+0000","last_became_peered":"2024-04-24T23:58:05.785737+0000","last_unstale":"2024-04-24T23:58:06.782618+0000","last_undegraded":"2024-04-24T23:58:06.782618+0000","last_fullsized":"2024-04-24T23:58:06.782618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:48.097493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779149+0000","last_change":"2024-04-24T23:58:04.759666+0000","last_active":"2024-04-24T23:58:06.779149+0000","last_peered":"2024-04-24T23:58:06.779149+0000","last_clean":"2024-04-24T23:58:06.779149+0000","last_became_active":"2024-04-24T23:58:04.759342+0000","last_became_peered":"2024-04-24T23:58:04.759342+0000","last_unstale":"2024-04-24T23:58:06.779149+0000","last_undegraded":"2024-04-24T23:58:06.779149+0000","last_fullsized":"2024-04-24T23:58:06.779149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551828+0000","last_change":"2024-04-24T23:58:05.793926+0000","last_active":"2024-04-24T23:58:07.551828+0000","last_peered":"2024-04-24T23:58:07.551828+0000","last_clean":"2024-04-24T23:58:07.551828+0000","last_became_active":"2024-04-24T23:58:05.792484+0000","last_became_peered":"2024-04-24T23:58:05.792484+0000","last_unstale":"2024-04-24T23:58:07.551828+0000","last_undegraded":"2024-04-24T23:58:07.551828+0000","last_fullsized":"2024-04-24T23:58:07.551828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:11.381479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548797+0000","last_change":"2024-04-24T23:58:04.776767+0000","last_active":"2024-04-24T23:58:07.548797+0000","last_peered":"2024-04-24T23:58:07.548797+0000","last_clean":"2024-04-24T23:58:07.548797+0000","last_became_active":"2024-04-24T23:58:04.776452+0000","last_became_peered":"2024-04-24T23:58:04.776452+0000","last_unstale":"2024-04-24T23:58:07.548797+0000","last_undegraded":"2024-04-24T23:58:07.548797+0000","last_fullsized":"2024-04-24T23:58:07.548797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:07:03.630911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549293+0000","last_change":"2024-04-24T23:58:05.790152+0000","last_active":"2024-04-24T23:58:07.549293+0000","last_peered":"2024-04-24T23:58:07.549293+0000","last_clean":"2024-04-24T23:58:07.549293+0000","last_became_active":"2024-04-24T23:58:05.789858+0000","last_became_peered":"2024-04-24T23:58:05.789858+0000","last_unstale":"2024-04-24T23:58:07.549293+0000","last_undegraded":"2024-04-24T23:58:07.549293+0000","last_fullsized":"2024-04-24T23:58:07.549293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548956+0000","last_change":"2024-04-24T23:58:04.771292+0000","last_active":"2024-04-24T23:58:07.548956+0000","last_peered":"2024-04-24T23:58:07.548956+0000","last_clean":"2024-04-24T23:58:07.548956+0000","last_became_active":"2024-04-24T23:58:04.770724+0000","last_became_peered":"2024-04-24T23:58:04.770724+0000","last_unstale":"2024-04-24T23:58:07.548956+0000","last_undegraded":"2024-04-24T23:58:07.548956+0000","last_fullsized":"2024-04-24T23:58:07.548956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548794+0000","last_change":"2024-04-24T23:58:05.802304+0000","last_active":"2024-04-24T23:58:07.548794+0000","last_peered":"2024-04-24T23:58:07.548794+0000","last_clean":"2024-04-24T23:58:07.548794+0000","last_became_active":"2024-04-24T23:58:05.799845+0000","last_became_peered":"2024-04-24T23:58:05.799845+0000","last_unstale":"2024-04-24T23:58:07.548794+0000","last_undegraded":"2024-04-24T23:58:07.548794+0000","last_fullsized":"2024-04-24T23:58:07.548794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778378+0000","last_change":"2024-04-24T23:58:04.765718+0000","last_active":"2024-04-24T23:58:06.778378+0000","last_peered":"2024-04-24T23:58:06.778378+0000","last_clean":"2024-04-24T23:58:06.778378+0000","last_became_active":"2024-04-24T23:58:04.765445+0000","last_became_peered":"2024-04-24T23:58:04.765445+0000","last_unstale":"2024-04-24T23:58:06.778378+0000","last_undegraded":"2024-04-24T23:58:06.778378+0000","last_fullsized":"2024-04-24T23:58:06.778378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780131+0000","last_change":"2024-04-24T23:58:05.775138+0000","last_active":"2024-04-24T23:58:06.780131+0000","last_peered":"2024-04-24T23:58:06.780131+0000","last_clean":"2024-04-24T23:58:06.780131+0000","last_became_active":"2024-04-24T23:58:05.774820+0000","last_became_peered":"2024-04-24T23:58:05.774820+0000","last_unstale":"2024-04-24T23:58:06.780131+0000","last_undegraded":"2024-04-24T23:58:06.780131+0000","last_fullsized":"2024-04-24T23:58:06.780131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547528+0000","last_change":"2024-04-24T23:58:04.756238+0000","last_active":"2024-04-24T23:58:07.547528+0000","last_peered":"2024-04-24T23:58:07.547528+0000","last_clean":"2024-04-24T23:58:07.547528+0000","last_became_active":"2024-04-24T23:58:04.755948+0000","last_became_peered":"2024-04-24T23:58:04.755948+0000","last_unstale":"2024-04-24T23:58:07.547528+0000","last_undegraded":"2024-04-24T23:58:07.547528+0000","last_fullsized":"2024-04-24T23:58:07.547528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549775+0000","last_change":"2024-04-24T23:58:05.792006+0000","last_active":"2024-04-24T23:58:07.549775+0000","last_peered":"2024-04-24T23:58:07.549775+0000","last_clean":"2024-04-24T23:58:07.549775+0000","last_became_active":"2024-04-24T23:58:05.791717+0000","last_became_peered":"2024-04-24T23:58:05.791717+0000","last_unstale":"2024-04-24T23:58:07.549775+0000","last_undegraded":"2024-04-24T23:58:07.549775+0000","last_fullsized":"2024-04-24T23:58:07.549775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782855+0000","last_change":"2024-04-24T23:58:04.762742+0000","last_active":"2024-04-24T23:58:06.782855+0000","last_peered":"2024-04-24T23:58:06.782855+0000","last_clean":"2024-04-24T23:58:06.782855+0000","last_became_active":"2024-04-24T23:58:04.757739+0000","last_became_peered":"2024-04-24T23:58:04.757739+0000","last_unstale":"2024-04-24T23:58:06.782855+0000","last_undegraded":"2024-04-24T23:58:06.782855+0000","last_fullsized":"2024-04-24T23:58:06.782855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:32:19.430261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552485+0000","last_change":"2024-04-24T23:58:05.804538+0000","last_active":"2024-04-24T23:58:07.552485+0000","last_peered":"2024-04-24T23:58:07.552485+0000","last_clean":"2024-04-24T23:58:07.552485+0000","last_became_active":"2024-04-24T23:58:05.804208+0000","last_became_peered":"2024-04-24T23:58:05.804208+0000","last_unstale":"2024-04-24T23:58:07.552485+0000","last_undegraded":"2024-04-24T23:58:07.552485+0000","last_fullsized":"2024-04-24T23:58:07.552485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.648636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549908+0000","last_change":"2024-04-24T23:58:04.760983+0000","last_active":"2024-04-24T23:58:07.549908+0000","last_peered":"2024-04-24T23:58:07.549908+0000","last_clean":"2024-04-24T23:58:07.549908+0000","last_became_active":"2024-04-24T23:58:04.760235+0000","last_became_peered":"2024-04-24T23:58:04.760235+0000","last_unstale":"2024-04-24T23:58:07.549908+0000","last_undegraded":"2024-04-24T23:58:07.549908+0000","last_fullsized":"2024-04-24T23:58:07.549908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552862+0000","last_change":"2024-04-24T23:58:05.803645+0000","last_active":"2024-04-24T23:58:07.552862+0000","last_peered":"2024-04-24T23:58:07.552862+0000","last_clean":"2024-04-24T23:58:07.552862+0000","last_became_active":"2024-04-24T23:58:05.803374+0000","last_became_peered":"2024-04-24T23:58:05.803374+0000","last_unstale":"2024-04-24T23:58:07.552862+0000","last_undegraded":"2024-04-24T23:58:07.552862+0000","last_fullsized":"2024-04-24T23:58:07.552862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:04:24.025118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780094+0000","last_change":"2024-04-24T23:58:04.773468+0000","last_active":"2024-04-24T23:58:06.780094+0000","last_peered":"2024-04-24T23:58:06.780094+0000","last_clean":"2024-04-24T23:58:06.780094+0000","last_became_active":"2024-04-24T23:58:04.773164+0000","last_became_peered":"2024-04-24T23:58:04.773164+0000","last_unstale":"2024-04-24T23:58:06.780094+0000","last_undegraded":"2024-04-24T23:58:06.780094+0000","last_fullsized":"2024-04-24T23:58:06.780094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549683+0000","last_change":"2024-04-24T23:58:05.796911+0000","last_active":"2024-04-24T23:58:07.549683+0000","last_peered":"2024-04-24T23:58:07.549683+0000","last_clean":"2024-04-24T23:58:07.549683+0000","last_became_active":"2024-04-24T23:58:05.796117+0000","last_became_peered":"2024-04-24T23:58:05.796117+0000","last_unstale":"2024-04-24T23:58:07.549683+0000","last_undegraded":"2024-04-24T23:58:07.549683+0000","last_fullsized":"2024-04-24T23:58:07.549683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:12.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550141+0000","last_change":"2024-04-24T23:58:04.772549+0000","last_active":"2024-04-24T23:58:07.550141+0000","last_peered":"2024-04-24T23:58:07.550141+0000","last_clean":"2024-04-24T23:58:07.550141+0000","last_became_active":"2024-04-24T23:58:04.771951+0000","last_became_peered":"2024-04-24T23:58:04.771951+0000","last_unstale":"2024-04-24T23:58:07.550141+0000","last_undegraded":"2024-04-24T23:58:07.550141+0000","last_fullsized":"2024-04-24T23:58:07.550141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:16:27.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551720+0000","last_change":"2024-04-24T23:58:05.793353+0000","last_active":"2024-04-24T23:58:07.551720+0000","last_peered":"2024-04-24T23:58:07.551720+0000","last_clean":"2024-04-24T23:58:07.551720+0000","last_became_active":"2024-04-24T23:58:05.793021+0000","last_became_peered":"2024-04-24T23:58:05.793021+0000","last_unstale":"2024-04-24T23:58:07.551720+0000","last_undegraded":"2024-04-24T23:58:07.551720+0000","last_fullsized":"2024-04-24T23:58:07.551720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:00.726837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547872+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:58:07.547872+0000","last_peered":"2024-04-24T23:58:07.547872+0000","last_clean":"2024-04-24T23:58:07.547872+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:58:07.547872+0000","last_undegraded":"2024-04-24T23:58:07.547872+0000","last_fullsized":"2024-04-24T23:58:07.547872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547780+0000","last_change":"2024-04-24T23:58:04.772159+0000","last_active":"2024-04-24T23:58:07.547780+0000","last_peered":"2024-04-24T23:58:07.547780+0000","last_clean":"2024-04-24T23:58:07.547780+0000","last_became_active":"2024-04-24T23:58:04.771791+0000","last_became_peered":"2024-04-24T23:58:04.771791+0000","last_unstale":"2024-04-24T23:58:07.547780+0000","last_undegraded":"2024-04-24T23:58:07.547780+0000","last_fullsized":"2024-04-24T23:58:07.547780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:16:27.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549665+0000","last_change":"2024-04-24T23:58:05.798331+0000","last_active":"2024-04-24T23:58:07.549665+0000","last_peered":"2024-04-24T23:58:07.549665+0000","last_clean":"2024-04-24T23:58:07.549665+0000","last_became_active":"2024-04-24T23:58:05.797998+0000","last_became_peered":"2024-04-24T23:58:05.797998+0000","last_unstale":"2024-04-24T23:58:07.549665+0000","last_undegraded":"2024-04-24T23:58:07.549665+0000","last_fullsized":"2024-04-24T23:58:07.549665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547517+0000","last_change":"2024-04-24T23:58:04.774140+0000","last_active":"2024-04-24T23:58:07.547517+0000","last_peered":"2024-04-24T23:58:07.547517+0000","last_clean":"2024-04-24T23:58:07.547517+0000","last_became_active":"2024-04-24T23:58:04.773822+0000","last_became_peered":"2024-04-24T23:58:04.773822+0000","last_unstale":"2024-04-24T23:58:07.547517+0000","last_undegraded":"2024-04-24T23:58:07.547517+0000","last_fullsized":"2024-04-24T23:58:07.547517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548141+0000","last_change":"2024-04-24T23:58:05.770614+0000","last_active":"2024-04-24T23:58:07.548141+0000","last_peered":"2024-04-24T23:58:07.548141+0000","last_clean":"2024-04-24T23:58:07.548141+0000","last_became_active":"2024-04-24T23:58:05.770229+0000","last_became_peered":"2024-04-24T23:58:05.770229+0000","last_unstale":"2024-04-24T23:58:07.548141+0000","last_undegraded":"2024-04-24T23:58:07.548141+0000","last_fullsized":"2024-04-24T23:58:07.548141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.247528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550130+0000","last_change":"2024-04-24T23:58:04.754168+0000","last_active":"2024-04-24T23:58:07.550130+0000","last_peered":"2024-04-24T23:58:07.550130+0000","last_clean":"2024-04-24T23:58:07.550130+0000","last_became_active":"2024-04-24T23:58:04.753801+0000","last_became_peered":"2024-04-24T23:58:04.753801+0000","last_unstale":"2024-04-24T23:58:07.550130+0000","last_undegraded":"2024-04-24T23:58:07.550130+0000","last_fullsized":"2024-04-24T23:58:07.550130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779072+0000","last_change":"2024-04-24T23:58:05.797159+0000","last_active":"2024-04-24T23:58:06.779072+0000","last_peered":"2024-04-24T23:58:06.779072+0000","last_clean":"2024-04-24T23:58:06.779072+0000","last_became_active":"2024-04-24T23:58:05.796588+0000","last_became_peered":"2024-04-24T23:58:05.796588+0000","last_unstale":"2024-04-24T23:58:06.779072+0000","last_undegraded":"2024-04-24T23:58:06.779072+0000","last_fullsized":"2024-04-24T23:58:06.779072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549111+0000","last_change":"2024-04-24T23:58:04.771298+0000","last_active":"2024-04-24T23:58:07.549111+0000","last_peered":"2024-04-24T23:58:07.549111+0000","last_clean":"2024-04-24T23:58:07.549111+0000","last_became_active":"2024-04-24T23:58:04.770304+0000","last_became_peered":"2024-04-24T23:58:04.770304+0000","last_unstale":"2024-04-24T23:58:07.549111+0000","last_undegraded":"2024-04-24T23:58:07.549111+0000","last_fullsized":"2024-04-24T23:58:07.549111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782155+0000","last_change":"2024-04-24T23:58:05.776073+0000","last_active":"2024-04-24T23:58:06.782155+0000","last_peered":"2024-04-24T23:58:06.782155+0000","last_clean":"2024-04-24T23:58:06.782155+0000","last_became_active":"2024-04-24T23:58:05.775750+0000","last_became_peered":"2024-04-24T23:58:05.775750+0000","last_unstale":"2024-04-24T23:58:06.782155+0000","last_undegraded":"2024-04-24T23:58:06.782155+0000","last_fullsized":"2024-04-24T23:58:06.782155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:39.153771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779645+0000","last_change":"2024-04-24T23:58:04.758156+0000","last_active":"2024-04-24T23:58:06.779645+0000","last_peered":"2024-04-24T23:58:06.779645+0000","last_clean":"2024-04-24T23:58:06.779645+0000","last_became_active":"2024-04-24T23:58:04.757677+0000","last_became_peered":"2024-04-24T23:58:04.757677+0000","last_unstale":"2024-04-24T23:58:06.779645+0000","last_undegraded":"2024-04-24T23:58:06.779645+0000","last_fullsized":"2024-04-24T23:58:06.779645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:05.846034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549139+0000","last_change":"2024-04-24T23:58:05.796265+0000","last_active":"2024-04-24T23:58:07.549139+0000","last_peered":"2024-04-24T23:58:07.549139+0000","last_clean":"2024-04-24T23:58:07.549139+0000","last_became_active":"2024-04-24T23:58:05.795946+0000","last_became_peered":"2024-04-24T23:58:05.795946+0000","last_unstale":"2024-04-24T23:58:07.549139+0000","last_undegraded":"2024-04-24T23:58:07.549139+0000","last_fullsized":"2024-04-24T23:58:07.549139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:11.381479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551980+0000","last_change":"2024-04-24T23:58:04.779614+0000","last_active":"2024-04-24T23:58:07.551980+0000","last_peered":"2024-04-24T23:58:07.551980+0000","last_clean":"2024-04-24T23:58:07.551980+0000","last_became_active":"2024-04-24T23:58:04.779349+0000","last_became_peered":"2024-04-24T23:58:04.779349+0000","last_unstale":"2024-04-24T23:58:07.551980+0000","last_undegraded":"2024-04-24T23:58:07.551980+0000","last_fullsized":"2024-04-24T23:58:07.551980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:03.060917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779784+0000","last_change":"2024-04-24T23:58:05.797066+0000","last_active":"2024-04-24T23:58:06.779784+0000","last_peered":"2024-04-24T23:58:06.779784+0000","last_clean":"2024-04-24T23:58:06.779784+0000","last_became_active":"2024-04-24T23:58:05.796781+0000","last_became_peered":"2024-04-24T23:58:05.796781+0000","last_unstale":"2024-04-24T23:58:06.779784+0000","last_undegraded":"2024-04-24T23:58:06.779784+0000","last_fullsized":"2024-04-24T23:58:06.779784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779750+0000","last_change":"2024-04-24T23:58:04.762718+0000","last_active":"2024-04-24T23:58:06.779750+0000","last_peered":"2024-04-24T23:58:06.779750+0000","last_clean":"2024-04-24T23:58:06.779750+0000","last_became_active":"2024-04-24T23:58:04.762332+0000","last_became_peered":"2024-04-24T23:58:04.762332+0000","last_unstale":"2024-04-24T23:58:06.779750+0000","last_undegraded":"2024-04-24T23:58:06.779750+0000","last_fullsized":"2024-04-24T23:58:06.779750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:42.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552274+0000","last_change":"2024-04-24T23:58:05.804598+0000","last_active":"2024-04-24T23:58:07.552274+0000","last_peered":"2024-04-24T23:58:07.552274+0000","last_clean":"2024-04-24T23:58:07.552274+0000","last_became_active":"2024-04-24T23:58:05.804304+0000","last_became_peered":"2024-04-24T23:58:05.804304+0000","last_unstale":"2024-04-24T23:58:07.552274+0000","last_undegraded":"2024-04-24T23:58:07.552274+0000","last_fullsized":"2024-04-24T23:58:07.552274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778978+0000","last_change":"2024-04-24T23:58:04.771715+0000","last_active":"2024-04-24T23:58:06.778978+0000","last_peered":"2024-04-24T23:58:06.778978+0000","last_clean":"2024-04-24T23:58:06.778978+0000","last_became_active":"2024-04-24T23:58:04.771411+0000","last_became_peered":"2024-04-24T23:58:04.771411+0000","last_unstale":"2024-04-24T23:58:06.778978+0000","last_undegraded":"2024-04-24T23:58:06.778978+0000","last_fullsized":"2024-04-24T23:58:06.778978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549805+0000","last_change":"2024-04-24T23:58:05.790643+0000","last_active":"2024-04-24T23:58:07.549805+0000","last_peered":"2024-04-24T23:58:07.549805+0000","last_clean":"2024-04-24T23:58:07.549805+0000","last_became_active":"2024-04-24T23:58:05.789742+0000","last_became_peered":"2024-04-24T23:58:05.789742+0000","last_unstale":"2024-04-24T23:58:07.549805+0000","last_undegraded":"2024-04-24T23:58:07.549805+0000","last_fullsized":"2024-04-24T23:58:07.549805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547503+0000","last_change":"2024-04-24T23:58:04.778586+0000","last_active":"2024-04-24T23:58:07.547503+0000","last_peered":"2024-04-24T23:58:07.547503+0000","last_clean":"2024-04-24T23:58:07.547503+0000","last_became_active":"2024-04-24T23:58:04.778296+0000","last_became_peered":"2024-04-24T23:58:04.778296+0000","last_unstale":"2024-04-24T23:58:07.547503+0000","last_undegraded":"2024-04-24T23:58:07.547503+0000","last_fullsized":"2024-04-24T23:58:07.547503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781615+0000","last_change":"2024-04-24T23:58:05.793469+0000","last_active":"2024-04-24T23:58:06.781615+0000","last_peered":"2024-04-24T23:58:06.781615+0000","last_clean":"2024-04-24T23:58:06.781615+0000","last_became_active":"2024-04-24T23:58:05.793129+0000","last_became_peered":"2024-04-24T23:58:05.793129+0000","last_unstale":"2024-04-24T23:58:06.781615+0000","last_undegraded":"2024-04-24T23:58:06.781615+0000","last_fullsized":"2024-04-24T23:58:06.781615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:23.767095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779337+0000","last_change":"2024-04-24T23:58:04.769158+0000","last_active":"2024-04-24T23:58:06.779337+0000","last_peered":"2024-04-24T23:58:06.779337+0000","last_clean":"2024-04-24T23:58:06.779337+0000","last_became_active":"2024-04-24T23:58:04.768707+0000","last_became_peered":"2024-04-24T23:58:04.768707+0000","last_unstale":"2024-04-24T23:58:06.779337+0000","last_undegraded":"2024-04-24T23:58:06.779337+0000","last_fullsized":"2024-04-24T23:58:06.779337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550571+0000","last_change":"2024-04-24T23:58:05.797038+0000","last_active":"2024-04-24T23:58:07.550571+0000","last_peered":"2024-04-24T23:58:07.550571+0000","last_clean":"2024-04-24T23:58:07.550571+0000","last_became_active":"2024-04-24T23:58:05.796524+0000","last_became_peered":"2024-04-24T23:58:05.796524+0000","last_unstale":"2024-04-24T23:58:07.550571+0000","last_undegraded":"2024-04-24T23:58:07.550571+0000","last_fullsized":"2024-04-24T23:58:07.550571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779397+0000","last_change":"2024-04-24T23:58:04.767745+0000","last_active":"2024-04-24T23:58:06.779397+0000","last_peered":"2024-04-24T23:58:06.779397+0000","last_clean":"2024-04-24T23:58:06.779397+0000","last_became_active":"2024-04-24T23:58:04.767416+0000","last_became_peered":"2024-04-24T23:58:04.767416+0000","last_unstale":"2024-04-24T23:58:06.779397+0000","last_undegraded":"2024-04-24T23:58:06.779397+0000","last_fullsized":"2024-04-24T23:58:06.779397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:47.083120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550336+0000","last_change":"2024-04-24T23:58:05.792064+0000","last_active":"2024-04-24T23:58:07.550336+0000","last_peered":"2024-04-24T23:58:07.550336+0000","last_clean":"2024-04-24T23:58:07.550336+0000","last_became_active":"2024-04-24T23:58:05.790769+0000","last_became_peered":"2024-04-24T23:58:05.790769+0000","last_unstale":"2024-04-24T23:58:07.550336+0000","last_undegraded":"2024-04-24T23:58:07.550336+0000","last_fullsized":"2024-04-24T23:58:07.550336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549106+0000","last_change":"2024-04-24T23:58:04.778697+0000","last_active":"2024-04-24T23:58:07.549106+0000","last_peered":"2024-04-24T23:58:07.549106+0000","last_clean":"2024-04-24T23:58:07.549106+0000","last_became_active":"2024-04-24T23:58:04.778416+0000","last_became_peered":"2024-04-24T23:58:04.778416+0000","last_unstale":"2024-04-24T23:58:07.549106+0000","last_undegraded":"2024-04-24T23:58:07.549106+0000","last_fullsized":"2024-04-24T23:58:07.549106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:05.846034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780654+0000","last_change":"2024-04-24T23:58:05.771222+0000","last_active":"2024-04-24T23:58:06.780654+0000","last_peered":"2024-04-24T23:58:06.780654+0000","last_clean":"2024-04-24T23:58:06.780654+0000","last_became_active":"2024-04-24T23:58:05.769336+0000","last_became_peered":"2024-04-24T23:58:05.769336+0000","last_unstale":"2024-04-24T23:58:06.780654+0000","last_undegraded":"2024-04-24T23:58:06.780654+0000","last_fullsized":"2024-04-24T23:58:06.780654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548707+0000","last_change":"2024-04-24T23:58:05.788629+0000","last_active":"2024-04-24T23:58:07.548707+0000","last_peered":"2024-04-24T23:58:07.548707+0000","last_clean":"2024-04-24T23:58:07.548707+0000","last_became_active":"2024-04-24T23:58:05.788319+0000","last_became_peered":"2024-04-24T23:58:05.788319+0000","last_unstale":"2024-04-24T23:58:07.548707+0000","last_undegraded":"2024-04-24T23:58:07.548707+0000","last_fullsized":"2024-04-24T23:58:07.548707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551482+0000","last_change":"2024-04-24T23:58:04.777211+0000","last_active":"2024-04-24T23:58:07.551482+0000","last_peered":"2024-04-24T23:58:07.551482+0000","last_clean":"2024-04-24T23:58:07.551482+0000","last_became_active":"2024-04-24T23:58:04.776698+0000","last_became_peered":"2024-04-24T23:58:04.776698+0000","last_unstale":"2024-04-24T23:58:07.551482+0000","last_undegraded":"2024-04-24T23:58:07.551482+0000","last_fullsized":"2024-04-24T23:58:07.551482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:47.083120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549778+0000","last_change":"2024-04-24T23:58:05.792287+0000","last_active":"2024-04-24T23:58:07.549778+0000","last_peered":"2024-04-24T23:58:07.549778+0000","last_clean":"2024-04-24T23:58:07.549778+0000","last_became_active":"2024-04-24T23:58:05.791111+0000","last_became_peered":"2024-04-24T23:58:05.791111+0000","last_unstale":"2024-04-24T23:58:07.549778+0000","last_undegraded":"2024-04-24T23:58:07.549778+0000","last_fullsized":"2024-04-24T23:58:07.549778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.648636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551807+0000","last_change":"2024-04-24T23:58:04.777424+0000","last_active":"2024-04-24T23:58:07.551807+0000","last_peered":"2024-04-24T23:58:07.551807+0000","last_clean":"2024-04-24T23:58:07.551807+0000","last_became_active":"2024-04-24T23:58:04.777129+0000","last_became_peered":"2024-04-24T23:58:04.777129+0000","last_unstale":"2024-04-24T23:58:07.551807+0000","last_undegraded":"2024-04-24T23:58:07.551807+0000","last_fullsized":"2024-04-24T23:58:07.551807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:42.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549197+0000","last_change":"2024-04-24T23:58:05.783822+0000","last_active":"2024-04-24T23:58:07.549197+0000","last_peered":"2024-04-24T23:58:07.549197+0000","last_clean":"2024-04-24T23:58:07.549197+0000","last_became_active":"2024-04-24T23:58:05.783517+0000","last_became_peered":"2024-04-24T23:58:05.783517+0000","last_unstale":"2024-04-24T23:58:07.549197+0000","last_undegraded":"2024-04-24T23:58:07.549197+0000","last_fullsized":"2024-04-24T23:58:07.549197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551826+0000","last_change":"2024-04-24T23:58:04.760821+0000","last_active":"2024-04-24T23:58:07.551826+0000","last_peered":"2024-04-24T23:58:07.551826+0000","last_clean":"2024-04-24T23:58:07.551826+0000","last_became_active":"2024-04-24T23:58:04.760384+0000","last_became_peered":"2024-04-24T23:58:04.760384+0000","last_unstale":"2024-04-24T23:58:07.551826+0000","last_undegraded":"2024-04-24T23:58:07.551826+0000","last_fullsized":"2024-04-24T23:58:07.551826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551776+0000","last_change":"2024-04-24T23:58:05.800284+0000","last_active":"2024-04-24T23:58:07.551776+0000","last_peered":"2024-04-24T23:58:07.551776+0000","last_clean":"2024-04-24T23:58:07.551776+0000","last_became_active":"2024-04-24T23:58:05.799756+0000","last_became_peered":"2024-04-24T23:58:05.799756+0000","last_unstale":"2024-04-24T23:58:07.551776+0000","last_undegraded":"2024-04-24T23:58:07.551776+0000","last_fullsized":"2024-04-24T23:58:07.551776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549323+0000","last_change":"2024-04-24T23:58:04.770489+0000","last_active":"2024-04-24T23:58:07.549323+0000","last_peered":"2024-04-24T23:58:07.549323+0000","last_clean":"2024-04-24T23:58:07.549323+0000","last_became_active":"2024-04-24T23:58:04.770181+0000","last_became_peered":"2024-04-24T23:58:04.770181+0000","last_unstale":"2024-04-24T23:58:07.549323+0000","last_undegraded":"2024-04-24T23:58:07.549323+0000","last_fullsized":"2024-04-24T23:58:07.549323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:44.729552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:58:10.929 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:58:10.930 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T23:58:10.930 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T23:58:10.930 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T23:58:10.930 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T23:58:11.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.174+0000 7f77f1000640 1 Processor -- start 2024-04-24T23:58:11.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.174+0000 7f77f1000640 1 -- start start 2024-04-24T23:58:11.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.175+0000 7f77f1000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f77ec15c230 0x7f77ec071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.175+0000 7f77f1000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77ec0acda0 0x7f77ec0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.175+0000 7f77f1000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77ec0aef50 0x7f77ec0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77f1000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f77ec15c610 con 0x7f77ec15c230 2024-04-24T23:58:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77f1000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f77ec160b20 con 0x7f77ec0aef50 2024-04-24T23:58:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77f1000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77ec0ad200 con 0x7f77ec0acda0 2024-04-24T23:58:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77e9e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f77ec15c230 0x7f77ec071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77e9e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f77ec15c230 0x7f77ec071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58824/0 (socket says 172.21.15.96:58824) 2024-04-24T23:58:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77e9e00640 1 -- 172.21.15.96:0/2796009157 learned_addr learned my addr 172.21.15.96:0/2796009157 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77e9e00640 1 -- 172.21.15.96:0/2796009157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77ec0acda0 msgr2=0x7f77ec0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77e9e00640 1 --2- 172.21.15.96:0/2796009157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77ec0acda0 0x7f77ec0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77ea800640 1 --2- 172.21.15.96:0/2796009157 >> v2:172.21.15.155:3300/0 conn(0x7f77ec0aef50 0x7f77ec0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77e9e00640 1 -- 172.21.15.96:0/2796009157 >> v2:172.21.15.155:3300/0 conn(0x7f77ec0aef50 msgr2=0x7f77ec0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:11.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77e9e00640 1 --2- 172.21.15.96:0/2796009157 >> v2:172.21.15.155:3300/0 conn(0x7f77ec0aef50 0x7f77ec0722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.176+0000 7f77e9e00640 1 -- 172.21.15.96:0/2796009157 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec15fd60 con 0x7f77ec15c230 2024-04-24T23:58:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.178+0000 7f77e9e00640 1 --2- 172.21.15.96:0/2796009157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec15c230 0x7f77ec071800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0cc610 tx=0x7f77dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a50d0d29638c30d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.178+0000 7f77e8a00640 1 -- 172.21.15.96:0/2796009157 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc037070 con 0x7f77ec15c230 2024-04-24T23:58:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.178+0000 7f77e8a00640 1 -- 172.21.15.96:0/2796009157 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc032440 con 0x7f77ec15c230 2024-04-24T23:58:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.178+0000 7f77e8a00640 1 -- 172.21.15.96:0/2796009157 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc032810 con 0x7f77ec15c230 2024-04-24T23:58:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.178+0000 7f77f1000640 1 -- 172.21.15.96:0/2796009157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec15c230 msgr2=0x7f77ec071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.178+0000 7f77f1000640 1 --2- 172.21.15.96:0/2796009157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec15c230 0x7f77ec071800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0cc610 tx=0x7f77dc02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.178+0000 7f77f1000640 1 -- 172.21.15.96:0/2796009157 shutdown_connections 2024-04-24T23:58:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.179+0000 7f77f1000640 1 --2- 172.21.15.96:0/2796009157 >> v2:172.21.15.155:3300/0 conn(0x7f77ec0aef50 0x7f77ec0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.179+0000 7f77f1000640 1 --2- 172.21.15.96:0/2796009157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77ec0acda0 0x7f77ec0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.179+0000 7f77f1000640 1 --2- 172.21.15.96:0/2796009157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec15c230 0x7f77ec071800 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.179+0000 7f77f1000640 1 -- 172.21.15.96:0/2796009157 >> 172.21.15.96:0/2796009157 conn(0x7f77ec0b19c0 msgr2=0x7f77ec0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.179+0000 7f77f1000640 1 -- 172.21.15.96:0/2796009157 shutdown_connections 2024-04-24T23:58:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.179+0000 7f77f1000640 1 -- 172.21.15.96:0/2796009157 wait complete. 2024-04-24T23:58:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.180+0000 7f77f1000640 1 Processor -- start 2024-04-24T23:58:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.180+0000 7f77f1000640 1 -- start start 2024-04-24T23:58:11.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.181+0000 7f77f1000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec0acda0 0x7f77ec15ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.181+0000 7f77f1000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77ec0aef50 0x7f77ec158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.181+0000 7f77f1000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77ec15c230 0x7f77ec09d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.181+0000 7f77f1000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec160600 con 0x7f77ec0acda0 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.181+0000 7f77f1000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec160320 con 0x7f77ec0aef50 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.181+0000 7f77f1000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77ec0af3e0 con 0x7f77ec15c230 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77e9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec0acda0 0x7f77ec15ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77e9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec0acda0 0x7f77ec15ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58830/0 (socket says 172.21.15.96:58830) 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77e9e00640 1 -- 172.21.15.96:0/3582931032 learned_addr learned my addr 172.21.15.96:0/3582931032 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77e9400640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77ec0aef50 0x7f77ec158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77e9e00640 1 -- 172.21.15.96:0/3582931032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77ec15c230 msgr2=0x7f77ec09d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77ea800640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77ec15c230 0x7f77ec09d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77e9e00640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77ec15c230 0x7f77ec09d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77e9e00640 1 -- 172.21.15.96:0/3582931032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77ec0aef50 msgr2=0x7f77ec158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77e9e00640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77ec0aef50 0x7f77ec158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.182+0000 7f77e9e00640 1 -- 172.21.15.96:0/3582931032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec09c060 con 0x7f77ec0acda0 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.183+0000 7f77e9e00640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec0acda0 0x7f77ec15ee10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f77dc02a220 tx=0x7f77dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.183+0000 7f77e2000640 1 -- 172.21.15.96:0/3582931032 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc037040 con 0x7f77ec0acda0 2024-04-24T23:58:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.183+0000 7f77e2000640 1 -- 172.21.15.96:0/3582931032 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc042070 con 0x7f77ec0acda0 2024-04-24T23:58:11.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.183+0000 7f77e2000640 1 -- 172.21.15.96:0/3582931032 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc030bb0 con 0x7f77ec0acda0 2024-04-24T23:58:11.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.183+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec09c340 con 0x7f77ec0acda0 2024-04-24T23:58:11.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.183+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec09c900 con 0x7f77ec0acda0 2024-04-24T23:58:11.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.184+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ec069110 con 0x7f77ec0acda0 2024-04-24T23:58:11.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.185+0000 7f77e2000640 1 -- 172.21.15.96:0/3582931032 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77dc047460 con 0x7f77ec0acda0 2024-04-24T23:58:11.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.186+0000 7f77e2000640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f77cc06be80 0x7f77cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.186+0000 7f77e2000640 1 -- 172.21.15.96:0/3582931032 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f77dc0ab8d0 con 0x7f77ec0acda0 2024-04-24T23:58:11.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.186+0000 7f77e9400640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f77cc06be80 0x7f77cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.187+0000 7f77e9400640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f77cc06be80 0x7f77cc06e340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77ec159b70 tx=0x7f77d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:11.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.191+0000 7f77e2000640 1 -- 172.21.15.96:0/3582931032 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f77dc045360 con 0x7f77ec0acda0 2024-04-24T23:58:11.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.438+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f77ec0cf3d0 con 0x7f77ec0acda0 2024-04-24T23:58:11.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.448+0000 7f77e2000640 1 -- 172.21.15.96:0/3582931032 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172939 (secure 0 0 0) 0x7f77dc07a3f0 con 0x7f77ec0acda0 2024-04-24T23:58:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.451+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f77cc06be80 msgr2=0x7f77cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.451+0000 7f77f1000640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f77cc06be80 0x7f77cc06e340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77ec159b70 tx=0x7f77d8008040 comp rx=0 tx=0).stop 2024-04-24T23:58:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.451+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec0acda0 msgr2=0x7f77ec15ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.451+0000 7f77f1000640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec0acda0 0x7f77ec15ee10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f77dc02a220 tx=0x7f77dc0046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.452+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 shutdown_connections 2024-04-24T23:58:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.452+0000 7f77f1000640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77ec15c230 0x7f77ec09d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.452+0000 7f77f1000640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77ec0aef50 0x7f77ec158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.452+0000 7f77f1000640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f77cc06be80 0x7f77cc06e340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.452+0000 7f77f1000640 1 --2- 172.21.15.96:0/3582931032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77ec0acda0 0x7f77ec15ee10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.452+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 >> 172.21.15.96:0/3582931032 conn(0x7f77ec0b19c0 msgr2=0x7f77ec15b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.452+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 shutdown_connections 2024-04-24T23:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.452+0000 7f77f1000640 1 -- 172.21.15.96:0/3582931032 wait complete. 2024-04-24T23:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":2887634096},{"type":"v1","addr":"172.21.15.96:6833","nonce":2887634096}]},"active_addr":"172.21.15.96:6833/2887634096","active_change":"2024-04-24T23:57:46.281687+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":4164771447}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1144248579}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1924116012}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2370784008}]}]} 2024-04-24T23:58:11.473 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T23:58:11.473 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T23:58:11.473 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:11.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.666+0000 7f3e78a00640 1 Processor -- start 2024-04-24T23:58:11.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.666+0000 7f3e78a00640 1 -- start start 2024-04-24T23:58:11.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e78a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e7415c230 0x7f3e74071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e78a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740acda0 0x7f3e740aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e78a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e74160b20 con 0x7f3e740aef50 2024-04-24T23:58:11.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e78a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3e7415c610 con 0x7f3e7415c230 2024-04-24T23:58:11.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e78a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e740ad200 con 0x7f3e740acda0 2024-04-24T23:58:11.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e72800640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3e740aef50 0x7f3e740722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50946/0 (socket says 172.21.15.96:50946) 2024-04-24T23:58:11.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e72800640 1 -- 172.21.15.96:0/2658083230 learned_addr learned my addr 172.21.15.96:0/2658083230 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e71400640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740acda0 0x7f3e740aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e71e00640 1 --2- 172.21.15.96:0/2658083230 >> v2:172.21.15.155:3300/0 conn(0x7f3e7415c230 0x7f3e74071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149544845 0 0) 0x7f3e74160b20 con 0x7f3e740aef50 2024-04-24T23:58:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.668+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e58003520 con 0x7f3e740aef50 2024-04-24T23:58:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3540248071 0 0) 0x7f3e58003520 con 0x7f3e740aef50 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740acda0 msgr2=0x7f3e740aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740acda0 0x7f3e740aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 >> v2:172.21.15.155:3300/0 conn(0x7f3e7415c230 msgr2=0x7f3e74071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 --2- 172.21.15.96:0/2658083230 >> v2:172.21.15.155:3300/0 conn(0x7f3e7415c230 0x7f3e74071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7415fd60 con 0x7f3e740aef50 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f3e6c0019f0 con 0x7f3e740aef50 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 >> v1:172.21.15.96:6789/0 conn(0x7f3e740aef50 legacy=0x7f3e740722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740acda0 0x7f3e58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e58004d40 0x7f3e580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7415c610 con 0x7f3e580039b0 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e740ad200 con 0x7f3e58004d40 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5800b9c0 con 0x7f3e740acda0 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e71e00640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.669+0000 7f3e72800640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e58004d40 0x7f3e580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.670+0000 7f3e71e00640 1 -- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740acda0 msgr2=0x7f3e58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.670+0000 7f3e71e00640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740acda0 0x7f3e58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.670+0000 7f3e71e00640 1 -- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e58004d40 msgr2=0x7f3e580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.670+0000 7f3e71e00640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e58004d40 0x7f3e580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.670+0000 7f3e71e00640 1 -- 172.21.15.96:0/2658083230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e58003520 con 0x7f3e580039b0 2024-04-24T23:58:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.670+0000 7f3e72800640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e58004d40 0x7f3e580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.671+0000 7f3e71e00640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e58003dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009ac0 tx=0x7f3e58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1952a5129f137e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.671+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c036070 con 0x7f3e580039b0 2024-04-24T23:58:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.671+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c031400 con 0x7f3e580039b0 2024-04-24T23:58:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.671+0000 7f3e70a00640 1 -- 172.21.15.96:0/2658083230 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c009690 con 0x7f3e580039b0 2024-04-24T23:58:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.672+0000 7f3e78a00640 1 -- 172.21.15.96:0/2658083230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 msgr2=0x7f3e58003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.672+0000 7f3e78a00640 1 --2- 172.21.15.96:0/2658083230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e58003dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009ac0 tx=0x7f3e58005830 comp rx=0 tx=0).stop 2024-04-24T23:58:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.672+0000 7f3e72800640 1 -- 172.21.15.96:0/2658083230 reap_dead start 2024-04-24T23:58:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.672+0000 7f3e78a00640 1 -- 172.21.15.96:0/2658083230 shutdown_connections 2024-04-24T23:58:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.672+0000 7f3e78a00640 1 -- 172.21.15.96:0/2658083230 >> 172.21.15.96:0/2658083230 conn(0x7f3e740b19c0 msgr2=0x7f3e740b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.672+0000 7f3e78a00640 1 -- 172.21.15.96:0/2658083230 shutdown_connections 2024-04-24T23:58:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.672+0000 7f3e78a00640 1 -- 172.21.15.96:0/2658083230 wait complete. 2024-04-24T23:58:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.674+0000 7f3e78a00640 1 Processor -- start 2024-04-24T23:58:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.674+0000 7f3e78a00640 1 -- start start 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e78a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e741502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e78a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e7409adc0 0x7f3e7409b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e78a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740b3c90 0x7f3e740b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e78a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3e74160600 con 0x7f3e580039b0 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e78a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e74160320 con 0x7f3e7409adc0 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e78a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e740af3e0 con 0x7f3e740b3c90 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e71e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e741502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e71e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e741502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58856/0 (socket says 172.21.15.96:58856) 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e71e00640 1 -- 172.21.15.96:0/196032577 learned_addr learned my addr 172.21.15.96:0/196032577 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e71400640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e7409adc0 0x7f3e7409b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e71e00640 1 -- 172.21.15.96:0/196032577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740b3c90 msgr2=0x7f3e740b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e71e00640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740b3c90 0x7f3e740b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e71e00640 1 -- 172.21.15.96:0/196032577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e7409adc0 msgr2=0x7f3e7409b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e71e00640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e7409adc0 0x7f3e7409b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.675+0000 7f3e71e00640 1 -- 172.21.15.96:0/196032577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e74150830 con 0x7f3e580039b0 2024-04-24T23:58:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.676+0000 7f3e71e00640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e741502f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c034040 tx=0x7f3e5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.676+0000 7f3e6a000640 1 -- 172.21.15.96:0/196032577 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c040020 con 0x7f3e580039b0 2024-04-24T23:58:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.676+0000 7f3e6a000640 1 -- 172.21.15.96:0/196032577 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c003950 con 0x7f3e580039b0 2024-04-24T23:58:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.676+0000 7f3e6a000640 1 -- 172.21.15.96:0/196032577 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c036040 con 0x7f3e580039b0 2024-04-24T23:58:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.676+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e74158780 con 0x7f3e580039b0 2024-04-24T23:58:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.676+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e74158d40 con 0x7f3e580039b0 2024-04-24T23:58:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.677+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e74069110 con 0x7f3e580039b0 2024-04-24T23:58:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.678+0000 7f3e6a000640 1 -- 172.21.15.96:0/196032577 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e5c043020 con 0x7f3e580039b0 2024-04-24T23:58:11.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.679+0000 7f3e6a000640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3e5006be60 0x7f3e5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:11.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.679+0000 7f3e6a000640 1 -- 172.21.15.96:0/196032577 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3e5c0aafe0 con 0x7f3e580039b0 2024-04-24T23:58:11.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.679+0000 7f3e71400640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3e5006be60 0x7f3e5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:11.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.680+0000 7f3e71400640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3e5006be60 0x7f3e5006e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009a50 tx=0x7f3e64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:11.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.683+0000 7f3e6a000640 1 -- 172.21.15.96:0/196032577 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e5c04a070 con 0x7f3e580039b0 2024-04-24T23:58:11.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.886+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e7415a630 con 0x7f3e580039b0 2024-04-24T23:58:11.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.887+0000 7f3e6a000640 1 -- 172.21.15.96:0/196032577 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7f3e74150830 con 0x7f3e580039b0 2024-04-24T23:58:11.888 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:11.888 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.890+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3e5006be60 msgr2=0x7f3e5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.890+0000 7f3e78a00640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3e5006be60 0x7f3e5006e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009a50 tx=0x7f3e64008040 comp rx=0 tx=0).stop 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.890+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 msgr2=0x7f3e741502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.890+0000 7f3e78a00640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e741502f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c034040 tx=0x7f3e5c004730 comp rx=0 tx=0).stop 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.891+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 shutdown_connections 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.891+0000 7f3e78a00640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e740b3c90 0x7f3e740b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.891+0000 7f3e78a00640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e7409adc0 0x7f3e7409b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.891+0000 7f3e78a00640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3e5006be60 0x7f3e5006e320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.891+0000 7f3e78a00640 1 --2- 172.21.15.96:0/196032577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e580039b0 0x7f3e741502f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.891+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 >> 172.21.15.96:0/196032577 conn(0x7f3e740b19c0 msgr2=0x7f3e740b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.891+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 shutdown_connections 2024-04-24T23:58:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:11.891+0000 7f3e78a00640 1 -- 172.21.15.96:0/196032577 wait complete. 2024-04-24T23:58:11.911 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T23:58:11.911 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:12.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.114+0000 7fadc1800640 1 Processor -- start 2024-04-24T23:58:12.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.114+0000 7fadc1800640 1 -- start start 2024-04-24T23:58:12.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadc1800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fadbc15c230 0x7fadbc071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadc1800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fadbc0acda0 0x7fadbc0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadc1800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadbc160b20 con 0x7fadbc0aef50 2024-04-24T23:58:12.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadc1800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fadbc15c610 con 0x7fadbc0acda0 2024-04-24T23:58:12.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadc1800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fadbc0ad230 con 0x7fadbc15c230 2024-04-24T23:58:12.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadba000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fadbc0acda0 0x7fadbc0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadba000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fadbc0acda0 0x7fadbc0aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58862/0 (socket says 172.21.15.96:58862) 2024-04-24T23:58:12.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadba000640 1 -- 172.21.15.96:0/710060223 learned_addr learned my addr 172.21.15.96:0/710060223 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadbaa00640 1 --2- 172.21.15.96:0/710060223 >> v2:172.21.15.155:3300/0 conn(0x7fadbc15c230 0x7fadbc071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadba000640 1 -- 172.21.15.96:0/710060223 >> v2:172.21.15.155:3300/0 conn(0x7fadbc15c230 msgr2=0x7fadbc071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.116+0000 7fadba000640 1 --2- 172.21.15.96:0/710060223 >> v2:172.21.15.155:3300/0 conn(0x7fadbc15c230 0x7fadbc071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.117+0000 7fadba000640 1 -- 172.21.15.96:0/710060223 >> v1:172.21.15.155:6789/0 conn(0x7fadbc0aef50 legacy=0x7fadbc0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.117+0000 7fadba000640 1 -- 172.21.15.96:0/710060223 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc15fd60 con 0x7fadbc0acda0 2024-04-24T23:58:12.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.118+0000 7fadba000640 1 --2- 172.21.15.96:0/710060223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 0x7fadbc0aea10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fadbc06c070 tx=0x7fada802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6243b3470ccc2e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.118+0000 7fadb9600640 1 -- 172.21.15.96:0/710060223 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8037070 con 0x7fadbc0acda0 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.118+0000 7fadb9600640 1 -- 172.21.15.96:0/710060223 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada8032440 con 0x7fadbc0acda0 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.118+0000 7fadb9600640 1 -- 172.21.15.96:0/710060223 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8032810 con 0x7fadbc0acda0 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.118+0000 7fadc1800640 1 -- 172.21.15.96:0/710060223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 msgr2=0x7fadbc0aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.118+0000 7fadc1800640 1 --2- 172.21.15.96:0/710060223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 0x7fadbc0aea10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fadbc06c070 tx=0x7fada802a230 comp rx=0 tx=0).stop 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.119+0000 7fadc1800640 1 -- 172.21.15.96:0/710060223 shutdown_connections 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.119+0000 7fadc1800640 1 --2- 172.21.15.96:0/710060223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 0x7fadbc0aea10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.119+0000 7fadc1800640 1 --2- 172.21.15.96:0/710060223 >> v2:172.21.15.155:3300/0 conn(0x7fadbc15c230 0x7fadbc071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.119+0000 7fadc1800640 1 -- 172.21.15.96:0/710060223 >> 172.21.15.96:0/710060223 conn(0x7fadbc0b19c0 msgr2=0x7fadbc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.119+0000 7fadc1800640 1 -- 172.21.15.96:0/710060223 shutdown_connections 2024-04-24T23:58:12.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.119+0000 7fadc1800640 1 -- 172.21.15.96:0/710060223 wait complete. 2024-04-24T23:58:12.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.120+0000 7fadc1800640 1 Processor -- start 2024-04-24T23:58:12.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.120+0000 7fadc1800640 1 -- start start 2024-04-24T23:58:12.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.121+0000 7fadc1800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 0x7fadbc15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.121+0000 7fadc1800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadbc0aef50 0x7fadbc14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.121+0000 7fadc1800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadbc15c230 0x7fadbc09b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.121+0000 7fadc1800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc160600 con 0x7fadbc0acda0 2024-04-24T23:58:12.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.121+0000 7fadc1800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc160320 con 0x7fadbc15c230 2024-04-24T23:58:12.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.121+0000 7fadc1800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fadbc06db80 con 0x7fadbc0aef50 2024-04-24T23:58:12.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbaa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 0x7fadbc15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbaa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 0x7fadbc15ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58870/0 (socket says 172.21.15.96:58870) 2024-04-24T23:58:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbaa00640 1 -- 172.21.15.96:0/2194167638 learned_addr learned my addr 172.21.15.96:0/2194167638 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbb400640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadbc15c230 0x7fadbc09b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbaa00640 1 -- 172.21.15.96:0/2194167638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadbc0aef50 msgr2=0x7fadbc14e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbaa00640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadbc0aef50 0x7fadbc14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbaa00640 1 -- 172.21.15.96:0/2194167638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadbc15c230 msgr2=0x7fadbc09b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbaa00640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadbc15c230 0x7fadbc09b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbaa00640 1 -- 172.21.15.96:0/2194167638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc09bcd0 con 0x7fadbc0acda0 2024-04-24T23:58:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.122+0000 7fadbaa00640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 0x7fadbc15ef40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c820 tx=0x7fadac00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.123+0000 7fadb2a00640 1 -- 172.21.15.96:0/2194167638 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac015070 con 0x7fadbc0acda0 2024-04-24T23:58:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.123+0000 7fadb2a00640 1 -- 172.21.15.96:0/2194167638 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac004020 con 0x7fadbc0acda0 2024-04-24T23:58:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.123+0000 7fadb2a00640 1 -- 172.21.15.96:0/2194167638 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac0043f0 con 0x7fadbc0acda0 2024-04-24T23:58:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.123+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadbc09bfb0 con 0x7fadbc0acda0 2024-04-24T23:58:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.123+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadbc09c570 con 0x7fadbc0acda0 2024-04-24T23:58:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.124+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadbc06f6a0 con 0x7fadbc0acda0 2024-04-24T23:58:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.125+0000 7fadb2a00640 1 -- 172.21.15.96:0/2194167638 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadac007830 con 0x7fadbc0acda0 2024-04-24T23:58:12.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.126+0000 7fadb2a00640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9c06be30 0x7fad9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.126+0000 7fadb2a00640 1 -- 172.21.15.96:0/2194167638 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fadac08ace0 con 0x7fadbc0acda0 2024-04-24T23:58:12.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.126+0000 7fadba000640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9c06be30 0x7fad9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.127+0000 7fadba000640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9c06be30 0x7fad9c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fada8034000 tx=0x7fada802c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.130+0000 7fadb2a00640 1 -- 172.21.15.96:0/2194167638 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fadbc06f6a0 con 0x7fadbc0acda0 2024-04-24T23:58:12.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.330+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadbc069110 con 0x7fadbc0acda0 2024-04-24T23:58:12.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.333+0000 7fadb2a00640 1 -- 172.21.15.96:0/2194167638 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7fadac0595f0 con 0x7fadbc0acda0 2024-04-24T23:58:12.334 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:12.334 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9c06be30 msgr2=0x7fad9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9c06be30 0x7fad9c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fada8034000 tx=0x7fada802c000 comp rx=0 tx=0).stop 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 msgr2=0x7fadbc15ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 0x7fadbc15ef40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c820 tx=0x7fadac00cce0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 shutdown_connections 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadbc15c230 0x7fadbc09b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadbc0aef50 0x7fadbc14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9c06be30 0x7fad9c06e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 --2- 172.21.15.96:0/2194167638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadbc0acda0 0x7fadbc15ef40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 >> 172.21.15.96:0/2194167638 conn(0x7fadbc0b19c0 msgr2=0x7fadbc0cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.336+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 shutdown_connections 2024-04-24T23:58:12.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.337+0000 7fadc1800640 1 -- 172.21.15.96:0/2194167638 wait complete. 2024-04-24T23:58:12.357 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T23:58:12.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T23:58:12.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T23:58:12.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T23:58:12.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-24T23:58:12.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-24T23:58:12.360 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-24T23:58:12.360 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-24T23:58:12.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.646+0000 7f0f3fe00640 1 Processor -- start 2024-04-24T23:58:12.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.646+0000 7f0f3fe00640 1 -- start start 2024-04-24T23:58:12.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.648+0000 7f0f3fe00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0f380dfec0 0x7f0f38052600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.648+0000 7f0f3fe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f380398d0 0x7f0f3804fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.648+0000 7f0f3fe00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f38039dd0 con 0x7f0f38052b40 2024-04-24T23:58:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.648+0000 7f0f3fe00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3803a0b0 con 0x7f0f380398d0 2024-04-24T23:58:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.648+0000 7f0f3fe00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3804f080 con 0x7f0f380dfec0 2024-04-24T23:58:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.649+0000 7f0f3e000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f380398d0 0x7f0f3804fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.649+0000 7f0f3e000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f380398d0 0x7f0f3804fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58876/0 (socket says 172.21.15.96:58876) 2024-04-24T23:58:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.649+0000 7f0f3e000640 1 -- 172.21.15.96:0/2719543517 learned_addr learned my addr 172.21.15.96:0/2719543517 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.650+0000 7f0f3e000640 1 -- 172.21.15.96:0/2719543517 >> v2:172.21.15.155:3300/0 conn(0x7f0f380dfec0 msgr2=0x7f0f38052600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-24T23:58:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.650+0000 7f0f3e000640 1 --2- 172.21.15.96:0/2719543517 >> v2:172.21.15.155:3300/0 conn(0x7f0f380dfec0 0x7f0f38052600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.650+0000 7f0f3e000640 1 -- 172.21.15.96:0/2719543517 >> v1:172.21.15.155:6789/0 conn(0x7f0f38052b40 legacy=0x7f0f380506f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-24T23:58:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.650+0000 7f0f3e000640 1 -- 172.21.15.96:0/2719543517 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3804f360 con 0x7f0f380398d0 2024-04-24T23:58:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.651+0000 7f0f3e000640 1 --2- 172.21.15.96:0/2719543517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f380398d0 0x7f0f3804fb60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f40050ce0 tx=0x7f0f400a9a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59681e281fc4105 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.652+0000 7f0f3d600640 1 -- 172.21.15.96:0/2719543517 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f400b2070 con 0x7f0f380398d0 2024-04-24T23:58:12.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.652+0000 7f0f3d600640 1 -- 172.21.15.96:0/2719543517 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f400ae6f0 con 0x7f0f380398d0 2024-04-24T23:58:12.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.652+0000 7f0f3d600640 1 -- 172.21.15.96:0/2719543517 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f400aeb60 con 0x7f0f380398d0 2024-04-24T23:58:12.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.653+0000 7fcc55200640 1 Processor -- start 2024-04-24T23:58:12.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.653+0000 7ff9b0c00640 1 Processor -- start 2024-04-24T23:58:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.654+0000 7ff9b0c00640 1 -- start start 2024-04-24T23:58:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.654+0000 7f0f3fe00640 1 -- 172.21.15.96:0/2719543517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f380398d0 msgr2=0x7f0f3804fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.654+0000 7f0f3fe00640 1 --2- 172.21.15.96:0/2719543517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f380398d0 0x7f0f3804fb60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f40050ce0 tx=0x7f0f400a9a20 comp rx=0 tx=0).stop 2024-04-24T23:58:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.653+0000 7fcc55200640 1 -- start start 2024-04-24T23:58:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7ff9b0c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff9a40e3160 0x7ff9a40e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7fcc55200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc500b24b0 0x7fcc500716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7fcc55200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcc5015a220 0x7fcc5015dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7fcc55200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc500ad4b0 con 0x7fcc5015e940 2024-04-24T23:58:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7fcc55200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fcc500b32e0 con 0x7fcc5015a220 2024-04-24T23:58:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7fcc55200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcc500b4140 con 0x7fcc500b24b0 2024-04-24T23:58:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7ff9b0c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9a4053cb0 0x7ff9a4054100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7ff9b0c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a4058810 con 0x7ff9a403c0a0 2024-04-24T23:58:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7ff9b0c00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a4007b70 con 0x7ff9a40e3160 2024-04-24T23:58:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.655+0000 7ff9b0c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a4058af0 con 0x7ff9a4053cb0 2024-04-24T23:58:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7f0f3fe00640 1 -- 172.21.15.96:0/2719543517 shutdown_connections 2024-04-24T23:58:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7f0f3fe00640 1 --2- 172.21.15.96:0/2719543517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f380398d0 0x7f0f3804fb60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7ffa09800640 1 Processor -- start 2024-04-24T23:58:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7fcc4de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc500b24b0 0x7fcc500716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7f0f3fe00640 1 --2- 172.21.15.96:0/2719543517 >> v2:172.21.15.155:3300/0 conn(0x7f0f380dfec0 0x7f0f38052600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7f0f3fe00640 1 -- 172.21.15.96:0/2719543517 >> 172.21.15.96:0/2719543517 conn(0x7f0f38009fb0 msgr2=0x7f0f3800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7ffa09800640 1 -- start start 2024-04-24T23:58:12.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7fcc4d400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fcc5015e940 0x7fcc500acda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50960/0 (socket says 172.21.15.96:50960) 2024-04-24T23:58:12.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7ff9abe00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9a4053cb0 0x7ff9a4054100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7f0f3fe00640 1 -- 172.21.15.96:0/2719543517 shutdown_connections 2024-04-24T23:58:12.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.657+0000 7ff9abe00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9a4053cb0 0x7ff9a4054100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45770/0 (socket says 172.21.15.96:45770) 2024-04-24T23:58:12.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.657+0000 7ff9abe00640 1 -- 172.21.15.96:0/2230167549 learned_addr learned my addr 172.21.15.96:0/2230167549 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7fcc4d400640 1 -- 172.21.15.96:0/1780907456 learned_addr learned my addr 172.21.15.96:0/1780907456 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:12.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.656+0000 7fcc4de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc500b24b0 0x7fcc500716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53102/0 (socket says 172.21.15.96:53102) 2024-04-24T23:58:12.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.657+0000 7f0f3fe00640 1 -- 172.21.15.96:0/2719543517 wait complete. 2024-04-24T23:58:12.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.657+0000 7fcc4e800640 1 --2- 172.21.15.96:0/1780907456 >> v2:172.21.15.96:3300/0 conn(0x7fcc5015a220 0x7fcc5015dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.657+0000 7ff9ab400640 1 --2- 172.21.15.96:0/2230167549 >> v2:172.21.15.96:3300/0 conn(0x7ff9a40e3160 0x7ff9a40e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.657+0000 7fb067200640 1 Processor -- start 2024-04-24T23:58:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7ff9aa000640 1 -- 172.21.15.96:0/2230167549 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051931256 0 0) 0x7ff9a4058810 con 0x7ff9a403c0a0 2024-04-24T23:58:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7fcc4de00640 1 -- 172.21.15.96:0/1780907456 >> v2:172.21.15.96:3300/0 conn(0x7fcc5015a220 msgr2=0x7fcc5015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7fcc4ca00640 1 -- 172.21.15.96:0/1780907456 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3542225683 0 0) 0x7fcc500ad4b0 con 0x7fcc5015e940 2024-04-24T23:58:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7fcc4de00640 1 --2- 172.21.15.96:0/1780907456 >> v2:172.21.15.96:3300/0 conn(0x7fcc5015a220 0x7fcc5015dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7fcc4de00640 1 -- 172.21.15.96:0/1780907456 >> v1:172.21.15.96:6789/0 conn(0x7fcc5015e940 legacy=0x7fcc500acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7fcc4de00640 1 -- 172.21.15.96:0/1780907456 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc500b3530 con 0x7fcc500b24b0 2024-04-24T23:58:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7fb067200640 1 -- start start 2024-04-24T23:58:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7ffa09800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa0415e210 0x7ffa0406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7ffa09800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa040cf3d0 0x7ffa0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7ffa09800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa040d2cc0 con 0x7ffa0415e5f0 2024-04-24T23:58:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7fcc4e800640 1 --2- 172.21.15.96:0/1780907456 >> v2:172.21.15.96:3300/0 conn(0x7fcc5015a220 0x7fcc5015dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7ffa09800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffa0406c6f0 con 0x7ffa040cf3d0 2024-04-24T23:58:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7ffa09800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa040d2fa0 con 0x7ffa0415e210 2024-04-24T23:58:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.658+0000 7ff9aa000640 1 -- 172.21.15.96:0/2230167549 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff994003520 con 0x7ff9a403c0a0 2024-04-24T23:58:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.659+0000 7ffa02000640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ffa0415e5f0 0x7ffa040cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50970/0 (socket says 172.21.15.96:50970) 2024-04-24T23:58:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.659+0000 7ffa02000640 1 -- 172.21.15.96:0/690535994 learned_addr learned my addr 172.21.15.96:0/690535994 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.659+0000 7ff9abe00640 1 -- 172.21.15.96:0/2230167549 >> v2:172.21.15.96:3300/0 conn(0x7ff9a40e3160 msgr2=0x7ff9a40e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.659+0000 7ffa02a00640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa0415e210 0x7ffa0406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.659+0000 7f0f3fe00640 1 Processor -- start 2024-04-24T23:58:12.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7fcc4de00640 1 --2- 172.21.15.96:0/1780907456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc500b24b0 0x7fcc500716e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097a0 tx=0x7fcc4002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42eff3ae230fc58e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2971161001 0 0) 0x7ffa040d2cc0 con 0x7ffa0415e5f0 2024-04-24T23:58:12.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e8003520 con 0x7ffa0415e5f0 2024-04-24T23:58:12.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7f0f3fe00640 1 -- start start 2024-04-24T23:58:12.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3705063822 0 0) 0x7ff9e8003520 con 0x7ffa0415e5f0 2024-04-24T23:58:12.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa0415e210 msgr2=0x7ffa0406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa0415e210 0x7ffa0406cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 >> v2:172.21.15.155:3300/0 conn(0x7ffa040cf3d0 msgr2=0x7ffa0406d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa03400640 1 --2- 172.21.15.96:0/690535994 >> v2:172.21.15.155:3300/0 conn(0x7ffa040cf3d0 0x7ffa0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 --2- 172.21.15.96:0/690535994 >> v2:172.21.15.155:3300/0 conn(0x7ffa040cf3d0 0x7ffa0406d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0406c0a0 con 0x7ffa0415e5f0 2024-04-24T23:58:12.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7ff9f0001670 con 0x7ffa0415e5f0 2024-04-24T23:58:12.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7fcc4ca00640 1 -- 172.21.15.96:0/1780907456 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40037070 con 0x7fcc500b24b0 2024-04-24T23:58:12.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7fcc4ca00640 1 -- 172.21.15.96:0/1780907456 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc40032440 con 0x7fcc500b24b0 2024-04-24T23:58:12.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 >> v1:172.21.15.96:6789/0 conn(0x7ffa0415e5f0 legacy=0x7ffa040cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7fcc4ca00640 1 -- 172.21.15.96:0/1780907456 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40032810 con 0x7fcc500b24b0 2024-04-24T23:58:12.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa0415e210 0x7ff9e80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e8003f30 0x7ff9e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e8004d40 0x7ff9e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0406c6f0 con 0x7ff9e8004d40 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa040d2fa0 con 0x7ff9e8003f30 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e800baf0 con 0x7ffa0415e210 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.660+0000 7ffa03400640 1 --2- 172.21.15.96:0/690535994 >> v2:172.21.15.155:3300/0 conn(0x7ffa040cf3d0 0x7ffa0406d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.661+0000 7ffa03400640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e8004d40 0x7ff9e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.661+0000 7ffa02000640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e8003f30 0x7ff9e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.661+0000 7ffa02a00640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa0415e210 0x7ff9e80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7f0f3fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380398d0 0x7f0f38180040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7f0f3fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f38052b40 0x7f0f38188ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7f0f3fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f380dfec0 0x7f0f38187270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7f0f3e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f38052b40 0x7f0f38188ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7f0f3e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f38052b40 0x7f0f38188ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53128/0 (socket says 172.21.15.96:53128) 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7f0f3ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380398d0 0x7f0f38180040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7f0f3ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380398d0 0x7f0f38180040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45794/0 (socket says 172.21.15.96:45794) 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7f0f3e000640 1 -- 172.21.15.96:0/709076734 learned_addr learned my addr 172.21.15.96:0/709076734 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7f0f3fe00640 1 -- 172.21.15.96:0/709076734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0f38054350 con 0x7f0f380dfec0 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7f0f3fe00640 1 -- 172.21.15.96:0/709076734 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f380e02a0 con 0x7f0f380398d0 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7f0f3fe00640 1 -- 172.21.15.96:0/709076734 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f380544d0 con 0x7f0f38052b40 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7f0f3f400640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f380dfec0 0x7f0f38187270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.661+0000 7fcc55200640 1 -- 172.21.15.96:0/1780907456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc500b24b0 msgr2=0x7fcc500716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.661+0000 7fcc55200640 1 --2- 172.21.15.96:0/1780907456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc500b24b0 0x7fcc500716e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097a0 tx=0x7fcc4002a180 comp rx=0 tx=0).stop 2024-04-24T23:58:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7fcc55200640 1 -- 172.21.15.96:0/1780907456 shutdown_connections 2024-04-24T23:58:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7fcc55200640 1 --2- 172.21.15.96:0/1780907456 >> v2:172.21.15.96:3300/0 conn(0x7fcc5015a220 0x7fcc5015dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7fcc55200640 1 --2- 172.21.15.96:0/1780907456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc500b24b0 0x7fcc500716e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7fcc55200640 1 -- 172.21.15.96:0/1780907456 >> 172.21.15.96:0/1780907456 conn(0x7fcc500b19c0 msgr2=0x7fcc500b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7fb067200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb06815a210 0x7fb0680cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7ffa03400640 1 -- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa0415e210 msgr2=0x7ff9e80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7ffa03400640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa0415e210 0x7ff9e80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7ffa03400640 1 -- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e8003f30 msgr2=0x7ff9e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7ffa03400640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e8003f30 0x7ff9e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7ffa02a00640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa0415e210 0x7ff9e80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7ffa03400640 1 -- 172.21.15.96:0/690535994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0406c0a0 con 0x7ff9e8004d40 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7ffa03400640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e8004d40 0x7ff9e80051c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400aa70 tx=0x7ff9e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c61b46dd3942937 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f400a640 con 0x7ff9e8004d40 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f402ac70 con 0x7ff9e8004d40 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7ffa01600640 1 -- 172.21.15.96:0/690535994 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4004240 con 0x7ff9e8004d40 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.659+0000 7ff9abe00640 1 --2- 172.21.15.96:0/2230167549 >> v2:172.21.15.96:3300/0 conn(0x7ff9a40e3160 0x7ff9a40e7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.659+0000 7ff9abe00640 1 -- 172.21.15.96:0/2230167549 >> v1:172.21.15.155:6789/0 conn(0x7ff9a403c0a0 legacy=0x7ff9a4058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.659+0000 7ff9abe00640 1 -- 172.21.15.96:0/2230167549 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a4006360 con 0x7ff9a4053cb0 2024-04-24T23:58:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7ff9ab400640 1 --2- 172.21.15.96:0/2230167549 >> v2:172.21.15.96:3300/0 conn(0x7ff9a40e3160 0x7ff9a40e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.663+0000 7ff9abe00640 1 --2- 172.21.15.96:0/2230167549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9a4053cb0 0x7ff9a4054100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4008660 tx=0x7ff9a002a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8c02d14dea2257b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7ff9f3c00640 1 Processor -- start 2024-04-24T23:58:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.662+0000 7ff9f3c00640 1 -- start start 2024-04-24T23:58:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7fcc55200640 1 -- 172.21.15.96:0/1780907456 shutdown_connections 2024-04-24T23:58:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7fcc55200640 1 -- 172.21.15.96:0/1780907456 wait complete. 2024-04-24T23:58:12.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7fb067200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680cc2b0 0x7fb068072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7ffa09800640 1 -- 172.21.15.96:0/690535994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e8004d40 msgr2=0x7ff9e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7ffa09800640 1 --2- 172.21.15.96:0/690535994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e8004d40 0x7ff9e80051c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400aa70 tx=0x7ff9e8005830 comp rx=0 tx=0).stop 2024-04-24T23:58:12.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7ffa03400640 1 -- 172.21.15.96:0/690535994 reap_dead start 2024-04-24T23:58:12.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7ffa09800640 1 -- 172.21.15.96:0/690535994 shutdown_connections 2024-04-24T23:58:12.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7ffa09800640 1 -- 172.21.15.96:0/690535994 >> 172.21.15.96:0/690535994 conn(0x7ffa0408dbb0 msgr2=0x7ffa0409d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7fb065e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb06815a210 0x7fb0680cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.664+0000 7fb065e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb06815a210 0x7fb0680cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45808/0 (socket says 172.21.15.96:45808) 2024-04-24T23:58:12.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7ff9f3c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9ec0b24b0 0x7ff9ec15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7ffa09800640 1 -- 172.21.15.96:0/690535994 shutdown_connections 2024-04-24T23:58:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7ff9f3c00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec0b3530 con 0x7ff9ec15e4b0 2024-04-24T23:58:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7ff9f3c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec0b3810 con 0x7ff9ec15e940 2024-04-24T23:58:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7ff9f3c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ec0b32e0 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7fb065e00640 1 -- 172.21.15.96:0/1885119655 learned_addr learned my addr 172.21.15.96:0/1885119655 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7ff9f1c00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff9ec15e4b0 0x7ff9ec0b45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50976/0 (socket says 172.21.15.96:50976) 2024-04-24T23:58:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7ff9f1200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9ec0b24b0 0x7ff9ec15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7ff9f1c00640 1 -- 172.21.15.96:0/3989281309 learned_addr learned my addr 172.21.15.96:0/3989281309 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:12.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7f042ec00640 1 Processor -- start 2024-04-24T23:58:12.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7f0f3e000640 1 -- 172.21.15.96:0/709076734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380398d0 msgr2=0x7f0f38180040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7f0f3e000640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380398d0 0x7f0f38180040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7f0f3e000640 1 -- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f380dfec0 msgr2=0x7f0f38187270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7f0f3e000640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f380dfec0 0x7f0f38187270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7f0f3e000640 1 -- 172.21.15.96:0/709076734 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f38180580 con 0x7f0f38052b40 2024-04-24T23:58:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7fcc55200640 1 Processor -- start 2024-04-24T23:58:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7fcc55200640 1 -- start start 2024-04-24T23:58:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7fb067200640 1 -- 172.21.15.96:0/1885119655 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0680cede0 con 0x7fb0680726c0 2024-04-24T23:58:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7fb067200640 1 -- 172.21.15.96:0/1885119655 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb0680cc060 con 0x7fb06815a210 2024-04-24T23:58:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7fb067200640 1 -- 172.21.15.96:0/1885119655 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb0680ce260 con 0x7fb0680cc2b0 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9aa000640 1 -- 172.21.15.96:0/2230167549 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0037070 con 0x7ff9a4053cb0 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9aa000640 1 -- 172.21.15.96:0/2230167549 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a0032440 con 0x7ff9a4053cb0 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9aa000640 1 -- 172.21.15.96:0/2230167549 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0032850 con 0x7ff9a4053cb0 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2230167549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9a4053cb0 msgr2=0x7ff9a4054100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9b0c00640 1 --2- 172.21.15.96:0/2230167549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9a4053cb0 0x7ff9a4054100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4008660 tx=0x7ff9a002a2a0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2230167549 shutdown_connections 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7ff9b0c00640 1 --2- 172.21.15.96:0/2230167549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9a4053cb0 0x7ff9a4054100 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7ff9b0c00640 1 --2- 172.21.15.96:0/2230167549 >> v2:172.21.15.96:3300/0 conn(0x7ff9a40e3160 0x7ff9a40e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2230167549 >> 172.21.15.96:0/2230167549 conn(0x7ff9a4058ee0 msgr2=0x7ff9a40592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2230167549 shutdown_connections 2024-04-24T23:58:12.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9eb400640 1 -- 172.21.15.96:0/3989281309 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864706786 0 0) 0x7ff9ec0b3530 con 0x7ff9ec15e4b0 2024-04-24T23:58:12.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9eb400640 1 -- 172.21.15.96:0/3989281309 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9d4003520 con 0x7ff9ec15e4b0 2024-04-24T23:58:12.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9f1200640 1 -- 172.21.15.96:0/3989281309 >> v1:172.21.15.155:6789/0 conn(0x7ff9ec15e940 legacy=0x7ff9ec15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7f042ec00640 1 -- start start 2024-04-24T23:58:12.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7fb064a00640 1 -- 172.21.15.96:0/1885119655 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935539691 0 0) 0x7fb0680cede0 con 0x7fb0680726c0 2024-04-24T23:58:12.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7fb065400640 1 --2- 172.21.15.96:0/1885119655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680cc2b0 0x7fb068072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7fb064a00640 1 -- 172.21.15.96:0/1885119655 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb04c003520 con 0x7fb0680726c0 2024-04-24T23:58:12.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7f0f3f400640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f380dfec0 0x7f0f38187270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:12.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7f0f3ea00640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380398d0 0x7f0f38180040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:12.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9f1200640 1 -- 172.21.15.96:0/3989281309 >> v1:172.21.15.96:6789/0 conn(0x7ff9ec15e4b0 legacy=0x7ff9ec0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7ff9f1200640 1 -- 172.21.15.96:0/3989281309 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec0b3af0 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.666+0000 7ff9eb400640 1 -- 172.21.15.96:0/3989281309 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2561539523 0 0) 0x7ff9d4003520 con 0x7ff9ec15e4b0 2024-04-24T23:58:12.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.665+0000 7ffa09800640 1 -- 172.21.15.96:0/690535994 wait complete. 2024-04-24T23:58:12.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7fcc55200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5015a220 0x7fcc501403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7fcc55200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5015e940 0x7fcc500cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7fcc55200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc5006dc80 0x7fcc5006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7fb065400640 1 -- 172.21.15.96:0/1885119655 >> v2:172.21.15.155:3300/0 conn(0x7fb06815a210 msgr2=0x7fb0680cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7ffa09800640 1 Processor -- start 2024-04-24T23:58:12.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7fb065400640 1 --2- 172.21.15.96:0/1885119655 >> v2:172.21.15.155:3300/0 conn(0x7fb06815a210 0x7fb0680cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7fb065400640 1 -- 172.21.15.96:0/1885119655 >> v1:172.21.15.155:6789/0 conn(0x7fb0680726c0 legacy=0x7fb06815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.667+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2230167549 wait complete. 2024-04-24T23:58:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7f042ec00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f04280b3b30 0x7f04280d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7f042ec00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04280d2cf0 0x7f04280cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7f042ec00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04280d0b30 con 0x7f04281619d0 2024-04-24T23:58:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7fcc4d400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5015e940 0x7fcc500cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7f042ec00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f04280d0e10 con 0x7f04280b3b30 2024-04-24T23:58:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7f042ec00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f04280d10f0 con 0x7f04280d2cf0 2024-04-24T23:58:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7f0427e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f04281619d0 0x7f04280d1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50992/0 (socket says 172.21.15.96:50992) 2024-04-24T23:58:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7f0427e00640 1 -- 172.21.15.96:0/2314984634 learned_addr learned my addr 172.21.15.96:0/2314984634 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7f0427400640 1 --2- 172.21.15.96:0/2314984634 >> v2:172.21.15.96:3300/0 conn(0x7f04280b3b30 0x7f04280d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f042cc00640 1 --2- 172.21.15.96:0/2314984634 >> v2:172.21.15.155:3300/0 conn(0x7f04280d2cf0 0x7f04280cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7ff9f1200640 1 --2- 172.21.15.96:0/3989281309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 0x7ff9ec15a2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097a0 tx=0x7ff9e002a120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41c4708d0861f9d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f1a02c00640 1 Processor -- start 2024-04-24T23:58:12.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7fcc4d400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5015e940 0x7fcc500cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45840/0 (socket says 172.21.15.96:45840) 2024-04-24T23:58:12.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7ffa09800640 1 -- start start 2024-04-24T23:58:12.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7fcc4de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5015a220 0x7fcc501403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7fcc4de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5015a220 0x7fcc501403c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53156/0 (socket says 172.21.15.96:53156) 2024-04-24T23:58:12.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f1a02c00640 1 -- start start 2024-04-24T23:58:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f0426a00640 1 -- 172.21.15.96:0/2314984634 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922072264 0 0) 0x7f04280d0b30 con 0x7f04281619d0 2024-04-24T23:58:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f0426a00640 1 -- 172.21.15.96:0/2314984634 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f040c003520 con 0x7f04281619d0 2024-04-24T23:58:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7fcc4d400640 1 -- 172.21.15.96:0/1147537395 learned_addr learned my addr 172.21.15.96:0/1147537395 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7fcc55200640 1 -- 172.21.15.96:0/1147537395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcc500b3dd0 con 0x7fcc5006dc80 2024-04-24T23:58:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7fcc55200640 1 -- 172.21.15.96:0/1147537395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcc500b3af0 con 0x7fcc5015e940 2024-04-24T23:58:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7fcc55200640 1 -- 172.21.15.96:0/1147537395 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5015e2e0 con 0x7fcc5015a220 2024-04-24T23:58:12.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7ff9b0c00640 1 Processor -- start 2024-04-24T23:58:12.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f042cc00640 1 -- 172.21.15.96:0/2314984634 >> v2:172.21.15.96:3300/0 conn(0x7f04280b3b30 msgr2=0x7f04280d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f042cc00640 1 --2- 172.21.15.96:0/2314984634 >> v2:172.21.15.96:3300/0 conn(0x7f04280b3b30 0x7f04280d27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f042cc00640 1 -- 172.21.15.96:0/2314984634 >> v1:172.21.15.96:6789/0 conn(0x7f04281619d0 legacy=0x7f04280d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f042cc00640 1 -- 172.21.15.96:0/2314984634 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04280d13d0 con 0x7f04280d2cf0 2024-04-24T23:58:12.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.668+0000 7fb065400640 1 -- 172.21.15.96:0/1885119655 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0680ce540 con 0x7fb0680cc2b0 2024-04-24T23:58:12.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7ff9eb400640 1 -- 172.21.15.96:0/3989281309 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0037070 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7ff9b0c00640 1 -- start start 2024-04-24T23:58:12.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.669+0000 7f0f3e000640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f38052b40 0x7f0f38188ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0f4007a980 tx=0x7f0f400754c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7ff9eb400640 1 -- 172.21.15.96:0/3989281309 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e002abb0 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7ff9eb400640 1 -- 172.21.15.96:0/3989281309 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e40019f0 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7fcc4e800640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc5006dc80 0x7fcc5006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7f0f37400640 1 -- 172.21.15.96:0/709076734 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f400b2040 con 0x7f0f38052b40 2024-04-24T23:58:12.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7fcc4d400640 1 -- 172.21.15.96:0/1147537395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5015a220 msgr2=0x7fcc501403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7fcc4d400640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5015a220 0x7fcc501403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7fcc4d400640 1 -- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc5006dc80 msgr2=0x7fcc5006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7f0f37400640 1 -- 172.21.15.96:0/709076734 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f400ad940 con 0x7f0f38052b40 2024-04-24T23:58:12.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7f0f37400640 1 -- 172.21.15.96:0/709076734 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f400adcf0 con 0x7f0f38052b40 2024-04-24T23:58:12.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7fcc4d400640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc5006dc80 0x7fcc5006e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7fcc4d400640 1 -- 172.21.15.96:0/1147537395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5015bee0 con 0x7fcc5015e940 2024-04-24T23:58:12.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.670+0000 7f0f3fe00640 1 -- 172.21.15.96:0/709076734 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f38189410 con 0x7f0f38052b40 2024-04-24T23:58:12.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7f0f3fe00640 1 -- 172.21.15.96:0/709076734 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f38188110 con 0x7f0f38052b40 2024-04-24T23:58:12.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3989281309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 msgr2=0x7ff9ec15a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ff9f3c00640 1 --2- 172.21.15.96:0/3989281309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 0x7ff9ec15a2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097a0 tx=0x7ff9e002a120 comp rx=0 tx=0).stop 2024-04-24T23:58:12.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7fb065400640 1 --2- 172.21.15.96:0/1885119655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680cc2b0 0x7fb068072180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb060007f40 tx=0x7fb06002ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcc12c1ce96c6630 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3989281309 shutdown_connections 2024-04-24T23:58:12.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ff9f3c00640 1 --2- 172.21.15.96:0/3989281309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 0x7ff9ec15a2b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3989281309 >> 172.21.15.96:0/3989281309 conn(0x7ff9ec0b19c0 msgr2=0x7ff9ec0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7fcc4e800640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc5006dc80 0x7fcc5006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:12.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3989281309 shutdown_connections 2024-04-24T23:58:12.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ffa09800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e8004d40 0x7ffa040c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7f042cc00640 1 --2- 172.21.15.96:0/2314984634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04280d2cf0 0x7f04280cf230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f042808e420 tx=0x7f042002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac6b337f32599dc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ffa09800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa0414bbf0 0x7ffa04152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3989281309 wait complete. 2024-04-24T23:58:12.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7fcc4d400640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5015e940 0x7fcc500cc240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c3f0 tx=0x7fcc3800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ffa09800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa04152570 0x7ffa04150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ffa09800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0406cd00 con 0x7ffa0414bbf0 2024-04-24T23:58:12.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ffa09800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0406cb80 con 0x7ff9e8004d40 2024-04-24T23:58:12.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.671+0000 7ffa09800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0406ce80 con 0x7ffa04152570 2024-04-24T23:58:12.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7f1a02c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19fc15ee50 0x7f19fc0d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7f1a02c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19fc15f230 0x7f19fc0d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7f1a02c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19fc15fba0 con 0x7f19fc0d2a30 2024-04-24T23:58:12.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7f1a02c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f19fc0d4eb0 con 0x7f19fc15ee50 2024-04-24T23:58:12.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7f1a02c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19fc15fe40 con 0x7f19fc15f230 2024-04-24T23:58:12.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7ffa02000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa0414bbf0 0x7ffa04152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9a403c0a0 0x7ff9a41785b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9a4053cb0 0x7ff9a4050bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7f0426a00640 1 -- 172.21.15.96:0/2314984634 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420007740 con 0x7f04280d2cf0 2024-04-24T23:58:12.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7f0426a00640 1 -- 172.21.15.96:0/2314984634 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04200078e0 con 0x7f04280d2cf0 2024-04-24T23:58:12.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7ffa02000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa0414bbf0 0x7ffa04152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58936/0 (socket says 172.21.15.96:58936) 2024-04-24T23:58:12.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7ffa02000640 1 -- 172.21.15.96:0/3554435536 learned_addr learned my addr 172.21.15.96:0/3554435536 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7fb064a00640 1 -- 172.21.15.96:0/1885119655 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060035070 con 0x7fb0680cc2b0 2024-04-24T23:58:12.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7f0426a00640 1 -- 172.21.15.96:0/2314984634 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420007c90 con 0x7f04280d2cf0 2024-04-24T23:58:12.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7fb064a00640 1 -- 172.21.15.96:0/1885119655 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb060003b90 con 0x7fb0680cc2b0 2024-04-24T23:58:12.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7fb064a00640 1 -- 172.21.15.96:0/1885119655 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06002f730 con 0x7fb0680cc2b0 2024-04-24T23:58:12.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7ffa02a00640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e8004d40 0x7ffa040c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9a40e3160 0x7ff9a403da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7ff9b0c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a40e3540 con 0x7ff9a4053cb0 2024-04-24T23:58:12.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.672+0000 7ff9b0c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a4054640 con 0x7ff9a403c0a0 2024-04-24T23:58:12.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7ff9b0c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a4006b60 con 0x7ff9a40e3160 2024-04-24T23:58:12.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f19fbe00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19fc15ee50 0x7f19fc0d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f19fbe00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19fc15ee50 0x7f19fc0d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45854/0 (socket says 172.21.15.96:45854) 2024-04-24T23:58:12.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f19fbe00640 1 -- 172.21.15.96:0/792876963 learned_addr learned my addr 172.21.15.96:0/792876963 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f0f3fe00640 1 -- 172.21.15.96:0/709076734 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f380e3050 con 0x7f0f38052b40 2024-04-24T23:58:12.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7fcc46000640 1 -- 172.21.15.96:0/1147537395 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc380074e0 con 0x7fcc5015e940 2024-04-24T23:58:12.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7ff9aaa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9a4053cb0 0x7ff9a4050bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7ff9aaa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9a4053cb0 0x7ff9a4050bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58950/0 (socket says 172.21.15.96:58950) 2024-04-24T23:58:12.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7ff9aaa00640 1 -- 172.21.15.96:0/2312781317 learned_addr learned my addr 172.21.15.96:0/2312781317 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7ff9ab400640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9a403c0a0 0x7ff9a41785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f042ec00640 1 -- 172.21.15.96:0/2314984634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04280d2cf0 msgr2=0x7f04280cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f042ec00640 1 --2- 172.21.15.96:0/2314984634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04280d2cf0 0x7f04280cf230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f042808e420 tx=0x7f042002a680 comp rx=0 tx=0).stop 2024-04-24T23:58:12.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7fcc46000640 1 -- 172.21.15.96:0/1147537395 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc380047e0 con 0x7fcc5015e940 2024-04-24T23:58:12.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7fcc46000640 1 -- 172.21.15.96:0/1147537395 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38004c10 con 0x7fcc5015e940 2024-04-24T23:58:12.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f19fbe00640 1 -- 172.21.15.96:0/792876963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19fc15f230 msgr2=0x7f19fc0d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f19fbe00640 1 --2- 172.21.15.96:0/792876963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19fc15f230 0x7f19fc0d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f19fbe00640 1 -- 172.21.15.96:0/792876963 >> v1:172.21.15.155:6789/0 conn(0x7f19fc0d2a30 legacy=0x7f19fc161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:12.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7fcc55200640 1 -- 172.21.15.96:0/1147537395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc50144c90 con 0x7fcc5015e940 2024-04-24T23:58:12.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7fb067200640 1 -- 172.21.15.96:0/1885119655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680cc2b0 msgr2=0x7fb068072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7fb067200640 1 --2- 172.21.15.96:0/1885119655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680cc2b0 0x7fb068072180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb060007f40 tx=0x7fb06002ebe0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f042ec00640 1 -- 172.21.15.96:0/2314984634 shutdown_connections 2024-04-24T23:58:12.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f042ec00640 1 --2- 172.21.15.96:0/2314984634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04280d2cf0 0x7f04280cf230 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f042ec00640 1 --2- 172.21.15.96:0/2314984634 >> v2:172.21.15.96:3300/0 conn(0x7f04280b3b30 0x7f04280d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f042ec00640 1 -- 172.21.15.96:0/2314984634 >> 172.21.15.96:0/2314984634 conn(0x7f042809d4b0 msgr2=0x7f04280d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7f042ec00640 1 -- 172.21.15.96:0/2314984634 shutdown_connections 2024-04-24T23:58:12.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.673+0000 7f19fbe00640 1 -- 172.21.15.96:0/792876963 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc160120 con 0x7f19fc15ee50 2024-04-24T23:58:12.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7f042ec00640 1 -- 172.21.15.96:0/2314984634 wait complete. 2024-04-24T23:58:12.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7fb067200640 1 -- 172.21.15.96:0/1885119655 shutdown_connections 2024-04-24T23:58:12.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7fb067200640 1 --2- 172.21.15.96:0/1885119655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680cc2b0 0x7fb068072180 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7fb067200640 1 --2- 172.21.15.96:0/1885119655 >> v2:172.21.15.155:3300/0 conn(0x7fb06815a210 0x7fb0680cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7fb067200640 1 -- 172.21.15.96:0/1885119655 >> 172.21.15.96:0/1885119655 conn(0x7fb0680b1f10 msgr2=0x7fb0680cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ffa02000640 1 -- 172.21.15.96:0/3554435536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa04152570 msgr2=0x7ffa04150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ffa02000640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa04152570 0x7ffa04150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ffa02000640 1 -- 172.21.15.96:0/3554435536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e8004d40 msgr2=0x7ffa040c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ffa02000640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e8004d40 0x7ffa040c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ffa02000640 1 -- 172.21.15.96:0/3554435536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa040c8200 con 0x7ffa0414bbf0 2024-04-24T23:58:12.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ff9aaa00640 1 -- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9a40e3160 msgr2=0x7ff9a403da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ff9aaa00640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9a40e3160 0x7ff9a403da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ff9aaa00640 1 -- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9a403c0a0 msgr2=0x7ff9a41785b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ff9aaa00640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9a403c0a0 0x7ff9a41785b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7ff9aaa00640 1 -- 172.21.15.96:0/2312781317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a4051590 con 0x7ff9a4053cb0 2024-04-24T23:58:12.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.674+0000 7fcc55200640 1 -- 172.21.15.96:0/1147537395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5015c180 con 0x7fcc5015e940 2024-04-24T23:58:12.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7ff9aaa00640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9a4053cb0 0x7ff9a4050bd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff99800c4c0 tx=0x7ff99800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7ffa02000640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa0414bbf0 0x7ffa04152030 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00072c0 tx=0x7ff9f0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7fb067200640 1 -- 172.21.15.96:0/1885119655 shutdown_connections 2024-04-24T23:58:12.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7ff9f3c00640 1 Processor -- start 2024-04-24T23:58:12.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7ff99f400640 1 -- 172.21.15.96:0/2312781317 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980052d0 con 0x7ff9a4053cb0 2024-04-24T23:58:12.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7fcc55200640 1 -- 172.21.15.96:0/1147537395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc501451b0 con 0x7fcc5015e940 2024-04-24T23:58:12.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7f19fbe00640 1 --2- 172.21.15.96:0/792876963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc15ee50 0x7f19fc0d47b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009e50 tx=0x7f19f402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a948720d018f70 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a4051870 con 0x7ff9a4053cb0 2024-04-24T23:58:12.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a404ccf0 con 0x7ff9a4053cb0 2024-04-24T23:58:12.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7ff9faa00640 1 -- 172.21.15.96:0/3554435536 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f001a070 con 0x7ffa0414bbf0 2024-04-24T23:58:12.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7f19faa00640 1 -- 172.21.15.96:0/792876963 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4036070 con 0x7f19fc15ee50 2024-04-24T23:58:12.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7f19faa00640 1 -- 172.21.15.96:0/792876963 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f4031600 con 0x7f19fc15ee50 2024-04-24T23:58:12.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7f19faa00640 1 -- 172.21.15.96:0/792876963 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f40319d0 con 0x7f19fc15ee50 2024-04-24T23:58:12.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7f042ec00640 1 Processor -- start 2024-04-24T23:58:12.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa040ca410 con 0x7ffa0414bbf0 2024-04-24T23:58:12.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7ff99f400640 1 -- 172.21.15.96:0/2312781317 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff998005470 con 0x7ff9a4053cb0 2024-04-24T23:58:12.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7ff99f400640 1 -- 172.21.15.96:0/2312781317 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998012870 con 0x7ff9a4053cb0 2024-04-24T23:58:12.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7f042ec00640 1 -- start start 2024-04-24T23:58:12.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7ff9faa00640 1 -- 172.21.15.96:0/3554435536 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f000fa20 con 0x7ffa0414bbf0 2024-04-24T23:58:12.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7ff9faa00640 1 -- 172.21.15.96:0/3554435536 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000fdf0 con 0x7ffa0414bbf0 2024-04-24T23:58:12.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.677+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa040ca9d0 con 0x7ffa0414bbf0 2024-04-24T23:58:12.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.677+0000 7f1a02c00640 1 -- 172.21.15.96:0/792876963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc15ee50 msgr2=0x7f19fc0d47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.677+0000 7f1a02c00640 1 --2- 172.21.15.96:0/792876963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc15ee50 0x7f19fc0d47b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009e50 tx=0x7f19f402a710 comp rx=0 tx=0).stop 2024-04-24T23:58:12.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.677+0000 7f1a02c00640 1 -- 172.21.15.96:0/792876963 shutdown_connections 2024-04-24T23:58:12.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.677+0000 7f1a02c00640 1 --2- 172.21.15.96:0/792876963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19fc15f230 0x7f19fc0d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.677+0000 7f1a02c00640 1 --2- 172.21.15.96:0/792876963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc15ee50 0x7f19fc0d47b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.677+0000 7f1a02c00640 1 -- 172.21.15.96:0/792876963 >> 172.21.15.96:0/792876963 conn(0x7f19fc09d450 msgr2=0x7f19fc0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.677+0000 7f0f37400640 1 -- 172.21.15.96:0/709076734 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f400b5070 con 0x7f0f38052b40 2024-04-24T23:58:12.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f042ec00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04280b3b30 0x7f04280ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f0f37400640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0f2006bf00 0x7f0f2006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f042ec00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04280d2cf0 0x7f04280c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f0f37400640 1 -- 172.21.15.96:0/709076734 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0f40127660 con 0x7f0f38052b40 2024-04-24T23:58:12.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f042ec00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04281619d0 0x7f042815f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f042ec00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f04280d0800 con 0x7f04280b3b30 2024-04-24T23:58:12.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f042ec00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0428161db0 con 0x7f04281619d0 2024-04-24T23:58:12.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f042ec00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f04280b3240 con 0x7f04280d2cf0 2024-04-24T23:58:12.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7f0427e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04280b3b30 0x7f04280ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7f042cc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04281619d0 0x7f042815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7f0427e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04280b3b30 0x7f04280ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58962/0 (socket says 172.21.15.96:58962) 2024-04-24T23:58:12.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7f0427e00640 1 -- 172.21.15.96:0/1538648719 learned_addr learned my addr 172.21.15.96:0/1538648719 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7f0f37400640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f0f20074120 0x7f0f20076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7f0f37400640 1 -- 172.21.15.96:0/709076734 --> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f4006efb0 con 0x7f0f20074120 2024-04-24T23:58:12.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa040ca1c0 con 0x7ffa0414bbf0 2024-04-24T23:58:12.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.675+0000 7ff9f3c00640 1 -- start start 2024-04-24T23:58:12.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7f0f37400640 1 -- 172.21.15.96:0/709076734 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0f40127a50 con 0x7f0f38052b40 2024-04-24T23:58:12.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7f0427400640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04280d2cf0 0x7f04280c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f1a02c00640 1 -- 172.21.15.96:0/792876963 shutdown_connections 2024-04-24T23:58:12.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.678+0000 7f1a02c00640 1 -- 172.21.15.96:0/792876963 wait complete. 2024-04-24T23:58:12.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff988001030 con 0x7ff9a4053cb0 2024-04-24T23:58:12.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7ff9f3c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 0x7ff9ec09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7f0f3f400640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f0f20074120 0x7f0f20076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7ff9f3c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9ec15e4b0 0x7ff9ec0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7f0427e00640 1 -- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04280d2cf0 msgr2=0x7f04280c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7f0427e00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04280d2cf0 0x7f04280c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7f0427e00640 1 -- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04281619d0 msgr2=0x7f042815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7f0427e00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04281619d0 0x7f042815f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7f0427e00640 1 -- 172.21.15.96:0/1538648719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0428151f70 con 0x7f04280b3b30 2024-04-24T23:58:12.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7ff9f3c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9ec15e940 0x7ff9ec0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.676+0000 7fb067200640 1 -- 172.21.15.96:0/1885119655 wait complete. 2024-04-24T23:58:12.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7fb067200640 1 Processor -- start 2024-04-24T23:58:12.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.679+0000 7fcc46000640 1 -- 172.21.15.96:0/1147537395 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc38011070 con 0x7fcc5015e940 2024-04-24T23:58:12.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7fcc46000640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcc2c06be30 0x7fcc2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7fcc46000640 1 -- 172.21.15.96:0/1147537395 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcc3808b3e0 con 0x7fcc5015e940 2024-04-24T23:58:12.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7fcc4de00640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcc2c06be30 0x7fcc2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7f1a02c00640 1 Processor -- start 2024-04-24T23:58:12.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7ff9f3c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0b4ce0 con 0x7ff9ec15e4b0 2024-04-24T23:58:12.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7fcc46000640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7fcc2c0740b0 0x7fcc2c0764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7ff9f3c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0b4140 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7ff9f3c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec0b4e60 con 0x7ff9ec15e940 2024-04-24T23:58:12.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.680+0000 7ff9f1200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 0x7ff9ec09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7ff9f1200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 0x7ff9ec09aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45878/0 (socket says 172.21.15.96:45878) 2024-04-24T23:58:12.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7ff9f1200640 1 -- 172.21.15.96:0/3798310872 learned_addr learned my addr 172.21.15.96:0/3798310872 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7fcc46000640 1 -- 172.21.15.96:0/1147537395 --> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc2c076b80 con 0x7fcc2c0740b0 2024-04-24T23:58:12.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7ff9ebe00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9ec15e4b0 0x7ff9ec0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7f0f3ea00640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0f2006bf00 0x7f0f2006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7f0f3f400640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f0f20074120 0x7f0f20076540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7f1a02c00640 1 -- start start 2024-04-24T23:58:12.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7fcc46000640 1 -- 172.21.15.96:0/1147537395 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcc3808b7d0 con 0x7fcc5015e940 2024-04-24T23:58:12.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.681+0000 7f0427e00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04280b3b30 0x7f04280ca270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f041800c430 tx=0x7f041800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7ff9f1c00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9ec15e940 0x7ff9ec0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7fcc4e800640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7fcc2c0740b0 0x7fcc2c0764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7f041fe00640 1 -- 172.21.15.96:0/1538648719 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418017070 con 0x7f04280b3b30 2024-04-24T23:58:12.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7ff9f1200640 1 -- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9ec15e940 msgr2=0x7ff9ec0cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7ff9f1200640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9ec15e940 0x7ff9ec0cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7ff9f1200640 1 -- 172.21.15.96:0/3798310872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9ec15e4b0 msgr2=0x7ff9ec0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7ff9f1200640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9ec15e4b0 0x7ff9ec0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7ff9f1200640 1 -- 172.21.15.96:0/3798310872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec13af40 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7f041fe00640 1 -- 172.21.15.96:0/1538648719 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0418005ce0 con 0x7f04280b3b30 2024-04-24T23:58:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7f041fe00640 1 -- 172.21.15.96:0/1538648719 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418017070 con 0x7f04280b3b30 2024-04-24T23:58:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04280ca950 con 0x7f04280b3b30 2024-04-24T23:58:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04280cc3f0 con 0x7f04280b3b30 2024-04-24T23:58:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7ff9f1c00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9ec15e940 0x7ff9ec0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:12.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7f1a02c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc0d2a30 0x7f19fc1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7f1a02c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19fc15ee50 0x7f19fc0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7ff9ebe00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9ec15e4b0 0x7ff9ec0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:12.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7ff99f400640 1 -- 172.21.15.96:0/2312781317 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff998012a10 con 0x7ff9a4053cb0 2024-04-24T23:58:12.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7ff99f400640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff98c06be30 0x7ff98c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7ff99f400640 1 -- 172.21.15.96:0/2312781317 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff99808ab70 con 0x7ff9a4053cb0 2024-04-24T23:58:12.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7ff99f400640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7ff98c073fd0 0x7ff98c0763f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7ff99f400640 1 -- 172.21.15.96:0/2312781317 --> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff98c076aa0 con 0x7ff98c073fd0 2024-04-24T23:58:12.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7f1a02c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19fc15f230 0x7f19fc0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.683+0000 7f19fbe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc0d2a30 0x7f19fc1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7ff9f1200640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 0x7ff9ec09aa70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0035040 tx=0x7ff9e00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.682+0000 7fb067200640 1 -- start start 2024-04-24T23:58:12.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7fb067200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680726c0 0x7fb068201350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7fb067200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0680cc2b0 0x7fb06815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7fb067200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06815a210 0x7fb068159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7fb067200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb068072b50 con 0x7fb06815a210 2024-04-24T23:58:12.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7fb067200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0680ceb00 con 0x7fb0680cc2b0 2024-04-24T23:58:12.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7fb067200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb06815a5f0 con 0x7fb0680726c0 2024-04-24T23:58:12.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7f19fbe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc0d2a30 0x7f19fc1536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45892/0 (socket says 172.21.15.96:45892) 2024-04-24T23:58:12.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7f19fbe00640 1 -- 172.21.15.96:0/3339342463 learned_addr learned my addr 172.21.15.96:0/3339342463 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7f19fb400640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19fc15ee50 0x7f19fc0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7fcc4e800640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7fcc2c0740b0 0x7fcc2c0764d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7ff99f400640 1 -- 172.21.15.96:0/2312781317 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff998055020 con 0x7ff9a4053cb0 2024-04-24T23:58:12.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7ff9e8c00640 1 -- 172.21.15.96:0/3798310872 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0041020 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7ff9e8c00640 1 -- 172.21.15.96:0/3798310872 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e003d640 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0428069110 con 0x7f04280b3b30 2024-04-24T23:58:12.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc15f810 con 0x7f19fc15f230 2024-04-24T23:58:12.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7f1a00c00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19fc15f230 0x7f19fc0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc15f690 con 0x7f19fc0d2a30 2024-04-24T23:58:12.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19fc161930 con 0x7f19fc15ee50 2024-04-24T23:58:12.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7fb065e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680726c0 0x7fb068201350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7fb065e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680726c0 0x7fb068201350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53238/0 (socket says 172.21.15.96:53238) 2024-04-24T23:58:12.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7fb065e00640 1 -- 172.21.15.96:0/3728915652 learned_addr learned my addr 172.21.15.96:0/3728915652 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:12.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7fb065400640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0680cc2b0 0x7fb06815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ec13b220 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7f0f37400640 1 -- 172.21.15.96:0/709076734 <== osd.0 v2:172.21.15.96:6816/4135409848 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f4006efb0 con 0x7f0f20074120 2024-04-24T23:58:12.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ec13b7e0 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7ff9e8c00640 1 -- 172.21.15.96:0/3798310872 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0037040 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7fcc4de00640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcc2c06be30 0x7fcc2c06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc40034000 tx=0x7fcc4002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7ff9abe00640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7ff98c073fd0 0x7ff98c0763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.685+0000 7ff9ab400640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff98c06be30 0x7ff98c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7ff9abe00640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7ff98c073fd0 0x7ff98c0763f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.684+0000 7ff9faa00640 1 -- 172.21.15.96:0/3554435536 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9f001d070 con 0x7ffa0414bbf0 2024-04-24T23:58:12.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7fb065e00640 1 -- 172.21.15.96:0/3728915652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0680cc2b0 msgr2=0x7fb06815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7fb065e00640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0680cc2b0 0x7fb06815b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7fb065e00640 1 -- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06815a210 msgr2=0x7fb068159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7fb065e00640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06815a210 0x7fb068159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9ec069110 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7f041fe00640 1 -- 172.21.15.96:0/1538648719 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f041801a070 con 0x7f04280b3b30 2024-04-24T23:58:12.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7f19fbe00640 1 -- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19fc15ee50 msgr2=0x7f19fc0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7f19fbe00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19fc15ee50 0x7f19fc0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7f19fbe00640 1 -- 172.21.15.96:0/3339342463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19fc15f230 msgr2=0x7f19fc0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7f19fbe00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19fc15f230 0x7f19fc0cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7f19fbe00640 1 -- 172.21.15.96:0/3339342463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc1f59c0 con 0x7f19fc0d2a30 2024-04-24T23:58:12.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.686+0000 7fcc46000640 1 -- 172.21.15.96:0/1147537395 <== osd.1 v2:172.21.15.96:6800/940576727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc2c076b80 con 0x7fcc2c0740b0 2024-04-24T23:58:12.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.687+0000 7f0f3ea00640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0f2006bf00 0x7f0f2006e3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f30006fd0 tx=0x7f0f30009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.687+0000 7fb065e00640 1 -- 172.21.15.96:0/3728915652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb068201890 con 0x7fb0680726c0 2024-04-24T23:58:12.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.687+0000 7ff9ab400640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff98c06be30 0x7ff98c06e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac02d700 tx=0x7ff9ac068060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.687+0000 7f19fbe00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc0d2a30 0x7f19fc1536c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19f4034040 tx=0x7f19f4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.687+0000 7f041fe00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f040806c060 0x7f040806e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.687+0000 7fb065e00640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680726c0 0x7fb068201350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb054009fd0 tx=0x7fb05400ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7ff9faa00640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9e406be30 0x7ff9e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7f19f3e00640 1 -- 172.21.15.96:0/3339342463 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4041020 con 0x7f19fc0d2a30 2024-04-24T23:58:12.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7f19f3e00640 1 -- 172.21.15.96:0/3339342463 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f4007800 con 0x7f19fc0d2a30 2024-04-24T23:58:12.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7f0427400640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f040806c060 0x7f040806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7fb05e000640 1 -- 172.21.15.96:0/3728915652 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054017070 con 0x7fb0680726c0 2024-04-24T23:58:12.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19fc0c92c0 con 0x7f19fc0d2a30 2024-04-24T23:58:12.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19fc0c9880 con 0x7f19fc0d2a30 2024-04-24T23:58:12.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7fb05e000640 1 -- 172.21.15.96:0/3728915652 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05400c940 con 0x7fb0680726c0 2024-04-24T23:58:12.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.689+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06809d190 con 0x7fb0680726c0 2024-04-24T23:58:12.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7f041fe00640 1 -- 172.21.15.96:0/1538648719 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f04180076e0 con 0x7f04280b3b30 2024-04-24T23:58:12.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7f041fe00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f0408074200 0x7f0408076620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7f041fe00640 1 -- 172.21.15.96:0/1538648719 --> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0408076cd0 con 0x7f0408074200 2024-04-24T23:58:12.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7f041fe00640 1 -- 172.21.15.96:0/1538648719 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f041808f060 con 0x7f04280b3b30 2024-04-24T23:58:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.688+0000 7ff9faa00640 1 -- 172.21.15.96:0/3554435536 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff9f008a870 con 0x7ffa0414bbf0 2024-04-24T23:58:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.689+0000 7ffa02a00640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9e406be30 0x7ff9e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.689+0000 7f19f3e00640 1 -- 172.21.15.96:0/3339342463 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4036040 con 0x7f19fc0d2a30 2024-04-24T23:58:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.689+0000 7f0427400640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f040806c060 0x7f040806e520 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0428160fb0 tx=0x7f0414009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.690+0000 7f042cc00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f0408074200 0x7f0408076620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.690+0000 7ff99f400640 1 -- 172.21.15.96:0/2312781317 <== osd.4 v2:172.21.15.155:6800/810886372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff98c076aa0 con 0x7ff98c073fd0 2024-04-24T23:58:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.689+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06809d710 con 0x7fb0680726c0 2024-04-24T23:58:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.690+0000 7fb05e000640 1 -- 172.21.15.96:0/3728915652 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05400cd10 con 0x7fb0680726c0 2024-04-24T23:58:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.690+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19fc069110 con 0x7f19fc0d2a30 2024-04-24T23:58:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.690+0000 7ffa02a00640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9e406be30 0x7ff9e406e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc003bd0 tx=0x7ff9fc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.690+0000 7ff9faa00640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7ff9e4074050 0x7ff9e4076470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.691+0000 7ff9faa00640 1 -- 172.21.15.96:0/3554435536 --> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9e4076b20 con 0x7ff9e4074050 2024-04-24T23:58:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.691+0000 7ff9faa00640 1 -- 172.21.15.96:0/3554435536 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff9f008f2a0 con 0x7ffa0414bbf0 2024-04-24T23:58:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.691+0000 7f042cc00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f0408074200 0x7f0408076620 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.691+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb040001030 con 0x7fb0680726c0 2024-04-24T23:58:12.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.691+0000 7ffa03400640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7ff9e4074050 0x7ff9e4076470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.691+0000 7ff9e8c00640 1 -- 172.21.15.96:0/3798310872 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9e0044020 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.692+0000 7ffa03400640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7ff9e4074050 0x7ff9e4076470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.692+0000 7ff9e8c00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9cc06beb0 0x7ff9cc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.692+0000 7ff9e8c00640 1 -- 172.21.15.96:0/3798310872 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff9e00abaf0 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.693+0000 7ff9ebe00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9cc06beb0 0x7ff9cc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.693+0000 7ff9e8c00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7ff9cc0740b0 0x7ff9cc0764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.693+0000 7ff9e8c00640 1 -- 172.21.15.96:0/3798310872 --> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9e00067f0 con 0x7ff9cc0740b0 2024-04-24T23:58:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.693+0000 7ff9e8c00640 1 -- 172.21.15.96:0/3798310872 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff9e00abea0 con 0x7ff9ec0b24b0 2024-04-24T23:58:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.693+0000 7ff9faa00640 1 -- 172.21.15.96:0/3554435536 <== osd.3 v2:172.21.15.96:6808/1162768165 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9e4076b20 con 0x7ff9e4074050 2024-04-24T23:58:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.694+0000 7ff9ebe00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9cc06beb0 0x7ff9cc06e370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0cc360 tx=0x7ff9d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.694+0000 7ff9f1c00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7ff9cc0740b0 0x7ff9cc0764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.694+0000 7f041fe00640 1 -- 172.21.15.96:0/1538648719 <== osd.6 v2:172.21.15.155:6808/2968414204 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0408076cd0 con 0x7f0408074200 2024-04-24T23:58:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.694+0000 7fb05e000640 1 -- 172.21.15.96:0/3728915652 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb05401a070 con 0x7fb0680726c0 2024-04-24T23:58:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.695+0000 7f19f3e00640 1 -- 172.21.15.96:0/3339342463 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19f4044020 con 0x7f19fc0d2a30 2024-04-24T23:58:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.696+0000 7f19f3e00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f19dc06be80 0x7f19dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.696+0000 7f19f3e00640 1 -- 172.21.15.96:0/3339342463 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f19f40ac040 con 0x7f19fc0d2a30 2024-04-24T23:58:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.696+0000 7f19f3e00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f19dc074100 0x7f19dc076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.697+0000 7f19f3e00640 1 -- 172.21.15.96:0/3339342463 --> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19f400ae60 con 0x7f19dc074100 2024-04-24T23:58:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.697+0000 7f19f3e00640 1 -- 172.21.15.96:0/3339342463 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f19f40ac430 con 0x7f19fc0d2a30 2024-04-24T23:58:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.696+0000 7fb05e000640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb04806be30 0x7fb04806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.696+0000 7fb05e000640 1 -- 172.21.15.96:0/3728915652 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb05408b0c0 con 0x7fb0680726c0 2024-04-24T23:58:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.697+0000 7fb05e000640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7fb048073fd0 0x7fb0480763f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.697+0000 7fb05e000640 1 -- 172.21.15.96:0/3728915652 --> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb048076aa0 con 0x7fb048073fd0 2024-04-24T23:58:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.697+0000 7fb05e000640 1 -- 172.21.15.96:0/3728915652 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb05408b550 con 0x7fb0680726c0 2024-04-24T23:58:12.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.697+0000 7f19fb400640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f19dc06be80 0x7f19dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.697+0000 7ff9f1c00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7ff9cc0740b0 0x7ff9cc0764d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.697+0000 7f1a00c00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f19dc074100 0x7f19dc076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.697+0000 7fb065400640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb04806be30 0x7fb04806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.698+0000 7fb066800640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7fb048073fd0 0x7fb0480763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:12.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.699+0000 7f19fb400640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f19dc06be80 0x7f19dc06e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19fc067400 tx=0x7f19ec009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.699+0000 7fb065400640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb04806be30 0x7fb04806e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb060039000 tx=0x7fb060010040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.699+0000 7f1a00c00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f19dc074100 0x7f19dc076520 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.699+0000 7fb066800640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7fb048073fd0 0x7fb0480763f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:12.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.700+0000 7ff9e8c00640 1 -- 172.21.15.96:0/3798310872 <== osd.5 v2:172.21.15.155:6821/841571603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9e00067f0 con 0x7ff9cc0740b0 2024-04-24T23:58:12.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.700+0000 7fb05e000640 1 -- 172.21.15.96:0/3728915652 <== osd.2 v2:172.21.15.96:6824/515371231 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb048076aa0 con 0x7fb048073fd0 2024-04-24T23:58:12.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.701+0000 7f19f3e00640 1 -- 172.21.15.96:0/3339342463 <== osd.7 v2:172.21.15.155:6816/654840370 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19f400ae60 con 0x7f19dc074100 2024-04-24T23:58:12.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.716+0000 7f0f3fe00640 1 -- 172.21.15.96:0/709076734 --> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f38005390 con 0x7f0f20074120 2024-04-24T23:58:12.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.717+0000 7f0f37400640 1 -- 172.21.15.96:0/709076734 <== osd.0 v2:172.21.15.96:6816/4135409848 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0f38005390 con 0x7f0f20074120 2024-04-24T23:58:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.717+0000 7fcc55200640 1 -- 172.21.15.96:0/1147537395 --> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc50069110 con 0x7fcc2c0740b0 2024-04-24T23:58:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.718+0000 7fcc46000640 1 -- 172.21.15.96:0/1147537395 <== osd.1 v2:172.21.15.96:6800/940576727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcc50069110 con 0x7fcc2c0740b0 2024-04-24T23:58:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7fcc3f400640 1 -- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7fcc2c0740b0 msgr2=0x7fcc2c0764d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7fcc3f400640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7fcc2c0740b0 0x7fcc2c0764d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7f0f34c00640 1 -- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f0f20074120 msgr2=0x7f0f20076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7f0f34c00640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f0f20074120 0x7f0f20076540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7f0f34c00640 1 -- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0f2006bf00 msgr2=0x7f0f2006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7f0f34c00640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0f2006bf00 0x7f0f2006e3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f30006fd0 tx=0x7f0f30009060 comp rx=0 tx=0).stop 2024-04-24T23:58:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7fcc3f400640 1 -- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcc2c06be30 msgr2=0x7fcc2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7fcc3f400640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fcc2c06be30 0x7fcc2c06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc40034000 tx=0x7fcc4002e000 comp rx=0 tx=0).stop 2024-04-24T23:58:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7fcc3f400640 1 -- 172.21.15.96:0/1147537395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5015e940 msgr2=0x7fcc500cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7fcc3f400640 1 --2- 172.21.15.96:0/1147537395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5015e940 0x7fcc500cc240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c3f0 tx=0x7fcc3800c8b0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7fcc4e800640 1 -- 172.21.15.96:0/1147537395 reap_dead start 2024-04-24T23:58:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7fcc3f400640 1 -- 172.21.15.96:0/1147537395 shutdown_connections 2024-04-24T23:58:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7fcc3f400640 1 -- 172.21.15.96:0/1147537395 >> 172.21.15.96:0/1147537395 conn(0x7fcc500b19c0 msgr2=0x7fcc5014b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7f0f34c00640 1 -- 172.21.15.96:0/709076734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f38052b40 msgr2=0x7f0f38188ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7f0f34c00640 1 --2- 172.21.15.96:0/709076734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f38052b40 0x7f0f38188ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0f4007a980 tx=0x7f0f400754c0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.719+0000 7f0f3f400640 1 -- 172.21.15.96:0/709076734 reap_dead start 2024-04-24T23:58:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.720+0000 7f0f34c00640 1 -- 172.21.15.96:0/709076734 shutdown_connections 2024-04-24T23:58:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.720+0000 7f0f34c00640 1 -- 172.21.15.96:0/709076734 >> 172.21.15.96:0/709076734 conn(0x7f0f38009fb0 msgr2=0x7f0f38006dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.721+0000 7f0f34c00640 1 -- 172.21.15.96:0/709076734 shutdown_connections 2024-04-24T23:58:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.721+0000 7fcc3f400640 1 -- 172.21.15.96:0/1147537395 shutdown_connections 2024-04-24T23:58:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.721+0000 7fcc3f400640 1 -- 172.21.15.96:0/1147537395 wait complete. 2024-04-24T23:58:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.721+0000 7f0f34c00640 1 -- 172.21.15.96:0/709076734 wait complete. 2024-04-24T23:58:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.723+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 --> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f042806c2c0 con 0x7f0408074200 2024-04-24T23:58:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.724+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 --> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffa04069110 con 0x7ff9e4074050 2024-04-24T23:58:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.724+0000 7ff9faa00640 1 -- 172.21.15.96:0/3554435536 <== osd.3 v2:172.21.15.96:6808/1162768165 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffa04069110 con 0x7ff9e4074050 2024-04-24T23:58:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.726+0000 7f041fe00640 1 -- 172.21.15.96:0/1538648719 <== osd.6 v2:172.21.15.155:6808/2968414204 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f042806c2c0 con 0x7f0408074200 2024-04-24T23:58:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.728+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 --> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff988002dd0 con 0x7ff98c073fd0 2024-04-24T23:58:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.728+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7ff9e4074050 msgr2=0x7ff9e4076470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.728+0000 7ffa09800640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7ff9e4074050 0x7ff9e4076470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9e406be30 msgr2=0x7ff9e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7ff99f400640 1 -- 172.21.15.96:0/2312781317 <== osd.4 v2:172.21.15.155:6800/810886372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff988002dd0 con 0x7ff98c073fd0 2024-04-24T23:58:12.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7ffa09800640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9e406be30 0x7ff9e406e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc003bd0 tx=0x7ff9fc00b040 comp rx=0 tx=0).stop 2024-04-24T23:58:12.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa0414bbf0 msgr2=0x7ffa04152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7ffa09800640 1 --2- 172.21.15.96:0/3554435536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa0414bbf0 0x7ffa04152030 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00072c0 tx=0x7ff9f0007780 comp rx=0 tx=0).stop 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.728+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f0408074200 msgr2=0x7f0408076620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.728+0000 7f042ec00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f0408074200 0x7f0408076620 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f040806c060 msgr2=0x7f040806e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7f042ec00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f040806c060 0x7f040806e520 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0428160fb0 tx=0x7f0414009190 comp rx=0 tx=0).stop 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04280b3b30 msgr2=0x7f04280ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7f042ec00640 1 --2- 172.21.15.96:0/1538648719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04280b3b30 0x7f04280ca270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f041800c430 tx=0x7f041800c8f0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7f042cc00640 1 -- 172.21.15.96:0/1538648719 reap_dead start 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 shutdown_connections 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 >> 172.21.15.96:0/1538648719 conn(0x7f042809d4b0 msgr2=0x7f042806c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 shutdown_connections 2024-04-24T23:58:12.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7f042ec00640 1 -- 172.21.15.96:0/1538648719 wait complete. 2024-04-24T23:58:12.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.729+0000 7ffa03400640 1 -- 172.21.15.96:0/3554435536 reap_dead start 2024-04-24T23:58:12.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.730+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7ff98c073fd0 msgr2=0x7ff98c0763f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.730+0000 7ff9b0c00640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7ff98c073fd0 0x7ff98c0763f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.730+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff98c06be30 msgr2=0x7ff98c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.730+0000 7ff9b0c00640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff98c06be30 0x7ff98c06e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac02d700 tx=0x7ff9ac068060 comp rx=0 tx=0).stop 2024-04-24T23:58:12.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.731+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 --> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9ec0b2e90 con 0x7ff9cc0740b0 2024-04-24T23:58:12.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.730+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9a4053cb0 msgr2=0x7ff9a4050bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.731+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 shutdown_connections 2024-04-24T23:58:12.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.731+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 >> 172.21.15.96:0/3554435536 conn(0x7ffa0408dbb0 msgr2=0x7ffa0415f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.730+0000 7ff9b0c00640 1 --2- 172.21.15.96:0/2312781317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9a4053cb0 0x7ff9a4050bd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff99800c4c0 tx=0x7ff99800c980 comp rx=0 tx=0).stop 2024-04-24T23:58:12.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.731+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 shutdown_connections 2024-04-24T23:58:12.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.730+0000 7ff9abe00640 1 -- 172.21.15.96:0/2312781317 reap_dead start 2024-04-24T23:58:12.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.730+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 shutdown_connections 2024-04-24T23:58:12.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.730+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 >> 172.21.15.96:0/2312781317 conn(0x7ff9a4058ee0 msgr2=0x7ff9a40393a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.731+0000 7ffa09800640 1 -- 172.21.15.96:0/3554435536 wait complete. 2024-04-24T23:58:12.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.731+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 shutdown_connections 2024-04-24T23:58:12.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.731+0000 7ff9b0c00640 1 -- 172.21.15.96:0/2312781317 wait complete. 2024-04-24T23:58:12.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.732+0000 7ff9e8c00640 1 -- 172.21.15.96:0/3798310872 <== osd.5 v2:172.21.15.155:6821/841571603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff9ec0b2e90 con 0x7ff9cc0740b0 2024-04-24T23:58:12.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.733+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 --> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb040002dd0 con 0x7fb048073fd0 2024-04-24T23:58:12.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.733+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7ff9cc0740b0 msgr2=0x7ff9cc0764d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.734+0000 7ff9f3c00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7ff9cc0740b0 0x7ff9cc0764d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.735+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9cc06beb0 msgr2=0x7ff9cc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.735+0000 7ff9f3c00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff9cc06beb0 0x7ff9cc06e370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0cc360 tx=0x7ff9d8009040 comp rx=0 tx=0).stop 2024-04-24T23:58:12.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.735+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 msgr2=0x7ff9ec09aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.735+0000 7ff9f3c00640 1 --2- 172.21.15.96:0/3798310872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0b24b0 0x7ff9ec09aa70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0035040 tx=0x7ff9e00046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.735+0000 7ff9f1c00640 1 -- 172.21.15.96:0/3798310872 reap_dead start 2024-04-24T23:58:12.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.735+0000 7fb05e000640 1 -- 172.21.15.96:0/3728915652 <== osd.2 v2:172.21.15.96:6824/515371231 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb040002dd0 con 0x7fb048073fd0 2024-04-24T23:58:12.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.736+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7fb048073fd0 msgr2=0x7fb0480763f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.736+0000 7fb067200640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7fb048073fd0 0x7fb0480763f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.736+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 shutdown_connections 2024-04-24T23:58:12.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.736+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 >> 172.21.15.96:0/3798310872 conn(0x7ff9ec0b19c0 msgr2=0x7ff9ec14a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.736+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb04806be30 msgr2=0x7fb04806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.736+0000 7fb067200640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb04806be30 0x7fb04806e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb060039000 tx=0x7fb060010040 comp rx=0 tx=0).stop 2024-04-24T23:58:12.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.736+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680726c0 msgr2=0x7fb068201350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.736+0000 7fb067200640 1 --2- 172.21.15.96:0/3728915652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0680726c0 0x7fb068201350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb054009fd0 tx=0x7fb05400ed40 comp rx=0 tx=0).stop 2024-04-24T23:58:12.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.736+0000 7fb066800640 1 -- 172.21.15.96:0/3728915652 reap_dead start 2024-04-24T23:58:12.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.737+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 shutdown_connections 2024-04-24T23:58:12.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.737+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 >> 172.21.15.96:0/3728915652 conn(0x7fb0680b1f10 msgr2=0x7fb06815dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.738+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 shutdown_connections 2024-04-24T23:58:12.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.738+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 --> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f19fc15b080 con 0x7f19dc074100 2024-04-24T23:58:12.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.738+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 shutdown_connections 2024-04-24T23:58:12.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.738+0000 7fb067200640 1 -- 172.21.15.96:0/3728915652 wait complete. 2024-04-24T23:58:12.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.738+0000 7ff9f3c00640 1 -- 172.21.15.96:0/3798310872 wait complete. 2024-04-24T23:58:12.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.739+0000 7f19f3e00640 1 -- 172.21.15.96:0/3339342463 <== osd.7 v2:172.21.15.155:6816/654840370 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f19fc15b080 con 0x7f19dc074100 2024-04-24T23:58:12.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.739+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f19dc074100 msgr2=0x7f19dc076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.739+0000 7f1a02c00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f19dc074100 0x7f19dc076520 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:12.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.740+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f19dc06be80 msgr2=0x7f19dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.740+0000 7f1a02c00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f19dc06be80 0x7f19dc06e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19fc067400 tx=0x7f19ec009110 comp rx=0 tx=0).stop 2024-04-24T23:58:12.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.741+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc0d2a30 msgr2=0x7f19fc1536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:12.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.741+0000 7f1a02c00640 1 --2- 172.21.15.96:0/3339342463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19fc0d2a30 0x7f19fc1536c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19f4034040 tx=0x7f19f4004a40 comp rx=0 tx=0).stop 2024-04-24T23:58:12.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.741+0000 7f1a00c00640 1 -- 172.21.15.96:0/3339342463 reap_dead start 2024-04-24T23:58:12.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.741+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 shutdown_connections 2024-04-24T23:58:12.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.741+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 >> 172.21.15.96:0/3339342463 conn(0x7f19fc09d450 msgr2=0x7f19fc0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:12.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.742+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 shutdown_connections 2024-04-24T23:58:12.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:12.742+0000 7f1a02c00640 1 -- 172.21.15.96:0/3339342463 wait complete. 2024-04-24T23:58:12.781 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:12.781 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T23:58:12.782 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:12.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T23:58:12.783 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:12.783 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T23:58:12.784 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:12.784 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T23:58:12.785 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-24T23:58:12.785 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T23:58:12.786 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-24T23:58:12.786 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T23:58:12.787 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:12.787 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T23:58:12.788 INFO:teuthology.orchestra.run.smithi096.stdout:55834574856 2024-04-24T23:58:12.789 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T23:58:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.099+0000 7f89a5a00640 1 Processor -- start 2024-04-24T23:58:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.099+0000 7f89a5a00640 1 -- start start 2024-04-24T23:58:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.102+0000 7f89a5a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f89a00b4640 0x7f89a01650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.103+0000 7f89a5a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a00b4ab0 con 0x7f89a00d0200 2024-04-24T23:58:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.103+0000 7f89a5a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a00b4d60 con 0x7f89a006e7a0 2024-04-24T23:58:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.103+0000 7f89a5a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f89a015dd50 con 0x7f89a00b4640 2024-04-24T23:58:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.103+0000 7f899fe00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f89a006e7a0 0x7f89a00cfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:50726/0 (socket says 172.21.15.96:50726) 2024-04-24T23:58:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.103+0000 7f899fe00640 1 -- 172.21.15.96:0/229663541 learned_addr learned my addr 172.21.15.96:0/229663541 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.103+0000 7f89a5000640 1 --2- 172.21.15.96:0/229663541 >> v2:172.21.15.155:3300/0 conn(0x7f89a00b4640 0x7f89a01650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.104+0000 7f89a5000640 1 -- 172.21.15.96:0/229663541 >> v1:172.21.15.155:6789/0 conn(0x7f89a006e7a0 legacy=0x7f89a00cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.104+0000 7f89a5000640 1 -- 172.21.15.96:0/229663541 >> v1:172.21.15.96:6789/0 conn(0x7f89a00d0200 legacy=0x7f89a00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.104+0000 7f89a5000640 1 -- 172.21.15.96:0/229663541 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a015dfa0 con 0x7f89a00b4640 2024-04-24T23:58:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.105+0000 7f89a5000640 1 --2- 172.21.15.96:0/229663541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 0x7f89a01650e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8998009d90 tx=0x7f899802c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c72673923e44fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.106+0000 7f899ea00640 1 -- 172.21.15.96:0/229663541 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998036020 con 0x7f89a00b4640 2024-04-24T23:58:13.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.106+0000 7f899ea00640 1 -- 172.21.15.96:0/229663541 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8998032820 con 0x7f89a00b4640 2024-04-24T23:58:13.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.106+0000 7f899ea00640 1 -- 172.21.15.96:0/229663541 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998032c50 con 0x7f89a00b4640 2024-04-24T23:58:13.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.107+0000 7f89a5a00640 1 -- 172.21.15.96:0/229663541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 msgr2=0x7f89a01650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.108+0000 7f3f2cc00640 1 Processor -- start 2024-04-24T23:58:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.107+0000 7f89a5a00640 1 --2- 172.21.15.96:0/229663541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 0x7f89a01650e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8998009d90 tx=0x7f899802c940 comp rx=0 tx=0).stop 2024-04-24T23:58:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.108+0000 7f89a5a00640 1 -- 172.21.15.96:0/229663541 shutdown_connections 2024-04-24T23:58:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.108+0000 7f89a5a00640 1 --2- 172.21.15.96:0/229663541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 0x7f89a01650e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.108+0000 7f89a5a00640 1 -- 172.21.15.96:0/229663541 >> 172.21.15.96:0/229663541 conn(0x7f89a00b18b0 msgr2=0x7f89a00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.108+0000 7f89a5a00640 1 -- 172.21.15.96:0/229663541 shutdown_connections 2024-04-24T23:58:13.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.108+0000 7f3f2cc00640 1 -- start start 2024-04-24T23:58:13.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.109+0000 7f89a5a00640 1 -- 172.21.15.96:0/229663541 wait complete. 2024-04-24T23:58:13.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.110+0000 7f08dd800640 1 Processor -- start 2024-04-24T23:58:13.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.111+0000 7f3f2cc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815a2b0 0x7f3f280716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.111+0000 7f3f2cc00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3f2815e940 0x7f3f280acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.111+0000 7f89a5a00640 1 Processor -- start 2024-04-24T23:58:13.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f89a5a00640 1 -- start start 2024-04-24T23:58:13.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f3f25e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815a2b0 0x7f3f280716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f3f25e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815a2b0 0x7f3f280716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53242/0 (socket says 172.21.15.96:53242) 2024-04-24T23:58:13.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f3f25e00640 1 -- 172.21.15.96:0/736868821 learned_addr learned my addr 172.21.15.96:0/736868821 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f3f2cc00640 1 -- 172.21.15.96:0/736868821 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f280b3530 con 0x7f3f2815dda0 2024-04-24T23:58:13.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f3f2cc00640 1 -- 172.21.15.96:0/736868821 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3f2815a690 con 0x7f3f2815e940 2024-04-24T23:58:13.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f3f2cc00640 1 -- 172.21.15.96:0/736868821 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3f280b32e0 con 0x7f3f2815a2b0 2024-04-24T23:58:13.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.110+0000 7f08dd800640 1 -- start start 2024-04-24T23:58:13.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f3f25400640 1 --2- 172.21.15.96:0/736868821 >> v2:172.21.15.155:3300/0 conn(0x7f3f2815e940 0x7f3f280acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f08dd800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 0x7f08d80b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f08dd800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f08d815ce50 0x7f08d8166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f08dd800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d81668a0 con 0x7f08d815ca70 2024-04-24T23:58:13.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f08dd800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f08d806dc60 con 0x7f08d815ce50 2024-04-24T23:58:13.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.112+0000 7f08dd800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f08d8167140 con 0x7f08d80d0200 2024-04-24T23:58:13.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.113+0000 7f08d7400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 0x7f08d80b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.113+0000 7f08d7e00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f08d815ca70 0x7f08d80cfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:50736/0 (socket says 172.21.15.96:50736) 2024-04-24T23:58:13.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.113+0000 7f08d7e00640 1 -- 172.21.15.96:0/1033688452 learned_addr learned my addr 172.21.15.96:0/1033688452 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:13.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.113+0000 7f08dce00640 1 --2- 172.21.15.96:0/1033688452 >> v2:172.21.15.155:3300/0 conn(0x7f08d815ce50 0x7f08d8166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.114+0000 7f3f25e00640 1 -- 172.21.15.96:0/736868821 >> v2:172.21.15.155:3300/0 conn(0x7f3f2815e940 msgr2=0x7f3f280acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:13.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.114+0000 7f3f25e00640 1 --2- 172.21.15.96:0/736868821 >> v2:172.21.15.155:3300/0 conn(0x7f3f2815e940 0x7f3f280acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.114+0000 7f3f25e00640 1 -- 172.21.15.96:0/736868821 >> v1:172.21.15.96:6789/0 conn(0x7f3f2815dda0 legacy=0x7f3f280b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.114+0000 7f08dce00640 1 -- 172.21.15.96:0/1033688452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 msgr2=0x7f08d80b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:13.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.114+0000 7f08dce00640 1 --2- 172.21.15.96:0/1033688452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 0x7f08d80b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.114+0000 7f08dce00640 1 -- 172.21.15.96:0/1033688452 >> v1:172.21.15.155:6789/0 conn(0x7f08d815ca70 legacy=0x7f08d80cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.114+0000 7f08dce00640 1 -- 172.21.15.96:0/1033688452 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d8166b80 con 0x7f08d815ce50 2024-04-24T23:58:13.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.114+0000 7f3f25e00640 1 -- 172.21.15.96:0/736868821 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f280b3810 con 0x7f3f2815a2b0 2024-04-24T23:58:13.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.115+0000 7f89a5a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a006e7a0 0x7f89a015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.115+0000 7f89a5a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 0x7f89a013a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.115+0000 7f899fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a006e7a0 0x7f89a015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.115+0000 7f89a5a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89a00d0200 0x7f89a0200c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.115+0000 7f899fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a006e7a0 0x7f89a015a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59012/0 (socket says 172.21.15.96:59012) 2024-04-24T23:58:13.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.116+0000 7f899fe00640 1 -- 172.21.15.96:0/1026414132 learned_addr learned my addr 172.21.15.96:0/1026414132 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.116+0000 7f899f400640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 0x7f89a013a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.115+0000 7f89a5a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f89a006eb80 con 0x7f89a006e7a0 2024-04-24T23:58:13.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.116+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f89a015e560 con 0x7f89a00b4640 2024-04-24T23:58:13.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.116+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89a015ea80 con 0x7f89a00d0200 2024-04-24T23:58:13.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.116+0000 7f89a5000640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89a00d0200 0x7f89a0200c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.116+0000 7f08dce00640 1 --2- 172.21.15.96:0/1033688452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ce50 0x7f08d8166200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009d90 tx=0x7f08d002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c58fbf922a987157 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.116+0000 7f3f25e00640 1 --2- 172.21.15.96:0/736868821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815a2b0 0x7f3f280716e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007360 tx=0x7f3f1802b0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60c54568eb8ec5c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.117+0000 7f08d6a00640 1 -- 172.21.15.96:0/1033688452 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0031600 con 0x7f08d815ce50 2024-04-24T23:58:13.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.117+0000 7f08d6a00640 1 -- 172.21.15.96:0/1033688452 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d00317a0 con 0x7f08d815ce50 2024-04-24T23:58:13.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.117+0000 7f08d6a00640 1 -- 172.21.15.96:0/1033688452 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0031b70 con 0x7f08d815ce50 2024-04-24T23:58:13.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.117+0000 7f899f400640 1 -- 172.21.15.96:0/1026414132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89a00d0200 msgr2=0x7f89a0200c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7f3f24a00640 1 -- 172.21.15.96:0/736868821 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18008df0 con 0x7f3f2815a2b0 2024-04-24T23:58:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.117+0000 7f899f400640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89a00d0200 0x7f89a0200c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.117+0000 7f899f400640 1 -- 172.21.15.96:0/1026414132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a006e7a0 msgr2=0x7f89a015a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7fb8b9a00640 1 Processor -- start 2024-04-24T23:58:13.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7f08dd800640 1 -- 172.21.15.96:0/1033688452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ce50 msgr2=0x7f08d8166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.117+0000 7f899f400640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a006e7a0 0x7f89a015a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7f08dd800640 1 --2- 172.21.15.96:0/1033688452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ce50 0x7f08d8166200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009d90 tx=0x7f08d002a5d0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.117+0000 7f899f400640 1 -- 172.21.15.96:0/1026414132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a0204560 con 0x7f89a00b4640 2024-04-24T23:58:13.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7f08dd800640 1 -- 172.21.15.96:0/1033688452 shutdown_connections 2024-04-24T23:58:13.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7f08dd800640 1 --2- 172.21.15.96:0/1033688452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ce50 0x7f08d8166200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f08dd800640 1 --2- 172.21.15.96:0/1033688452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 0x7f08d80b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7f3f24a00640 1 -- 172.21.15.96:0/736868821 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1802b970 con 0x7f3f2815a2b0 2024-04-24T23:58:13.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7f3f24a00640 1 -- 172.21.15.96:0/736868821 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1802bd20 con 0x7f3f2815a2b0 2024-04-24T23:58:13.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f08dd800640 1 -- 172.21.15.96:0/1033688452 >> 172.21.15.96:0/1033688452 conn(0x7f08d80b18b0 msgr2=0x7f08d80b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f3f2cc00640 1 -- 172.21.15.96:0/736868821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815a2b0 msgr2=0x7f3f280716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f08dd800640 1 -- 172.21.15.96:0/1033688452 shutdown_connections 2024-04-24T23:58:13.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7f899f400640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 0x7f89a013a7c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f899000c3c0 tx=0x7f899000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f08dd800640 1 -- 172.21.15.96:0/1033688452 wait complete. 2024-04-24T23:58:13.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f8997e00640 1 -- 172.21.15.96:0/1026414132 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89900052d0 con 0x7f89a00b4640 2024-04-24T23:58:13.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f8997e00640 1 -- 172.21.15.96:0/1026414132 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8990005490 con 0x7f89a00b4640 2024-04-24T23:58:13.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f8997e00640 1 -- 172.21.15.96:0/1026414132 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990007260 con 0x7f89a00b4640 2024-04-24T23:58:13.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f3f2cc00640 1 --2- 172.21.15.96:0/736868821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815a2b0 0x7f3f280716e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007360 tx=0x7f3f1802b0f0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f3f2cc00640 1 -- 172.21.15.96:0/736868821 shutdown_connections 2024-04-24T23:58:13.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.120+0000 7f3f2cc00640 1 --2- 172.21.15.96:0/736868821 >> v2:172.21.15.155:3300/0 conn(0x7f3f2815e940 0x7f3f280acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.120+0000 7f3f2cc00640 1 --2- 172.21.15.96:0/736868821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815a2b0 0x7f3f280716e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.120+0000 7f3f2cc00640 1 -- 172.21.15.96:0/736868821 >> 172.21.15.96:0/736868821 conn(0x7f3f280b19c0 msgr2=0x7f3f280b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.120+0000 7f3f2cc00640 1 -- 172.21.15.96:0/736868821 shutdown_connections 2024-04-24T23:58:13.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a0201850 con 0x7f89a00b4640 2024-04-24T23:58:13.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.120+0000 7f3f2cc00640 1 -- 172.21.15.96:0/736868821 wait complete. 2024-04-24T23:58:13.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.119+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a0138fa0 con 0x7f89a00b4640 2024-04-24T23:58:13.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.118+0000 7fb8b9a00640 1 -- start start 2024-04-24T23:58:13.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.120+0000 7fb8b9a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b416dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.120+0000 7fb8b9a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b40b4fe0 con 0x7fb8b415cbf0 2024-04-24T23:58:13.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.120+0000 7fb8b9a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b406d5c0 con 0x7fb8b4070df0 2024-04-24T23:58:13.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.120+0000 7fb8b9a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b406d8a0 con 0x7fb8b4071280 2024-04-24T23:58:13.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.121+0000 7fb8b3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b416dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.121+0000 7fb8b3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b416dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53272/0 (socket says 172.21.15.96:53272) 2024-04-24T23:58:13.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.121+0000 7fb8b3400640 1 -- 172.21.15.96:0/960329435 learned_addr learned my addr 172.21.15.96:0/960329435 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.122+0000 7fb8b3400640 1 -- 172.21.15.96:0/960329435 >> v1:172.21.15.155:6789/0 conn(0x7fb8b4070df0 legacy=0x7fb8b416a5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T23:58:13.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.122+0000 7fb8b3400640 1 -- 172.21.15.96:0/960329435 >> v1:172.21.15.96:6789/0 conn(0x7fb8b415cbf0 legacy=0x7fb8b406cb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T23:58:13.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.122+0000 7fb8b3400640 1 -- 172.21.15.96:0/960329435 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b406db80 con 0x7fb8b4071280 2024-04-24T23:58:13.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.123+0000 7f3f2cc00640 1 Processor -- start 2024-04-24T23:58:13.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.123+0000 7fb8b3400640 1 --2- 172.21.15.96:0/960329435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b416dcd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40d0dd0 tx=0x7fb8ac02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f79f8c0438d2d8e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.124+0000 7f3f2cc00640 1 -- start start 2024-04-24T23:58:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.122+0000 7f08dd800640 1 Processor -- start 2024-04-24T23:58:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.122+0000 7f08dd800640 1 -- start start 2024-04-24T23:58:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.123+0000 7f08dd800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 0x7f08d813f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.123+0000 7f08dd800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ca70 0x7f08d80a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.123+0000 7f08dd800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08d815ce50 0x7f08d8140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.124+0000 7f08dd800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f08d8163700 con 0x7f08d815ce50 2024-04-24T23:58:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.124+0000 7f08dd800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f08d806de90 con 0x7f08d815ca70 2024-04-24T23:58:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.124+0000 7f08dd800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f08d8163880 con 0x7f08d80d0200 2024-04-24T23:58:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.124+0000 7f08d7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 0x7f08d813f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.124+0000 7f08d7400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ca70 0x7f08d80a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.124+0000 7f08d7400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ca70 0x7f08d80a9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45964/0 (socket says 172.21.15.96:45964) 2024-04-24T23:58:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.124+0000 7f08d7400640 1 -- 172.21.15.96:0/3341332463 learned_addr learned my addr 172.21.15.96:0/3341332463 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.125+0000 7f08dce00640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08d815ce50 0x7f08d8140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.125+0000 7f08d7400640 1 -- 172.21.15.96:0/3341332463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 msgr2=0x7f08d813f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.125+0000 7f08d7400640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 0x7f08d813f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.125+0000 7f08d7400640 1 -- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08d815ce50 msgr2=0x7f08d8140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.125+0000 7f08d7400640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08d815ce50 0x7f08d8140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.125+0000 7f08d7400640 1 -- 172.21.15.96:0/3341332463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d813ffa0 con 0x7f08d815ca70 2024-04-24T23:58:13.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.126+0000 7fb8b1600640 1 -- 172.21.15.96:0/960329435 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac036070 con 0x7fb8b4071280 2024-04-24T23:58:13.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.124+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8978005290 con 0x7f89a00b4640 2024-04-24T23:58:13.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.126+0000 7fb8b1600640 1 -- 172.21.15.96:0/960329435 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac031600 con 0x7fb8b4071280 2024-04-24T23:58:13.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.126+0000 7fb8b1600640 1 -- 172.21.15.96:0/960329435 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0319d0 con 0x7fb8b4071280 2024-04-24T23:58:13.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.126+0000 7f8997e00640 1 -- 172.21.15.96:0/1026414132 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8990007400 con 0x7f89a00b4640 2024-04-24T23:58:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.126+0000 7f08d7400640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ca70 0x7f08d80a9540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f08c400e9e0 tx=0x7f08c400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.126+0000 7f08cfe00640 1 -- 172.21.15.96:0/3341332463 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4017070 con 0x7f08d815ca70 2024-04-24T23:58:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.127+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d8140280 con 0x7f08d815ca70 2024-04-24T23:58:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.127+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d81626a0 con 0x7f08d815ca70 2024-04-24T23:58:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f8997e00640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f898006bf30 0x7f898006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.127+0000 7f3f2cc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2815a2b0 0x7f3f281efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f3f2cc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815dda0 0x7f3f280ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f3f2cc00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f2815e940 0x7f3f280ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.127+0000 7fb8b9a00640 1 -- 172.21.15.96:0/960329435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 msgr2=0x7fb8b416dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.127+0000 7fb8b9a00640 1 --2- 172.21.15.96:0/960329435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b416dcd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40d0dd0 tx=0x7fb8ac02a6f0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7fb8b9a00640 1 -- 172.21.15.96:0/960329435 shutdown_connections 2024-04-24T23:58:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7fb8b9a00640 1 --2- 172.21.15.96:0/960329435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b416dcd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7fb8b9a00640 1 -- 172.21.15.96:0/960329435 >> 172.21.15.96:0/960329435 conn(0x7fb8b40b19c0 msgr2=0x7fb8b40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.127+0000 7f08cfe00640 1 -- 172.21.15.96:0/3341332463 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c400c9d0 con 0x7f08d815ca70 2024-04-24T23:58:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.127+0000 7f08cfe00640 1 -- 172.21.15.96:0/3341332463 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4017070 con 0x7f08d815ca70 2024-04-24T23:58:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7fb8b9a00640 1 -- 172.21.15.96:0/960329435 shutdown_connections 2024-04-24T23:58:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7fb8b9a00640 1 -- 172.21.15.96:0/960329435 wait complete. 2024-04-24T23:58:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f8997e00640 1 -- 172.21.15.96:0/1026414132 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f899008a090 con 0x7f89a00b4640 2024-04-24T23:58:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7fc2e4e00640 1 Processor -- start 2024-04-24T23:58:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.129+0000 7fc2e4e00640 1 -- start start 2024-04-24T23:58:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f3f25e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2815a2b0 0x7f3f281efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f3f2cc00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3f280b3dd0 con 0x7f3f2815e940 2024-04-24T23:58:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f3f2cc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f280b4140 con 0x7f3f2815a2b0 2024-04-24T23:58:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f3f2cc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3f280ad2e0 con 0x7f3f2815dda0 2024-04-24T23:58:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f3f25e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2815a2b0 0x7f3f281efd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:45976/0 (socket says 172.21.15.96:45976) 2024-04-24T23:58:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7f3f25e00640 1 -- 172.21.15.96:0/1657126917 learned_addr learned my addr 172.21.15.96:0/1657126917 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.129+0000 7f3f25400640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815dda0 0x7f3f280ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.129+0000 7f3f26800640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f2815e940 0x7f3f280ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.129+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b0005290 con 0x7f08d815ca70 2024-04-24T23:58:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7fb903a00640 1 Processor -- start 2024-04-24T23:58:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.128+0000 7fb903a00640 1 -- start start 2024-04-24T23:58:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7f899fe00640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f898006bf30 0x7f898006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.129+0000 7f3f25e00640 1 -- 172.21.15.96:0/1657126917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815dda0 msgr2=0x7f3f280ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.129+0000 7f3f25e00640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815dda0 0x7f3f280ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7f3f25e00640 1 -- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f2815e940 msgr2=0x7f3f280ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7fc2e4e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2e00b24b0 0x7fc2e015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7f3f25e00640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f2815e940 0x7f3f280ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7f3f25e00640 1 -- 172.21.15.96:0/1657126917 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f281f0270 con 0x7f3f2815a2b0 2024-04-24T23:58:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7f3f26800640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f2815e940 0x7f3f280ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7fb8b9a00640 1 Processor -- start 2024-04-24T23:58:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7f899fe00640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f898006bf30 0x7f898006e3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f898c005880 tx=0x7f898c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fb903a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8fc166890 0x7fb8fc166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7fc2e4e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e015e940 0x7fc2e00716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7fc2e4e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc2e00acda0 0x7fc2e015dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7fc2e4e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e00b32e0 con 0x7fc2e00b24b0 2024-04-24T23:58:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fb8b9a00640 1 -- start start 2024-04-24T23:58:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fb8fbe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8fc166890 0x7fb8fc166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fb8fbe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8fc166890 0x7fb8fc166cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59050/0 (socket says 172.21.15.96:59050) 2024-04-24T23:58:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fb903a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8fc0b3880 0x7fb8fc0b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7fc2e4e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e00b4140 con 0x7fc2e00acda0 2024-04-24T23:58:13.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fb8fbe00640 1 -- 172.21.15.96:0/2231474091 learned_addr learned my addr 172.21.15.96:0/2231474091 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fb903a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8fc0b3380 con 0x7fb8fc162570 2024-04-24T23:58:13.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fb903a00640 1 -- 172.21.15.96:0/2231474091 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb8fc06def0 con 0x7fb8fc166890 2024-04-24T23:58:13.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fb903a00640 1 -- 172.21.15.96:0/2231474091 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb8fc06e1d0 con 0x7fb8fc0b3880 2024-04-24T23:58:13.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.130+0000 7fc2e4e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e00b3530 con 0x7fc2e015e940 2024-04-24T23:58:13.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fc2dde00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2e00b24b0 0x7fc2e015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7f3f25e00640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2815a2b0 0x7f3f281efd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3f18000c00 tx=0x7f3f180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fc2dde00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2e00b24b0 0x7fc2e015a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59034/0 (socket says 172.21.15.96:59034) 2024-04-24T23:58:13.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fc2dde00640 1 -- 172.21.15.96:0/2109019403 learned_addr learned my addr 172.21.15.96:0/2109019403 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fc2de800640 1 --2- 172.21.15.96:0/2109019403 >> v2:172.21.15.155:3300/0 conn(0x7fc2e00acda0 0x7fc2e015dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.132+0000 7fb901a00640 1 --2- 172.21.15.96:0/2231474091 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc0b3880 0x7fb8fc0b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.131+0000 7fc2dd400640 1 --2- 172.21.15.96:0/2109019403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e015e940 0x7fc2e00716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.132+0000 7fc2dde00640 1 -- 172.21.15.96:0/2109019403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e015e940 msgr2=0x7fc2e00716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:13.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.132+0000 7fc2dde00640 1 --2- 172.21.15.96:0/2109019403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e015e940 0x7fc2e00716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.132+0000 7fc2dde00640 1 -- 172.21.15.96:0/2109019403 >> v2:172.21.15.155:3300/0 conn(0x7fc2e00acda0 msgr2=0x7fc2e015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:13.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.132+0000 7fc2dde00640 1 --2- 172.21.15.96:0/2109019403 >> v2:172.21.15.155:3300/0 conn(0x7fc2e00acda0 0x7fc2e015dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.132+0000 7fc2dde00640 1 -- 172.21.15.96:0/2109019403 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e00b3810 con 0x7fc2e00b24b0 2024-04-24T23:58:13.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.132+0000 7fb8fbe00640 1 -- 172.21.15.96:0/2231474091 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc0b3880 msgr2=0x7fb8fc0b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:13.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b9a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8b4070df0 0x7fb8b41fc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.132+0000 7fb8fb400640 1 -- 172.21.15.96:0/2231474091 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212100985 0 0) 0x7fb8fc0b3380 con 0x7fb8fc162570 2024-04-24T23:58:13.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8fbe00640 1 --2- 172.21.15.96:0/2231474091 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc0b3880 0x7fb8fc0b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8fbe00640 1 -- 172.21.15.96:0/2231474091 >> v1:172.21.15.96:6789/0 conn(0x7fb8fc162570 legacy=0x7fb8fc166180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8fbe00640 1 -- 172.21.15.96:0/2231474091 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc06e4b0 con 0x7fb8fc166890 2024-04-24T23:58:13.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b9a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b40cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b9a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b415cbf0 0x7fb8b40d0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b9a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b406e660 con 0x7fb8b4070df0 2024-04-24T23:58:13.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b9a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b40716d0 con 0x7fb8b415cbf0 2024-04-24T23:58:13.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b9a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b415cfd0 con 0x7fb8b4071280 2024-04-24T23:58:13.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7f53f1a00640 1 Processor -- start 2024-04-24T23:58:13.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b2a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8b4070df0 0x7fb8b41fc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b2a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8b4070df0 0x7fb8b41fc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59052/0 (socket says 172.21.15.96:59052) 2024-04-24T23:58:13.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b2a00640 1 -- 172.21.15.96:0/791396288 learned_addr learned my addr 172.21.15.96:0/791396288 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7f53f1a00640 1 -- start start 2024-04-24T23:58:13.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.133+0000 7fb8b2000640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b40cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb8b3400640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b415cbf0 0x7fb8b40d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb8b2a00640 1 -- 172.21.15.96:0/791396288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 msgr2=0x7fb8b40cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb901a00640 1 --2- 172.21.15.96:0/2231474091 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc0b3880 0x7fb8fc0b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:13.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb8b2a00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b40cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb8b2a00640 1 -- 172.21.15.96:0/791396288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b415cbf0 msgr2=0x7fb8b40d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb8b2a00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b415cbf0 0x7fb8b40d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb8b2a00640 1 -- 172.21.15.96:0/791396288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b409aeb0 con 0x7fb8b4070df0 2024-04-24T23:58:13.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb8fbe00640 1 --2- 172.21.15.96:0/2231474091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc166890 0x7fb8fc166cf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc070d80 tx=0x7fb8f002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1438625932a090c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fc2dde00640 1 --2- 172.21.15.96:0/2109019403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00b24b0 0x7fc2e015a2b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0070f30 tx=0x7fc2d002a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bd4cc5c901d81c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb8b2a00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8b4070df0 0x7fb8b41fc060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400b3e0 tx=0x7fb8a400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fb8fb400640 1 -- 172.21.15.96:0/2231474091 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0037070 con 0x7fb8fc166890 2024-04-24T23:58:13.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.134+0000 7fc2dca00640 1 -- 172.21.15.96:0/2109019403 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d002f710 con 0x7fc2e00b24b0 2024-04-24T23:58:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fc2dca00640 1 -- 172.21.15.96:0/2109019403 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d002f8b0 con 0x7fc2e00b24b0 2024-04-24T23:58:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fc2dca00640 1 -- 172.21.15.96:0/2109019403 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d002fcc0 con 0x7fc2e00b24b0 2024-04-24T23:58:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fb8aaa00640 1 -- 172.21.15.96:0/791396288 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4015020 con 0x7fb8b4070df0 2024-04-24T23:58:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fb8aaa00640 1 -- 172.21.15.96:0/791396288 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a4011850 con 0x7fb8b4070df0 2024-04-24T23:58:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fb8aaa00640 1 -- 172.21.15.96:0/791396288 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4011c40 con 0x7fb8b4070df0 2024-04-24T23:58:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fb8fb400640 1 -- 172.21.15.96:0/2231474091 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f0032440 con 0x7fb8fc166890 2024-04-24T23:58:13.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7f53f1a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0d1110 0x7f53ec0d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7f53f1a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f53ec0cf700 0x7f53ec0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b409b190 con 0x7fb8b4070df0 2024-04-24T23:58:13.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fb8fb400640 1 -- 172.21.15.96:0/2231474091 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0037070 con 0x7fb8fc166890 2024-04-24T23:58:13.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b409b750 con 0x7fb8b4070df0 2024-04-24T23:58:13.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7f53f1a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ec0cfbe0 con 0x7f53ec0b51f0 2024-04-24T23:58:13.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7f53f1a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f53ec0c7bf0 con 0x7f53ec0cf700 2024-04-24T23:58:13.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7f53f1a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f53ec0cfec0 con 0x7f53ec0d1110 2024-04-24T23:58:13.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7f53e2000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0d1110 0x7f53ec0d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7f53e2000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0d1110 0x7f53ec0d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53340/0 (socket says 172.21.15.96:53340) 2024-04-24T23:58:13.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7f53e2000640 1 -- 172.21.15.96:0/308768999 learned_addr learned my addr 172.21.15.96:0/308768999 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2109019403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00b24b0 msgr2=0x7fc2e015a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.135+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2109019403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00b24b0 0x7fc2e015a2b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0070f30 tx=0x7fc2d002a620 comp rx=0 tx=0).stop 2024-04-24T23:58:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2109019403 shutdown_connections 2024-04-24T23:58:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2109019403 >> v2:172.21.15.155:3300/0 conn(0x7fc2e00acda0 0x7fc2e015dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2109019403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e015e940 0x7fc2e00716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2109019403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00b24b0 0x7fc2e015a2b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2109019403 >> 172.21.15.96:0/2109019403 conn(0x7fc2e00b19c0 msgr2=0x7fc2e00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fb903a00640 1 -- 172.21.15.96:0/2231474091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc166890 msgr2=0x7fb8fc166cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fb903a00640 1 --2- 172.21.15.96:0/2231474091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc166890 0x7fb8fc166cf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc070d80 tx=0x7fb8f002a2a0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7f53eaa00640 1 --1- 172.21.15.96:0/308768999 >> v1:172.21.15.155:6789/0 conn(0x7f53ec0b51f0 0x7f53ec0d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:50746/0 (socket says 172.21.15.96:50746) 2024-04-24T23:58:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fb903a00640 1 -- 172.21.15.96:0/2231474091 shutdown_connections 2024-04-24T23:58:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fb903a00640 1 --2- 172.21.15.96:0/2231474091 >> v2:172.21.15.155:3300/0 conn(0x7fb8fc0b3880 0x7fb8fc0b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fb903a00640 1 --2- 172.21.15.96:0/2231474091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc166890 0x7fb8fc166cf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fb903a00640 1 -- 172.21.15.96:0/2231474091 >> 172.21.15.96:0/2231474091 conn(0x7fb8fc0b19c0 msgr2=0x7fb8fc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fb903a00640 1 -- 172.21.15.96:0/2231474091 shutdown_connections 2024-04-24T23:58:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fb903a00640 1 -- 172.21.15.96:0/2231474091 wait complete. 2024-04-24T23:58:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2109019403 shutdown_connections 2024-04-24T23:58:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2109019403 wait complete. 2024-04-24T23:58:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7f53eb400640 1 --2- 172.21.15.96:0/308768999 >> v2:172.21.15.155:3300/0 conn(0x7f53ec0cf700 0x7f53ec0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.136+0000 7f53eb400640 1 -- 172.21.15.96:0/308768999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0d1110 msgr2=0x7f53ec0d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.137+0000 7f53eb400640 1 --2- 172.21.15.96:0/308768999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0d1110 0x7f53ec0d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.137+0000 7f53eb400640 1 -- 172.21.15.96:0/308768999 >> v1:172.21.15.155:6789/0 conn(0x7f53ec0b51f0 legacy=0x7f53ec0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.137+0000 7f53eb400640 1 -- 172.21.15.96:0/308768999 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec0d01a0 con 0x7f53ec0cf700 2024-04-24T23:58:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.138+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c005290 con 0x7fb8b4070df0 2024-04-24T23:58:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.138+0000 7f21aca00640 1 Processor -- start 2024-04-24T23:58:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.138+0000 7fb903a00640 1 Processor -- start 2024-04-24T23:58:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.138+0000 7fb903a00640 1 -- start start 2024-04-24T23:58:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.139+0000 7fb903a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8fc0b3880 0x7fb8fc14bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.139+0000 7fb903a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc162570 0x7fb8fc0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.139+0000 7fc2e4e00640 1 Processor -- start 2024-04-24T23:58:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.139+0000 7fb903a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8fc166890 0x7fb8fc0d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fb903a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0b2de0 con 0x7fb8fc162570 2024-04-24T23:58:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fb903a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc06db80 con 0x7fb8fc0b3880 2024-04-24T23:58:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fb903a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc0b2f60 con 0x7fb8fc166890 2024-04-24T23:58:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.139+0000 7f53eb400640 1 --2- 172.21.15.96:0/308768999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53ec0cf700 0x7f53ec0b55d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53e40097a0 tx=0x7f53e402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=485c286893527887 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.138+0000 7f21aca00640 1 -- start start 2024-04-24T23:58:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7f21aca00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f21a80675b0 0x7f21a80ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7f21aca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8166f30 0x7f21a806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7f21aca00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a8163390 con 0x7f21a8162b40 2024-04-24T23:58:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7f21aca00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f21a806ebd0 con 0x7f21a80675b0 2024-04-24T23:58:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7f21aca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f21a80b0770 con 0x7f21a8166f30 2024-04-24T23:58:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fc2e4e00640 1 -- start start 2024-04-24T23:58:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7f21a6800640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f21a8162b40 0x7f21a8066ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51016/0 (socket says 172.21.15.96:51016) 2024-04-24T23:58:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7f21a6800640 1 -- 172.21.15.96:0/4064354304 learned_addr learned my addr 172.21.15.96:0/4064354304 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fb8aaa00640 1 -- 172.21.15.96:0/791396288 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8a4018020 con 0x7fb8b4070df0 2024-04-24T23:58:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fb901000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8fc0b3880 0x7fb8fc14bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fb901000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8fc0b3880 0x7fb8fc14bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:46026/0 (socket says 172.21.15.96:46026) 2024-04-24T23:58:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fb901000640 1 -- 172.21.15.96:0/2281766756 learned_addr learned my addr 172.21.15.96:0/2281766756 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fb901a00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8fc166890 0x7fb8fc0d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7fb8fbe00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc162570 0x7fb8fc0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7f21a7200640 1 --2- 172.21.15.96:0/4064354304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8166f30 0x7f21a806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.140+0000 7f21a5e00640 1 --2- 172.21.15.96:0/4064354304 >> v2:172.21.15.96:3300/0 conn(0x7f21a80675b0 0x7f21a80ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7f21a7200640 1 -- 172.21.15.96:0/4064354304 >> v2:172.21.15.96:3300/0 conn(0x7f21a80675b0 msgr2=0x7f21a80ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7f21a7200640 1 --2- 172.21.15.96:0/4064354304 >> v2:172.21.15.96:3300/0 conn(0x7f21a80675b0 0x7f21a80ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7f21a7200640 1 -- 172.21.15.96:0/4064354304 >> v1:172.21.15.96:6789/0 conn(0x7f21a8162b40 legacy=0x7f21a8066ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7f21a7200640 1 -- 172.21.15.96:0/4064354304 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a8163670 con 0x7f21a8166f30 2024-04-24T23:58:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7fb901000640 1 -- 172.21.15.96:0/2281766756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8fc166890 msgr2=0x7fb8fc0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7fb901000640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8fc166890 0x7fb8fc0d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7fb901000640 1 -- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc162570 msgr2=0x7fb8fc0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7fb901000640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc162570 0x7fb8fc0d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7fb901000640 1 -- 172.21.15.96:0/2281766756 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc09bc60 con 0x7fb8fc0b3880 2024-04-24T23:58:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7fb8fbe00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc162570 0x7fb8fc0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.141+0000 7fb8aaa00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb89406be60 0x7fb89406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.142+0000 7fb901000640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8fc0b3880 0x7fb8fc14bea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800c4e0 tx=0x7fb8e800c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.142+0000 7fc2e4e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e00acda0 0x7fc2e01ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.142+0000 7fc2e4e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e015e940 0x7fc2e00ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.142+0000 7fb8aaa00640 1 -- 172.21.15.96:0/791396288 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb8a408ae00 con 0x7fb8b4070df0 2024-04-24T23:58:13.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.142+0000 7fc2e4e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00aeba0 0x7fc2e015c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.142+0000 7fb8b2000640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb89406be60 0x7fb89406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.142+0000 7fc2dde00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e00acda0 0x7fc2e01ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.142+0000 7fc2dd400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e015e940 0x7fc2e00ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2dd400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e015e940 0x7fc2e00ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59076/0 (socket says 172.21.15.96:59076) 2024-04-24T23:58:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2dde00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e00acda0 0x7fc2e01ef5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:46040/0 (socket says 172.21.15.96:46040) 2024-04-24T23:58:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2dd400640 1 -- 172.21.15.96:0/2593587059 learned_addr learned my addr 172.21.15.96:0/2593587059 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e00ad250 con 0x7fc2e015e940 2024-04-24T23:58:13.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7f21a7200640 1 --2- 172.21.15.96:0/4064354304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8166f30 0x7f21a806f040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009d90 tx=0x7f21a002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a274c806b829d98 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e00b3dd0 con 0x7fc2e00acda0 2024-04-24T23:58:13.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e00ad3d0 con 0x7fc2e00aeba0 2024-04-24T23:58:13.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2de800640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00aeba0 0x7fc2e015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7f21a5400640 1 -- 172.21.15.96:0/4064354304 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0007740 con 0x7f21a8166f30 2024-04-24T23:58:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7f21a5400640 1 -- 172.21.15.96:0/4064354304 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a00078e0 con 0x7f21a8166f30 2024-04-24T23:58:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7f21a5400640 1 -- 172.21.15.96:0/4064354304 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0007cb0 con 0x7f21a8166f30 2024-04-24T23:58:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2dd400640 1 -- 172.21.15.96:0/2593587059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00aeba0 msgr2=0x7fc2e015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2dd400640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00aeba0 0x7fc2e015c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2dd400640 1 -- 172.21.15.96:0/2593587059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e00acda0 msgr2=0x7fc2e01ef5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2dd400640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e00acda0 0x7fc2e01ef5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2dd400640 1 -- 172.21.15.96:0/2593587059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e014f700 con 0x7fc2e015e940 2024-04-24T23:58:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fc2de800640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00aeba0 0x7fc2e015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.143+0000 7fb8b2000640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb89406be60 0x7fb89406e320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0006fd0 tx=0x7fb8a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.144+0000 7fc2dd400640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e015e940 0x7fc2e00ae660 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800e840 tx=0x7fc2c800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.144+0000 7f21aca00640 1 -- 172.21.15.96:0/4064354304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8166f30 msgr2=0x7f21a806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.144+0000 7f21aca00640 1 --2- 172.21.15.96:0/4064354304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8166f30 0x7f21a806f040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009d90 tx=0x7f21a002a6f0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.144+0000 7f21aca00640 1 -- 172.21.15.96:0/4064354304 shutdown_connections 2024-04-24T23:58:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.144+0000 7f21aca00640 1 --2- 172.21.15.96:0/4064354304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8166f30 0x7f21a806f040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.144+0000 7f21aca00640 1 --2- 172.21.15.96:0/4064354304 >> v2:172.21.15.96:3300/0 conn(0x7f21a80675b0 0x7f21a80ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.144+0000 7f21aca00640 1 -- 172.21.15.96:0/4064354304 >> 172.21.15.96:0/4064354304 conn(0x7f21a80cd8a0 msgr2=0x7f21a80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.144+0000 7f21aca00640 1 -- 172.21.15.96:0/4064354304 shutdown_connections 2024-04-24T23:58:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.144+0000 7f21aca00640 1 -- 172.21.15.96:0/4064354304 wait complete. 2024-04-24T23:58:13.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.146+0000 7fc2d6000640 1 -- 172.21.15.96:0/2593587059 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8017070 con 0x7fc2e015e940 2024-04-24T23:58:13.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.146+0000 7fc2d6000640 1 -- 172.21.15.96:0/2593587059 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c800c940 con 0x7fc2e015e940 2024-04-24T23:58:13.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.146+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e014f9e0 con 0x7fc2e015e940 2024-04-24T23:58:13.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.146+0000 7fc2d6000640 1 -- 172.21.15.96:0/2593587059 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800cd10 con 0x7fc2e015e940 2024-04-24T23:58:13.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.146+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e014ffa0 con 0x7fc2e015e940 2024-04-24T23:58:13.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.147+0000 7fb8aaa00640 1 -- 172.21.15.96:0/791396288 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb8a401f020 con 0x7fb8b4070df0 2024-04-24T23:58:13.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.147+0000 7f21aca00640 1 Processor -- start 2024-04-24T23:58:13.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.147+0000 7f21aca00640 1 -- start start 2024-04-24T23:58:13.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e0069110 con 0x7fc2e015e940 2024-04-24T23:58:13.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f53ea000640 1 -- 172.21.15.96:0/308768999 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4037070 con 0x7f53ec0cf700 2024-04-24T23:58:13.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f3f1e000640 1 -- 172.21.15.96:0/1657126917 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18042030 con 0x7f3f2815a2b0 2024-04-24T23:58:13.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f21aca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a80675b0 0x7f21a81f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f8997e00640 1 -- 172.21.15.96:0/1026414132 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f89900583d0 con 0x7f89a00b4640 2024-04-24T23:58:13.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f21aca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8162b40 0x7f21a8160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f3f2cc00640 1 -- 172.21.15.96:0/1657126917 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f280cd8b0 con 0x7f3f2815a2b0 2024-04-24T23:58:13.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f3f2cc00640 1 -- 172.21.15.96:0/1657126917 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2809c4a0 con 0x7f3f2815a2b0 2024-04-24T23:58:13.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f3f1e000640 1 -- 172.21.15.96:0/1657126917 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1800a420 con 0x7f3f2815a2b0 2024-04-24T23:58:13.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f3f1e000640 1 -- 172.21.15.96:0/1657126917 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18042030 con 0x7f3f2815a2b0 2024-04-24T23:58:13.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f53ea000640 1 -- 172.21.15.96:0/308768999 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e402ae40 con 0x7f53ec0cf700 2024-04-24T23:58:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f21aca00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8166f30 0x7f21a81fb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f21aca00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81673c0 con 0x7f21a8166f30 2024-04-24T23:58:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f21aca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f21a8163c30 con 0x7f21a80675b0 2024-04-24T23:58:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.148+0000 7f21aca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f21a80ce570 con 0x7f21a8162b40 2024-04-24T23:58:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.149+0000 7f21a6800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a80675b0 0x7f21a81f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.149+0000 7f21a7200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8166f30 0x7f21a81fb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.149+0000 7f21a5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8162b40 0x7f21a8160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.149+0000 7f21a5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8162b40 0x7f21a8160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53368/0 (socket says 172.21.15.96:53368) 2024-04-24T23:58:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.149+0000 7f21a5e00640 1 -- 172.21.15.96:0/786556134 learned_addr learned my addr 172.21.15.96:0/786556134 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.149+0000 7f53f1a00640 1 -- 172.21.15.96:0/308768999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53ec0cf700 msgr2=0x7f53ec0b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7fb8f8c00640 1 -- 172.21.15.96:0/2281766756 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8017070 con 0x7fb8fc0b3880 2024-04-24T23:58:13.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7fb8f8c00640 1 -- 172.21.15.96:0/2281766756 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e80035f0 con 0x7fb8fc0b3880 2024-04-24T23:58:13.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7fb8f8c00640 1 -- 172.21.15.96:0/2281766756 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80039e0 con 0x7fb8fc0b3880 2024-04-24T23:58:13.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.149+0000 7f53f1a00640 1 --2- 172.21.15.96:0/308768999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53ec0cf700 0x7f53ec0b55d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53e40097a0 tx=0x7f53e402a0f0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7f21a5e00640 1 -- 172.21.15.96:0/786556134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a80675b0 msgr2=0x7f21a81f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7f21a5e00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a80675b0 0x7f21a81f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7f21a5e00640 1 -- 172.21.15.96:0/786556134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8166f30 msgr2=0x7f21a81fb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7f21a5e00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8166f30 0x7f21a81fb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7f21a5e00640 1 -- 172.21.15.96:0/786556134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a81fc1c0 con 0x7f21a8162b40 2024-04-24T23:58:13.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f21a5e00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8162b40 0x7f21a8160ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f219400c7f0 tx=0x7f219400ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.149+0000 7fc2d6000640 1 -- 172.21.15.96:0/2593587059 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2c801a070 con 0x7fc2e015e940 2024-04-24T23:58:13.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7fc2d6000640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7fc2d6000640 1 -- 172.21.15.96:0/2593587059 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc2c808b000 con 0x7fc2e015e940 2024-04-24T23:58:13.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f53f1a00640 1 -- 172.21.15.96:0/308768999 shutdown_connections 2024-04-24T23:58:13.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f53f1a00640 1 --2- 172.21.15.96:0/308768999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53ec0cf700 0x7f53ec0b55d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f53f1a00640 1 --2- 172.21.15.96:0/308768999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0d1110 0x7f53ec0d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f53f1a00640 1 -- 172.21.15.96:0/308768999 >> 172.21.15.96:0/308768999 conn(0x7f53ec0d40a0 msgr2=0x7f53ec0d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.150+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc09bf40 con 0x7fb8fc0b3880 2024-04-24T23:58:13.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc14c3e0 con 0x7fb8fc0b3880 2024-04-24T23:58:13.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f08cfe00640 1 -- 172.21.15.96:0/3341332463 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08c401a070 con 0x7f08d815ca70 2024-04-24T23:58:13.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f219ea00640 1 -- 172.21.15.96:0/786556134 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194015070 con 0x7f21a8162b40 2024-04-24T23:58:13.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f219ea00640 1 -- 172.21.15.96:0/786556134 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2194004240 con 0x7f21a8162b40 2024-04-24T23:58:13.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f219ea00640 1 -- 172.21.15.96:0/786556134 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194007620 con 0x7f21a8162b40 2024-04-24T23:58:13.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f53f1a00640 1 -- 172.21.15.96:0/308768999 shutdown_connections 2024-04-24T23:58:13.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.151+0000 7f53f1a00640 1 -- 172.21.15.96:0/308768999 wait complete. 2024-04-24T23:58:13.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.152+0000 7f3f13400640 1 -- 172.21.15.96:0/1657126917 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3efc005290 con 0x7f3f2815a2b0 2024-04-24T23:58:13.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.152+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a81fc4a0 con 0x7f21a8162b40 2024-04-24T23:58:13.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.152+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a809d430 con 0x7f21a8162b40 2024-04-24T23:58:13.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.152+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc0689f0 con 0x7fb8fc0b3880 2024-04-24T23:58:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.153+0000 7f08cfe00640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f08b806c030 0x7f08b806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.153+0000 7f08cfe00640 1 -- 172.21.15.96:0/3341332463 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f08c408b1d0 con 0x7f08d815ca70 2024-04-24T23:58:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.153+0000 7f08d7e00640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f08b806c030 0x7f08b806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.153+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2180005290 con 0x7f21a8162b40 2024-04-24T23:58:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.154+0000 7f53f1a00640 1 Processor -- start 2024-04-24T23:58:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.154+0000 7f53f1a00640 1 -- start start 2024-04-24T23:58:13.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.154+0000 7fc2dde00640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.155+0000 7f08d7e00640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f08b806c030 0x7f08b806e4f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005880 tx=0x7f08c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.155+0000 7fc2dde00640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0034000 tx=0x7fc2d002f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53f1a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53ec0b51f0 0x7f53ec158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53f1a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0cf700 0x7f53ec0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53f1a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ec0d1110 0x7f53ec0ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53f1a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec0c7980 con 0x7f53ec0d1110 2024-04-24T23:58:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53f1a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec0c7800 con 0x7f53ec0b51f0 2024-04-24T23:58:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53f1a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f53ec0c8360 con 0x7f53ec0cf700 2024-04-24T23:58:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f219ea00640 1 -- 172.21.15.96:0/786556134 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21940079d0 con 0x7f21a8162b40 2024-04-24T23:58:13.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53eb400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ec0d1110 0x7f53ec0ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53eb400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ec0d1110 0x7f53ec0ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59086/0 (socket says 172.21.15.96:59086) 2024-04-24T23:58:13.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53eb400640 1 -- 172.21.15.96:0/2518536595 learned_addr learned my addr 172.21.15.96:0/2518536595 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:13.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53eaa00640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53ec0b51f0 0x7f53ec158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.156+0000 7f53e2000640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0cf700 0x7f53ec0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.157+0000 7f219ea00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f218806bf30 0x7f218806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.157+0000 7f219ea00640 1 -- 172.21.15.96:0/786556134 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f219408b2b0 con 0x7f21a8162b40 2024-04-24T23:58:13.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.157+0000 7f53eb400640 1 -- 172.21.15.96:0/2518536595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0cf700 msgr2=0x7f53ec0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.157+0000 7f53eb400640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0cf700 0x7f53ec0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.157+0000 7f53eb400640 1 -- 172.21.15.96:0/2518536595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53ec0b51f0 msgr2=0x7f53ec158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.157+0000 7f53eb400640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53ec0b51f0 0x7f53ec158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.157+0000 7f53eb400640 1 -- 172.21.15.96:0/2518536595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec0b7d10 con 0x7f53ec0d1110 2024-04-24T23:58:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.157+0000 7f21a6800640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f218806bf30 0x7f218806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.157+0000 7f53eb400640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ec0d1110 0x7f53ec0ccca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f53e40097a0 tx=0x7f53e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.158+0000 7f21a6800640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f218806bf30 0x7f218806e3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2198005880 tx=0x7f2198009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.159+0000 7f53e3400640 1 -- 172.21.15.96:0/2518536595 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4041070 con 0x7f53ec0d1110 2024-04-24T23:58:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.159+0000 7f53e3400640 1 -- 172.21.15.96:0/2518536595 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e403c870 con 0x7f53ec0d1110 2024-04-24T23:58:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.159+0000 7f53e3400640 1 -- 172.21.15.96:0/2518536595 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4037040 con 0x7f53ec0d1110 2024-04-24T23:58:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.159+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ec1644b0 con 0x7f53ec0d1110 2024-04-24T23:58:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.159+0000 7fc2d6000640 1 -- 172.21.15.96:0/2593587059 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc2c80592c0 con 0x7fc2e015e940 2024-04-24T23:58:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.159+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ec164a70 con 0x7f53ec0d1110 2024-04-24T23:58:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.161+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ec0681f0 con 0x7f53ec0d1110 2024-04-24T23:58:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.163+0000 7f53e3400640 1 -- 172.21.15.96:0/2518536595 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53e4044070 con 0x7f53ec0d1110 2024-04-24T23:58:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.164+0000 7f53e3400640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f53c806beb0 0x7f53c806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.163+0000 7f08cfe00640 1 -- 172.21.15.96:0/3341332463 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f08c40595a0 con 0x7f08d815ca70 2024-04-24T23:58:13.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.164+0000 7f53e3400640 1 -- 172.21.15.96:0/2518536595 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f53e40ab400 con 0x7f53ec0d1110 2024-04-24T23:58:13.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.164+0000 7f53eaa00640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f53c806beb0 0x7f53c806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.166+0000 7f3f1e000640 1 -- 172.21.15.96:0/1657126917 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f18045070 con 0x7f3f2815a2b0 2024-04-24T23:58:13.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.168+0000 7f53eaa00640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f53c806beb0 0x7f53c806e370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0012e0 tx=0x7f53dc001650 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.168+0000 7fb8f8c00640 1 -- 172.21.15.96:0/2281766756 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8e801a070 con 0x7fb8fc0b3880 2024-04-24T23:58:13.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.168+0000 7f3f1e000640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f0806c030 0x7f3f0806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.168+0000 7f3f1e000640 1 -- 172.21.15.96:0/1657126917 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3f180abe90 con 0x7f3f2815a2b0 2024-04-24T23:58:13.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.169+0000 7f3f25400640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f0806c030 0x7f3f0806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.169+0000 7fb8f8c00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb8dc06bf30 0x7fb8dc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:13.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.169+0000 7fb8f8c00640 1 -- 172.21.15.96:0/2281766756 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb8e808a970 con 0x7fb8fc0b3880 2024-04-24T23:58:13.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.170+0000 7fb8fbe00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb8dc06bf30 0x7fb8dc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:13.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.170+0000 7f3f25400640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f0806c030 0x7f3f0806e4f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f14006fd0 tx=0x7f3f14011040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.171+0000 7fb8fbe00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb8dc06bf30 0x7fb8dc06e3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0034000 tx=0x7fb8f002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:13.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.172+0000 7f219ea00640 1 -- 172.21.15.96:0/786556134 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f21940595f0 con 0x7f21a8162b40 2024-04-24T23:58:13.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.174+0000 7f53e3400640 1 -- 172.21.15.96:0/2518536595 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f53e404b030 con 0x7f53ec0d1110 2024-04-24T23:58:13.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.177+0000 7f3f1e000640 1 -- 172.21.15.96:0/1657126917 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3f1807a9d0 con 0x7f3f2815a2b0 2024-04-24T23:58:13.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.188+0000 7fb8f8c00640 1 -- 172.21.15.96:0/2281766756 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb8fc0689f0 con 0x7fb8fc0b3880 2024-04-24T23:58:13.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.557+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb88c005580 con 0x7fb8b4070df0 2024-04-24T23:58:13.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.558+0000 7fb8aaa00640 1 -- 172.21.15.96:0/791396288 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8a40172c0 con 0x7fb8b4070df0 2024-04-24T23:58:13.561 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-24T23:58:13.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.561+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb89406be60 msgr2=0x7fb89406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.561+0000 7fb8b9a00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb89406be60 0x7fb89406e320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0006fd0 tx=0x7fb8a0008040 comp rx=0 tx=0).stop 2024-04-24T23:58:13.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.561+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8b4070df0 msgr2=0x7fb8b41fc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.561+0000 7fb8b9a00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8b4070df0 0x7fb8b41fc060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400b3e0 tx=0x7fb8a400b8a0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.562+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 shutdown_connections 2024-04-24T23:58:13.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.562+0000 7fb8b9a00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b415cbf0 0x7fb8b40d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.562+0000 7fb8b9a00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b4071280 0x7fb8b40cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.562+0000 7fb8b9a00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb89406be60 0x7fb89406e320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.562+0000 7fb8b9a00640 1 --2- 172.21.15.96:0/791396288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8b4070df0 0x7fb8b41fc060 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.562+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 >> 172.21.15.96:0/791396288 conn(0x7fb8b40b19c0 msgr2=0x7fb8b40b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.563+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 shutdown_connections 2024-04-24T23:58:13.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.563+0000 7fb8b9a00640 1 -- 172.21.15.96:0/791396288 wait complete. 2024-04-24T23:58:13.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.568+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8978005580 con 0x7f89a00b4640 2024-04-24T23:58:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.569+0000 7f8997e00640 1 -- 172.21.15.96:0/1026414132 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f899005c6d0 con 0x7f89a00b4640 2024-04-24T23:58:13.570 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-24T23:58:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.572+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f898006bf30 msgr2=0x7f898006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.572+0000 7f89a5a00640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f898006bf30 0x7f898006e3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f898c005880 tx=0x7f898c009040 comp rx=0 tx=0).stop 2024-04-24T23:58:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.572+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 msgr2=0x7f89a013a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.572+0000 7f89a5a00640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 0x7f89a013a7c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f899000c3c0 tx=0x7f899000c880 comp rx=0 tx=0).stop 2024-04-24T23:58:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.573+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 shutdown_connections 2024-04-24T23:58:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.573+0000 7f89a5a00640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89a00d0200 0x7f89a0200c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.573+0000 7f89a5a00640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89a00b4640 0x7f89a013a7c0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f899000c3c0 tx=0x7f899000c880 comp rx=0 tx=0).stop 2024-04-24T23:58:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.573+0000 7f89a5a00640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f898006bf30 0x7f898006e3f0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f898c005880 tx=0x7f898c009040 comp rx=0 tx=0).stop 2024-04-24T23:58:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.573+0000 7f89a5a00640 1 --2- 172.21.15.96:0/1026414132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a006e7a0 0x7f89a015a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.573+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 >> 172.21.15.96:0/1026414132 conn(0x7f89a00b18b0 msgr2=0x7f89a00b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.573+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 shutdown_connections 2024-04-24T23:58:13.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.573+0000 7f89a5a00640 1 -- 172.21.15.96:0/1026414132 wait complete. 2024-04-24T23:58:13.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.590+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc2e009d880 con 0x7fc2e015e940 2024-04-24T23:58:13.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-04-24T23:58:13.592 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:13.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.591+0000 7fc2d6000640 1 -- 172.21.15.96:0/2593587059 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc2c805d5c0 con 0x7fc2e015e940 2024-04-24T23:58:13.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.593+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f08b0005850 con 0x7f08d815ca70 2024-04-24T23:58:13.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.594+0000 7f08cfe00640 1 -- 172.21.15.96:0/3341332463 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08c405d8a0 con 0x7f08d815ca70 2024-04-24T23:58:13.595 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-24T23:58:13.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc2bc06be30 msgr2=0x7fc2bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0034000 tx=0x7fc2d002f000 comp rx=0 tx=0).stop 2024-04-24T23:58:13.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e015e940 msgr2=0x7fc2e00ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e015e940 0x7fc2e00ae660 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800e840 tx=0x7fc2c800ed00 comp rx=0 tx=0).stop 2024-04-24T23:58:13.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 shutdown_connections 2024-04-24T23:58:13.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00aeba0 0x7fc2e015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e015e940 0x7fc2e00ae660 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 --2- 172.21.15.96:0/2593587059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e00acda0 0x7fc2e01ef5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.595+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 >> 172.21.15.96:0/2593587059 conn(0x7fc2e00b19c0 msgr2=0x7fc2e0070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.597+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 shutdown_connections 2024-04-24T23:58:13.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.597+0000 7fc2e4e00640 1 -- 172.21.15.96:0/2593587059 wait complete. 2024-04-24T23:58:13.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.597+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f08b806c030 msgr2=0x7f08b806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.597+0000 7f08dd800640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f08b806c030 0x7f08b806e4f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005880 tx=0x7f08c8009040 comp rx=0 tx=0).stop 2024-04-24T23:58:13.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.597+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ca70 msgr2=0x7f08d80a9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.597+0000 7f08dd800640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ca70 0x7f08d80a9540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f08c400e9e0 tx=0x7f08c400eea0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.598+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 shutdown_connections 2024-04-24T23:58:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.598+0000 7f08dd800640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f08b806c030 0x7f08b806e4f0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005880 tx=0x7f08c8009040 comp rx=0 tx=0).stop 2024-04-24T23:58:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.598+0000 7f08dd800640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08d815ce50 0x7f08d8140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.598+0000 7f08dd800640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d815ca70 0x7f08d80a9540 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.598+0000 7f08dd800640 1 --2- 172.21.15.96:0/3341332463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08d80d0200 0x7f08d813f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.598+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 >> 172.21.15.96:0/3341332463 conn(0x7f08d80b18b0 msgr2=0x7f08d806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.599+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2180005850 con 0x7f21a8162b40 2024-04-24T23:58:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.600+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 shutdown_connections 2024-04-24T23:58:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.600+0000 7f08dd800640 1 -- 172.21.15.96:0/3341332463 wait complete. 2024-04-24T23:58:13.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-04-24T23:58:13.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.600+0000 7f219ea00640 1 -- 172.21.15.96:0/786556134 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f219405d8f0 con 0x7f21a8162b40 2024-04-24T23:58:13.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.601+0000 7f3f13400640 1 -- 172.21.15.96:0/1657126917 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3efc005850 con 0x7f3f2815a2b0 2024-04-24T23:58:13.604 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-24T23:58:13.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.602+0000 7f3f1e000640 1 -- 172.21.15.96:0/1657126917 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3f1807a2d0 con 0x7f3f2815a2b0 2024-04-24T23:58:13.604 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-24T23:58:13.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.603+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f218806bf30 msgr2=0x7f218806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.603+0000 7f21aca00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f218806bf30 0x7f218806e3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2198005880 tx=0x7f2198009040 comp rx=0 tx=0).stop 2024-04-24T23:58:13.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.603+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8162b40 msgr2=0x7f21a8160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.603+0000 7f21aca00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8162b40 0x7f21a8160ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f219400c7f0 tx=0x7f219400ccb0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.604+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 shutdown_connections 2024-04-24T23:58:13.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.604+0000 7f21aca00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f218806bf30 0x7f218806e3f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.604+0000 7f21aca00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8166f30 0x7f21a81fb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.604+0000 7f21aca00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a8162b40 0x7f21a8160ae0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.604+0000 7f21aca00640 1 --2- 172.21.15.96:0/786556134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a80675b0 0x7f21a81f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.604+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 >> 172.21.15.96:0/786556134 conn(0x7f21a80cd8a0 msgr2=0x7f21a80cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.604+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 shutdown_connections 2024-04-24T23:58:13.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.604+0000 7f21aca00640 1 -- 172.21.15.96:0/786556134 wait complete. 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.605+0000 7f3f13400640 1 -- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f0806c030 msgr2=0x7f3f0806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.605+0000 7f3f13400640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f0806c030 0x7f3f0806e4f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f14006fd0 tx=0x7f3f14011040 comp rx=0 tx=0).stop 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.605+0000 7f3f13400640 1 -- 172.21.15.96:0/1657126917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2815a2b0 msgr2=0x7f3f281efd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.605+0000 7f3f13400640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2815a2b0 0x7f3f281efd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3f18000c00 tx=0x7f3f180046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.605+0000 7f3f13400640 1 -- 172.21.15.96:0/1657126917 shutdown_connections 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.605+0000 7f3f13400640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3f0806c030 0x7f3f0806e4f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.605+0000 7f3f13400640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f2815e940 0x7f3f280ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.605+0000 7f3f13400640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f2815dda0 0x7f3f280ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.605+0000 7f3f13400640 1 --2- 172.21.15.96:0/1657126917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2815a2b0 0x7f3f281efd30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.606+0000 7f3f13400640 1 -- 172.21.15.96:0/1657126917 >> 172.21.15.96:0/1657126917 conn(0x7f3f280b19c0 msgr2=0x7f3f280b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.606+0000 7f3f13400640 1 -- 172.21.15.96:0/1657126917 shutdown_connections 2024-04-24T23:58:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.606+0000 7f3f13400640 1 -- 172.21.15.96:0/1657126917 wait complete. 2024-04-24T23:58:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.607+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f53ec0ce560 con 0x7f53ec0d1110 2024-04-24T23:58:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.608+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb8fc069110 con 0x7fb8fc0b3880 2024-04-24T23:58:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.608+0000 7f53e3400640 1 -- 172.21.15.96:0/2518536595 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53e40799f0 con 0x7f53ec0d1110 2024-04-24T23:58:13.609 INFO:teuthology.orchestra.run.smithi096.stdout:55834574853 2024-04-24T23:58:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.609+0000 7fb8f8c00640 1 -- 172.21.15.96:0/2281766756 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8e8058d40 con 0x7fb8fc0b3880 2024-04-24T23:58:13.612 INFO:teuthology.orchestra.run.smithi096.stdout:55834574853 2024-04-24T23:58:13.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.612+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f53c806beb0 msgr2=0x7f53c806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.612+0000 7f53f1a00640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f53c806beb0 0x7f53c806e370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0012e0 tx=0x7f53dc001650 comp rx=0 tx=0).stop 2024-04-24T23:58:13.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.612+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ec0d1110 msgr2=0x7f53ec0ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.612+0000 7f53f1a00640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ec0d1110 0x7f53ec0ccca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f53e40097a0 tx=0x7f53e40046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.612+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 shutdown_connections 2024-04-24T23:58:13.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7f53f1a00640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f53c806beb0 0x7f53c806e370 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7f53f1a00640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ec0d1110 0x7f53ec0ccca0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7f53f1a00640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53ec0cf700 0x7f53ec0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7f53f1a00640 1 --2- 172.21.15.96:0/2518536595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53ec0b51f0 0x7f53ec158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 >> 172.21.15.96:0/2518536595 conn(0x7f53ec0d40a0 msgr2=0x7f53ec162520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb8dc06bf30 msgr2=0x7fb8dc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb8dc06bf30 0x7fb8dc06e3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0034000 tx=0x7fb8f002e000 comp rx=0 tx=0).stop 2024-04-24T23:58:13.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 shutdown_connections 2024-04-24T23:58:13.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8fc0b3880 msgr2=0x7fb8fc14bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8fc0b3880 0x7fb8fc14bea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800c4e0 tx=0x7fb8e800c9a0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 shutdown_connections 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8fc166890 0x7fb8fc0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb8dc06bf30 0x7fb8dc06e3f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8fc162570 0x7fb8fc0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 --2- 172.21.15.96:0/2281766756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8fc0b3880 0x7fb8fc14bea0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 >> 172.21.15.96:0/2281766756 conn(0x7fb8fc0b19c0 msgr2=0x7fb8fc161010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 shutdown_connections 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7fb903a00640 1 -- 172.21.15.96:0/2281766756 wait complete. 2024-04-24T23:58:13.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:13.613+0000 7f53f1a00640 1 -- 172.21.15.96:0/2518536595 wait complete. 2024-04-24T23:58:13.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-04-24T23:58:13.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-24T23:58:13.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-24T23:58:13.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-04-24T23:58:13.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-04-24T23:58:13.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-04-24T23:58:14.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T23:58:14.604 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T23:58:14.627 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T23:58:14.627 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T23:58:14.629 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T23:58:14.630 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T23:58:14.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T23:58:14.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T23:58:14.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.873+0000 7f0aa6a00640 1 Processor -- start 2024-04-24T23:58:14.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.873+0000 7f0aa6a00640 1 -- start start 2024-04-24T23:58:14.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.875+0000 7f0aa6a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a9803c0a0 0x7f0a980e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.876+0000 7f0a9fe00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0a980e3160 0x7f0a98058050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51018/0 (socket says 172.21.15.96:51018) 2024-04-24T23:58:14.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.876+0000 7f0a9fe00640 1 -- 172.21.15.96:0/3161836644 learned_addr learned my addr 172.21.15.96:0/3161836644 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:14.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.877+0000 7f0a9f400640 1 --2- 172.21.15.96:0/3161836644 >> v2:172.21.15.155:3300/0 conn(0x7f0a9803c0a0 0x7f0a980e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.877+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/3161836644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98053cb0 0x7f0a98054140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.878+0000 7f0aa6a00640 1 -- 172.21.15.96:0/3161836644 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a98054680 con 0x7f0a980e3160 2024-04-24T23:58:14.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.878+0000 7f0aa6a00640 1 -- 172.21.15.96:0/3161836644 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0a98007b70 con 0x7f0a9803c0a0 2024-04-24T23:58:14.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.878+0000 7f0aa6a00640 1 -- 172.21.15.96:0/3161836644 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0a98058810 con 0x7f0a98053cb0 2024-04-24T23:58:14.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.879+0000 7f0aa4a00640 1 --2- 172.21.15.96:0/3161836644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98053cb0 0x7f0a98054140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.879+0000 7f0a9ea00640 1 -- 172.21.15.96:0/3161836644 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724830527 0 0) 0x7f0a98054680 con 0x7f0a980e3160 2024-04-24T23:58:14.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.880+0000 7f0a9ea00640 1 -- 172.21.15.96:0/3161836644 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a88003520 con 0x7f0a980e3160 2024-04-24T23:58:14.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.880+0000 7f0a9ea00640 1 -- 172.21.15.96:0/3161836644 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 286732587 0 0) 0x7f0a88003520 con 0x7f0a980e3160 2024-04-24T23:58:14.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.881+0000 7f0a9f400640 1 -- 172.21.15.96:0/3161836644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98053cb0 msgr2=0x7f0a98054140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.881+0000 7f0a9f400640 1 --2- 172.21.15.96:0/3161836644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98053cb0 0x7f0a98054140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.881+0000 7f0a9f400640 1 -- 172.21.15.96:0/3161836644 >> v1:172.21.15.96:6789/0 conn(0x7f0a980e3160 legacy=0x7f0a98058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.881+0000 7f0a9f400640 1 -- 172.21.15.96:0/3161836644 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a98058af0 con 0x7f0a9803c0a0 2024-04-24T23:58:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.883+0000 7f0a9f400640 1 --2- 172.21.15.96:0/3161836644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a9803c0a0 0x7f0a980e7780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a940097a0 tx=0x7f0a9402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35aa14bb8bc6ab0b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.884+0000 7f0a9ea00640 1 -- 172.21.15.96:0/3161836644 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94037070 con 0x7f0a9803c0a0 2024-04-24T23:58:14.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.884+0000 7f0a9ea00640 1 -- 172.21.15.96:0/3161836644 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9402abc0 con 0x7f0a9803c0a0 2024-04-24T23:58:14.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.885+0000 7f0a9ea00640 1 -- 172.21.15.96:0/3161836644 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00755d0 con 0x7f0a9803c0a0 2024-04-24T23:58:14.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.886+0000 7f0aa6a00640 1 -- 172.21.15.96:0/3161836644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a9803c0a0 msgr2=0x7f0a980e7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.886+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/3161836644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a9803c0a0 0x7f0a980e7780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a940097a0 tx=0x7f0a9402a130 comp rx=0 tx=0).stop 2024-04-24T23:58:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.886+0000 7f0aa6a00640 1 -- 172.21.15.96:0/3161836644 shutdown_connections 2024-04-24T23:58:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.886+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/3161836644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98053cb0 0x7f0a98054140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.887+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/3161836644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a9803c0a0 0x7f0a980e7780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.887+0000 7f0aa6a00640 1 -- 172.21.15.96:0/3161836644 >> 172.21.15.96:0/3161836644 conn(0x7f0a98058ee0 msgr2=0x7f0a980592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.887+0000 7f0aa6a00640 1 -- 172.21.15.96:0/3161836644 shutdown_connections 2024-04-24T23:58:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.887+0000 7f0aa6a00640 1 -- 172.21.15.96:0/3161836644 wait complete. 2024-04-24T23:58:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.890+0000 7f0aa6a00640 1 Processor -- start 2024-04-24T23:58:14.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.891+0000 7f0aa6a00640 1 -- start start 2024-04-24T23:58:14.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.893+0000 7f0aa6a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a9803c0a0 0x7f0a980e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.893+0000 7f0aa6a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98053cb0 0x7f0a981858f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.893+0000 7f0aa6a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a980e3160 0x7f0a98185e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.894+0000 7f0a9fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a9803c0a0 0x7f0a980e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.894+0000 7f0a9fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a9803c0a0 0x7f0a980e40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53412/0 (socket says 172.21.15.96:53412) 2024-04-24T23:58:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.894+0000 7f0a9f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98053cb0 0x7f0a981858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.894+0000 7f0a9f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98053cb0 0x7f0a981858f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:46076/0 (socket says 172.21.15.96:46076) 2024-04-24T23:58:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.895+0000 7f0aa4a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a980e3160 0x7f0a98185e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.895+0000 7f0aa4a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a980e3160 0x7f0a98185e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59094/0 (socket says 172.21.15.96:59094) 2024-04-24T23:58:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.895+0000 7f0a9fe00640 1 -- 172.21.15.96:0/1779072782 learned_addr learned my addr 172.21.15.96:0/1779072782 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.895+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980e3540 con 0x7f0a980e3160 2024-04-24T23:58:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.896+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0a98006640 con 0x7f0a98053cb0 2024-04-24T23:58:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.896+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0a98006b60 con 0x7f0a9803c0a0 2024-04-24T23:58:14.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.897+0000 7f0aa4a00640 1 -- 172.21.15.96:0/1779072782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a9803c0a0 msgr2=0x7f0a980e40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.897+0000 7f0aa4a00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a9803c0a0 0x7f0a980e40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.897+0000 7f0aa4a00640 1 -- 172.21.15.96:0/1779072782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98053cb0 msgr2=0x7f0a981858f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.897+0000 7f0aa4a00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98053cb0 0x7f0a981858f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.897+0000 7f0aa4a00640 1 -- 172.21.15.96:0/1779072782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a980e4ca0 con 0x7f0a980e3160 2024-04-24T23:58:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.897+0000 7f0aa4a00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a980e3160 0x7f0a98185e30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000d530 tx=0x7f0a9000d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.897+0000 7f0a9fe00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a9803c0a0 0x7f0a980e40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.898+0000 7f0a8fe00640 1 -- 172.21.15.96:0/1779072782 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900125f0 con 0x7f0a980e3160 2024-04-24T23:58:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.898+0000 7f0a8fe00640 1 -- 172.21.15.96:0/1779072782 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a90019070 con 0x7f0a980e3160 2024-04-24T23:58:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.898+0000 7f0a8fe00640 1 -- 172.21.15.96:0/1779072782 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900129b0 con 0x7f0a980e3160 2024-04-24T23:58:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.898+0000 7f0a9f400640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98053cb0 0x7f0a981858f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:14.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.900+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a980e4f80 con 0x7f0a980e3160 2024-04-24T23:58:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.901+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a980e5540 con 0x7f0a980e3160 2024-04-24T23:58:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.904+0000 7f0a8fe00640 1 -- 172.21.15.96:0/1779072782 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a90012b50 con 0x7f0a980e3160 2024-04-24T23:58:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.905+0000 7f0a8fe00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0a8406be30 0x7f0a8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.906+0000 7f0a9fe00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0a8406be30 0x7f0a8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.908+0000 7f0a9fe00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0a8406be30 0x7f0a8406e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0050090 tx=0x7f0aa007ab20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.909+0000 7f0a8fe00640 1 -- 172.21.15.96:0/1779072782 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0a90012e40 con 0x7f0a980e3160 2024-04-24T23:58:14.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.909+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a98005390 con 0x7f0a980e3160 2024-04-24T23:58:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.919+0000 7f0a8fe00640 1 -- 172.21.15.96:0/1779072782 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0a9005f030 con 0x7f0a980e3160 2024-04-24T23:58:14.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.925+0000 7fad92000640 1 Processor -- start 2024-04-24T23:58:14.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.925+0000 7fad92000640 1 -- start start 2024-04-24T23:58:14.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.927+0000 7fad92000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad840543c0 0x7fad840e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.927+0000 7fad92000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad84058810 con 0x7fad8403c0a0 2024-04-24T23:58:14.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.927+0000 7fad92000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad84058af0 con 0x7fad840e3160 2024-04-24T23:58:14.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.927+0000 7fc62b200640 1 Processor -- start 2024-04-24T23:58:14.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.927+0000 7fad92000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fad84007b70 con 0x7fad840543c0 2024-04-24T23:58:14.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.928+0000 7fad91600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad840543c0 0x7fad840e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.928+0000 7fad91600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad840543c0 0x7fad840e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:53414/0 (socket says 172.21.15.96:53414) 2024-04-24T23:58:14.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.928+0000 7fad90c00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fad840e3160 0x7fad84058050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:50762/0 (socket says 172.21.15.96:50762) 2024-04-24T23:58:14.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.928+0000 7fad90c00640 1 -- 172.21.15.96:0/2006016679 learned_addr learned my addr 172.21.15.96:0/2006016679 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:14.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.928+0000 7fc62b200640 1 -- start start 2024-04-24T23:58:14.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.929+0000 7fc62b200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc62c06e1c0 0x7fc62c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.930+0000 7fc62b200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc62c0cf3c0 0x7fc62c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.930+0000 7fc62b200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc62c0cf890 con 0x7fc62c06e5a0 2024-04-24T23:58:14.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.930+0000 7fc62b200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc62c1663b0 con 0x7fc62c06e1c0 2024-04-24T23:58:14.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.930+0000 7fc62b200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc62c166c50 con 0x7fc62c0cf3c0 2024-04-24T23:58:14.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.930+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2064860529 0 0) 0x7fad84058af0 con 0x7fad840e3160 2024-04-24T23:58:14.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.930+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad74003520 con 0x7fad840e3160 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.930+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713004509 0 0) 0x7fad84058810 con 0x7fad8403c0a0 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.930+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad74003880 con 0x7fad8403c0a0 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 761837269 0 0) 0x7fad74003520 con 0x7fad840e3160 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad840543c0 msgr2=0x7fad840e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad840543c0 0x7fad840e7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 >> v1:172.21.15.96:6789/0 conn(0x7fad8403c0a0 legacy=0x7fad84053cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad84006360 con 0x7fad840e3160 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fad78001650 con 0x7fad840e3160 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 >> v1:172.21.15.155:6789/0 conn(0x7fad840e3160 legacy=0x7fad84058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad74003d30 0x7fad74004150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad74004800 0x7fad74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad74005390 0x7fad740141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fad74014a80 con 0x7fad74005390 2024-04-24T23:58:14.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad74014c30 con 0x7fad74004800 2024-04-24T23:58:14.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.931+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fad74014e30 con 0x7fad74003d30 2024-04-24T23:58:14.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.932+0000 7fc629400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc62c0cf3c0 0x7fc62c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.932+0000 7fc629400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc62c0cf3c0 0x7fc62c0cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:46080/0 (socket says 172.21.15.96:46080) 2024-04-24T23:58:14.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.932+0000 7fc629400640 1 -- 172.21.15.96:0/636087247 learned_addr learned my addr 172.21.15.96:0/636087247 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:14.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.932+0000 7fc629e00640 1 --2- 172.21.15.96:0/636087247 >> v2:172.21.15.96:3300/0 conn(0x7fc62c06e1c0 0x7fc62c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.932+0000 7fad90c00640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad74003d30 0x7fad74004150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.933+0000 7fad91600640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad74005390 0x7fad740141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.933+0000 7fad8be00640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad74004800 0x7fad74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.933+0000 7fc628a00640 1 -- 172.21.15.96:0/636087247 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3953680820 0 0) 0x7fc62c0cf890 con 0x7fc62c06e5a0 2024-04-24T23:58:14.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.933+0000 7fc629400640 1 -- 172.21.15.96:0/636087247 >> v2:172.21.15.96:3300/0 conn(0x7fc62c06e1c0 msgr2=0x7fc62c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.933+0000 7fc629400640 1 --2- 172.21.15.96:0/636087247 >> v2:172.21.15.96:3300/0 conn(0x7fc62c06e1c0 0x7fc62c0cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.933+0000 7fc629400640 1 -- 172.21.15.96:0/636087247 >> v1:172.21.15.155:6789/0 conn(0x7fc62c06e5a0 legacy=0x7fc62c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.934+0000 7fad8be00640 1 -- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad74003d30 msgr2=0x7fad74004150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.934+0000 7fad8be00640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad74003d30 0x7fad74004150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.934+0000 7fad8be00640 1 -- 172.21.15.96:0/2006016679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad74005390 msgr2=0x7fad740141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.934+0000 7fad8be00640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad74005390 0x7fad740141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.934+0000 7fad8be00640 1 -- 172.21.15.96:0/2006016679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad84006360 con 0x7fad74004800 2024-04-24T23:58:14.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.934+0000 7fad91600640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad74005390 0x7fad740141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:14.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.933+0000 7fc629400640 1 -- 172.21.15.96:0/636087247 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c166600 con 0x7fc62c0cf3c0 2024-04-24T23:58:14.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.933+0000 7fc629e00640 1 --2- 172.21.15.96:0/636087247 >> v2:172.21.15.96:3300/0 conn(0x7fc62c06e1c0 0x7fc62c0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:14.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.935+0000 7fc629400640 1 --2- 172.21.15.96:0/636087247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 0x7fc62c0cc560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0cd4c0 tx=0x7fc61c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2354b2be8e254c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.936+0000 7fc628a00640 1 -- 172.21.15.96:0/636087247 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c037070 con 0x7fc62c0cf3c0 2024-04-24T23:58:14.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.936+0000 7fc628a00640 1 -- 172.21.15.96:0/636087247 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61c032440 con 0x7fc62c0cf3c0 2024-04-24T23:58:14.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.936+0000 7fc628a00640 1 -- 172.21.15.96:0/636087247 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c032810 con 0x7fc62c0cf3c0 2024-04-24T23:58:14.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.936+0000 7ff002200640 1 Processor -- start 2024-04-24T23:58:14.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.936+0000 7fad8be00640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad74004800 0x7fad74004c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad80001800 tx=0x7fad74005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7d3feb43ea1197e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7ff002200640 1 -- start start 2024-04-24T23:58:14.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7f51fd200640 1 Processor -- start 2024-04-24T23:58:14.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fc62b200640 1 -- 172.21.15.96:0/636087247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 msgr2=0x7fc62c0cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fc62b200640 1 --2- 172.21.15.96:0/636087247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 0x7fc62c0cc560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0cd4c0 tx=0x7fc61c02a270 comp rx=0 tx=0).stop 2024-04-24T23:58:14.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80001420 con 0x7fad74004800 2024-04-24T23:58:14.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fc62b200640 1 -- 172.21.15.96:0/636087247 shutdown_connections 2024-04-24T23:58:14.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fc62b200640 1 --2- 172.21.15.96:0/636087247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 0x7fc62c0cc560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fc62b200640 1 --2- 172.21.15.96:0/636087247 >> v2:172.21.15.96:3300/0 conn(0x7fc62c06e1c0 0x7fc62c0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fc62b200640 1 -- 172.21.15.96:0/636087247 >> 172.21.15.96:0/636087247 conn(0x7fc62c0b1f10 msgr2=0x7fc62c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:14.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad800052d0 con 0x7fad74004800 2024-04-24T23:58:14.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fc62b200640 1 -- 172.21.15.96:0/636087247 shutdown_connections 2024-04-24T23:58:14.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fad8b400640 1 -- 172.21.15.96:0/2006016679 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8002abb0 con 0x7fad74004800 2024-04-24T23:58:14.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7fc62b200640 1 -- 172.21.15.96:0/636087247 wait complete. 2024-04-24T23:58:14.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.937+0000 7f51fd200640 1 -- start start 2024-04-24T23:58:14.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.938+0000 7f19b1e00640 1 Processor -- start 2024-04-24T23:58:14.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.938+0000 7f19b1e00640 1 -- start start 2024-04-24T23:58:14.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.938+0000 7fad92000640 1 -- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad74004800 msgr2=0x7fad74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.938+0000 7fad92000640 1 --2- 172.21.15.96:0/2006016679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad74004800 0x7fad74004c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad80001800 tx=0x7fad74005830 comp rx=0 tx=0).stop 2024-04-24T23:58:14.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7fad91600640 1 -- 172.21.15.96:0/2006016679 reap_dead start 2024-04-24T23:58:14.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7fad92000640 1 -- 172.21.15.96:0/2006016679 shutdown_connections 2024-04-24T23:58:14.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7fad92000640 1 -- 172.21.15.96:0/2006016679 >> 172.21.15.96:0/2006016679 conn(0x7fad84058ee0 msgr2=0x7fad840592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:14.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7ff002200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc15b220 0x7feffc15f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7ff002200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feffc06d400 0x7feffc06d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7ff002200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feffc0713d0 con 0x7feffc070df0 2024-04-24T23:58:14.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7ff002200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7feffc0aee00 con 0x7feffc06d400 2024-04-24T23:58:14.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7ff002200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feffc0ae4d0 con 0x7feffc15b220 2024-04-24T23:58:14.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7feffb400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7feffc070df0 0x7feffc15ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51042/0 (socket says 172.21.15.96:51042) 2024-04-24T23:58:14.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.939+0000 7feffb400640 1 -- 172.21.15.96:0/1163651987 learned_addr learned my addr 172.21.15.96:0/1163651987 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:14.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7f19b1e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f19ac15e210 0x7f19ac06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7f19b1e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19ac15e5f0 0x7f19ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7fad92000640 1 -- 172.21.15.96:0/2006016679 shutdown_connections 2024-04-24T23:58:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7f19b1e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19ac0d2cc0 con 0x7f19ac0cecc0 2024-04-24T23:58:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7f19b1e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f19ac06c6f0 con 0x7f19ac15e210 2024-04-24T23:58:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7f19b1e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f19ac0d2fa0 con 0x7f19ac15e5f0 2024-04-24T23:58:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7fc62b200640 1 Processor -- start 2024-04-24T23:58:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7feffaa00640 1 --2- 172.21.15.96:0/1163651987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc15b220 0x7feffc15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7feffbe00640 1 --2- 172.21.15.96:0/1163651987 >> v2:172.21.15.155:3300/0 conn(0x7feffc06d400 0x7feffc06d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7f19aaa00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f19ac15e210 0x7f19ac06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7fc62b200640 1 -- start start 2024-04-24T23:58:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7f19ab400640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f19ac0cecc0 0x7f19ac0d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:50784/0 (socket says 172.21.15.96:50784) 2024-04-24T23:58:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7f19ab400640 1 -- 172.21.15.96:0/2201946907 learned_addr learned my addr 172.21.15.96:0/2201946907 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7f51fd200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51f80d26f0 0x7f51f80d2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7feffa000640 1 -- 172.21.15.96:0/1163651987 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260262893 0 0) 0x7feffc0713d0 con 0x7feffc070df0 2024-04-24T23:58:14.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.940+0000 7fad92000640 1 -- 172.21.15.96:0/2006016679 wait complete. 2024-04-24T23:58:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7fc62b200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c06e1c0 0x7fc62c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7fc62b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc62c06e5a0 0x7fc62c0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7fc62b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 0x7fc62c0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7fc62b200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c1670e0 con 0x7fc62c06e1c0 2024-04-24T23:58:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7fc62b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c072d10 con 0x7fc62c0cf3c0 2024-04-24T23:58:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7fc62b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc62c0aed60 con 0x7fc62c06e5a0 2024-04-24T23:58:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7fc629e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c06e1c0 0x7fc62c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7f19a9600640 1 -- 172.21.15.96:0/2201946907 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294626202 0 0) 0x7f19ac0d2cc0 con 0x7f19ac0cecc0 2024-04-24T23:58:14.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7f19aaa00640 1 -- 172.21.15.96:0/2201946907 >> v2:172.21.15.155:3300/0 conn(0x7f19ac15e5f0 msgr2=0x7f19ac06d0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T23:58:14.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7f19aaa00640 1 --2- 172.21.15.96:0/2201946907 >> v2:172.21.15.155:3300/0 conn(0x7f19ac15e5f0 0x7f19ac06d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7f19aaa00640 1 -- 172.21.15.96:0/2201946907 >> v1:172.21.15.155:6789/0 conn(0x7f19ac0cecc0 legacy=0x7f19ac0d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7f19aaa00640 1 -- 172.21.15.96:0/2201946907 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac06c0a0 con 0x7f19ac15e210 2024-04-24T23:58:14.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7fc629e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c06e1c0 0x7fc62c0b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59134/0 (socket says 172.21.15.96:59134) 2024-04-24T23:58:14.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7fc629e00640 1 -- 172.21.15.96:0/1508341058 learned_addr learned my addr 172.21.15.96:0/1508341058 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:14.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7fc629400640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc62c06e5a0 0x7fc62c0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7f51fd200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f51f80cf2b0 0x7f51f80cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7f51f7400640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f51f8161880 0x7f51f80b3d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:50790/0 (socket says 172.21.15.96:50790) 2024-04-24T23:58:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7f51fd200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f80b4820 con 0x7f51f8161880 2024-04-24T23:58:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7f51fd200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f51f80d3070 con 0x7f51f80cf2b0 2024-04-24T23:58:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7f51fd200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f51f80b4b00 con 0x7f51f80d26f0 2024-04-24T23:58:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.942+0000 7f51f7400640 1 -- 172.21.15.96:0/947470810 learned_addr learned my addr 172.21.15.96:0/947470810 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7feffaa00640 1 -- 172.21.15.96:0/1163651987 >> v2:172.21.15.155:3300/0 conn(0x7feffc06d400 msgr2=0x7feffc06d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7feffaa00640 1 --2- 172.21.15.96:0/1163651987 >> v2:172.21.15.155:3300/0 conn(0x7feffc06d400 0x7feffc06d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7feffaa00640 1 -- 172.21.15.96:0/1163651987 >> v1:172.21.15.96:6789/0 conn(0x7feffc070df0 legacy=0x7feffc15ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.941+0000 7feffaa00640 1 -- 172.21.15.96:0/1163651987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc0ae7b0 con 0x7feffc15b220 2024-04-24T23:58:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.943+0000 7fc62a800640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 0x7fc62c0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.943+0000 7f51efe00640 1 --2- 172.21.15.96:0/947470810 >> v2:172.21.15.155:3300/0 conn(0x7f51f80d26f0 0x7f51f80d2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.943+0000 7f51f7e00640 1 --2- 172.21.15.96:0/947470810 >> v2:172.21.15.96:3300/0 conn(0x7f51f80cf2b0 0x7f51f80cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.943+0000 7fc629e00640 1 -- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc62c06e5a0 msgr2=0x7fc62c0b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.943+0000 7fad92000640 1 Processor -- start 2024-04-24T23:58:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.943+0000 7fc629e00640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc62c06e5a0 0x7fc62c0b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.943+0000 7fc629e00640 1 -- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 msgr2=0x7fc62c0acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.943+0000 7fc629e00640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 0x7fc62c0acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.943+0000 7fc629e00640 1 -- 172.21.15.96:0/1508341058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c143430 con 0x7fc62c06e1c0 2024-04-24T23:58:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7fc629400640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc62c06e5a0 0x7fc62c0b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7f51f6a00640 1 -- 172.21.15.96:0/947470810 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807716036 0 0) 0x7f51f80b4820 con 0x7f51f8161880 2024-04-24T23:58:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7f51f6a00640 1 -- 172.21.15.96:0/947470810 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51dc003520 con 0x7f51f8161880 2024-04-24T23:58:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7feffaa00640 1 --2- 172.21.15.96:0/1163651987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc15b220 0x7feffc15f380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fefe80097a0 tx=0x7fefe802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a079505cf7334208 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7f51f7e00640 1 -- 172.21.15.96:0/947470810 >> v2:172.21.15.155:3300/0 conn(0x7f51f80d26f0 msgr2=0x7f51f80d2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7f51f7e00640 1 --2- 172.21.15.96:0/947470810 >> v2:172.21.15.155:3300/0 conn(0x7f51f80d26f0 0x7f51f80d2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7f51f7e00640 1 -- 172.21.15.96:0/947470810 >> v1:172.21.15.155:6789/0 conn(0x7f51f8161880 legacy=0x7f51f80b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7f51f7e00640 1 -- 172.21.15.96:0/947470810 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f80b4de0 con 0x7f51f80cf2b0 2024-04-24T23:58:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7fc62a800640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 0x7fc62c0acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7f5767800640 1 Processor -- start 2024-04-24T23:58:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7f5767800640 1 -- start start 2024-04-24T23:58:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7fc629e00640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c06e1c0 0x7fc62c0b3ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc61800e7e0 tx=0x7fc61800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7f19aaa00640 1 --2- 172.21.15.96:0/2201946907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac15e210 0x7f19ac06cb80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009d90 tx=0x7f19a402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0e0c294a4d0b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.944+0000 7fad92000640 1 -- start start 2024-04-24T23:58:14.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7feffa000640 1 -- 172.21.15.96:0/1163651987 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8037070 con 0x7feffc15b220 2024-04-24T23:58:14.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7feffa000640 1 -- 172.21.15.96:0/1163651987 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe8032440 con 0x7feffc15b220 2024-04-24T23:58:14.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7fc622000640 1 -- 172.21.15.96:0/1508341058 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61800f040 con 0x7fc62c06e1c0 2024-04-24T23:58:14.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7feffa000640 1 -- 172.21.15.96:0/1163651987 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8037070 con 0x7feffc15b220 2024-04-24T23:58:14.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7f19a9600640 1 -- 172.21.15.96:0/2201946907 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4007740 con 0x7f19ac15e210 2024-04-24T23:58:14.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7f19a9600640 1 -- 172.21.15.96:0/2201946907 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a40078e0 con 0x7f19ac15e210 2024-04-24T23:58:14.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7f19a9600640 1 -- 172.21.15.96:0/2201946907 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4007cb0 con 0x7f19ac15e210 2024-04-24T23:58:14.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7fc622000640 1 -- 172.21.15.96:0/1508341058 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc618004030 con 0x7fc62c06e1c0 2024-04-24T23:58:14.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7fc622000640 1 -- 172.21.15.96:0/1508341058 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618004400 con 0x7fc62c06e1c0 2024-04-24T23:58:14.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62c143710 con 0x7fc62c06e1c0 2024-04-24T23:58:14.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.945+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62c143cd0 con 0x7fc62c06e1c0 2024-04-24T23:58:14.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f19b1e00640 1 -- 172.21.15.96:0/2201946907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac15e210 msgr2=0x7f19ac06cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f19b1e00640 1 --2- 172.21.15.96:0/2201946907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac15e210 0x7f19ac06cb80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009d90 tx=0x7f19a402a6d0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f19b1e00640 1 -- 172.21.15.96:0/2201946907 shutdown_connections 2024-04-24T23:58:14.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f19b1e00640 1 --2- 172.21.15.96:0/2201946907 >> v2:172.21.15.155:3300/0 conn(0x7f19ac15e5f0 0x7f19ac06d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f19b1e00640 1 --2- 172.21.15.96:0/2201946907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac15e210 0x7f19ac06cb80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f19b1e00640 1 -- 172.21.15.96:0/2201946907 >> 172.21.15.96:0/2201946907 conn(0x7f19ac08dbb0 msgr2=0x7f19ac09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:14.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f51f7e00640 1 --2- 172.21.15.96:0/947470810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f80cf2b0 0x7f51f80cf760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f51f80b6c90 tx=0x7f51f002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75292dfdf071c44 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f51f6a00640 1 -- 172.21.15.96:0/947470810 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0007740 con 0x7f51f80cf2b0 2024-04-24T23:58:14.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f51f6a00640 1 -- 172.21.15.96:0/947470810 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f00078e0 con 0x7f51f80cf2b0 2024-04-24T23:58:14.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.946+0000 7f51f6a00640 1 -- 172.21.15.96:0/947470810 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0007cb0 con 0x7f51f80cf2b0 2024-04-24T23:58:14.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62c067e40 con 0x7fc62c06e1c0 2024-04-24T23:58:14.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f3025600640 1 Processor -- start 2024-04-24T23:58:14.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f19b1e00640 1 -- 172.21.15.96:0/2201946907 shutdown_connections 2024-04-24T23:58:14.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7fad92000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad840d7c60 0x7fad840508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7fad92000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad8404d9b0 0x7fad8403dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7fad92000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad840d81f0 0x7fad8403e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7fad92000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fad840e7780 con 0x7fad840d7c60 2024-04-24T23:58:14.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7fad92000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad840e3540 con 0x7fad8404d9b0 2024-04-24T23:58:14.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7fad92000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fad840e7900 con 0x7fad840d81f0 2024-04-24T23:58:14.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f3025600640 1 -- start start 2024-04-24T23:58:14.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f5767800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f57600af2a0 0x7f5760070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f5767800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 0x7f5760071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f5767800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f57600b32f0 0x7f57600b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f5767800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f576015b2a0 con 0x7f57600af2a0 2024-04-24T23:58:14.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f5767800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5760071c30 con 0x7f57600b32f0 2024-04-24T23:58:14.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f5767800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f576015ece0 con 0x7f57600b47c0 2024-04-24T23:58:14.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7fad90c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad840d7c60 0x7fad840508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7fad90c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad840d7c60 0x7fad840508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59146/0 (socket says 172.21.15.96:59146) 2024-04-24T23:58:14.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7fad90c00640 1 -- 172.21.15.96:0/4178771006 learned_addr learned my addr 172.21.15.96:0/4178771006 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:14.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7ff002200640 1 -- 172.21.15.96:0/1163651987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc15b220 msgr2=0x7feffc15f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7ff002200640 1 --2- 172.21.15.96:0/1163651987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc15b220 0x7feffc15f380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fefe80097a0 tx=0x7fefe802a180 comp rx=0 tx=0).stop 2024-04-24T23:58:14.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7f5764e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f57600af2a0 0x7f5760070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7f5764e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f57600af2a0 0x7f5760070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59156/0 (socket says 172.21.15.96:59156) 2024-04-24T23:58:14.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7f5764e00640 1 -- 172.21.15.96:0/2196379334 learned_addr learned my addr 172.21.15.96:0/2196379334 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:14.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f575fe00640 1 --2- 172.21.15.96:0/2196379334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 0x7f5760071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f5764e00640 1 -- 172.21.15.96:0/2196379334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 msgr2=0x7f5760071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f5764e00640 1 --2- 172.21.15.96:0/2196379334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 0x7f5760071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f5764e00640 1 -- 172.21.15.96:0/2196379334 >> v2:172.21.15.155:3300/0 conn(0x7f57600b32f0 msgr2=0x7f57600b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f5764e00640 1 --2- 172.21.15.96:0/2196379334 >> v2:172.21.15.155:3300/0 conn(0x7f57600b32f0 0x7f57600b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f5764e00640 1 -- 172.21.15.96:0/2196379334 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576015ac50 con 0x7f57600af2a0 2024-04-24T23:58:14.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f19b1e00640 1 -- 172.21.15.96:0/2201946907 wait complete. 2024-04-24T23:58:14.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7fad8be00640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad8404d9b0 0x7fad8403dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f3025600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f302015cbf0 0x7f302006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f3025600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3020071500 0x7f302016c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f3025600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30200b4fe0 con 0x7f302006d0b0 2024-04-24T23:58:14.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f3025600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f302006d5c0 con 0x7f302015cbf0 2024-04-24T23:58:14.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7f3025600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f302006d8a0 con 0x7f3020071500 2024-04-24T23:58:14.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7fad90c00640 1 -- 172.21.15.96:0/4178771006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad840d81f0 msgr2=0x7fad8403e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7fad90c00640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad840d81f0 0x7fad8403e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7fad90c00640 1 -- 172.21.15.96:0/4178771006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad8404d9b0 msgr2=0x7fad8403dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7fad90c00640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad8404d9b0 0x7fad8403dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.949+0000 7fad90c00640 1 -- 172.21.15.96:0/4178771006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad840d89f0 con 0x7fad840d7c60 2024-04-24T23:58:14.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f51fd200640 1 -- 172.21.15.96:0/947470810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f80cf2b0 msgr2=0x7f51f80cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.947+0000 7f51fd200640 1 --2- 172.21.15.96:0/947470810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f80cf2b0 0x7f51f80cf760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f51f80b6c90 tx=0x7f51f002a630 comp rx=0 tx=0).stop 2024-04-24T23:58:14.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7f51fd200640 1 -- 172.21.15.96:0/947470810 shutdown_connections 2024-04-24T23:58:14.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7f51fd200640 1 --2- 172.21.15.96:0/947470810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f80cf2b0 0x7f51f80cf760 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7f51fd200640 1 --2- 172.21.15.96:0/947470810 >> v2:172.21.15.155:3300/0 conn(0x7f51f80d26f0 0x7f51f80d2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.948+0000 7f51fd200640 1 -- 172.21.15.96:0/947470810 >> 172.21.15.96:0/947470810 conn(0x7f51f808db00 msgr2=0x7f51f809d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:14.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f301ea00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f302015cbf0 0x7f302006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7ff002200640 1 -- 172.21.15.96:0/1163651987 shutdown_connections 2024-04-24T23:58:14.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7ff002200640 1 --2- 172.21.15.96:0/1163651987 >> v2:172.21.15.155:3300/0 conn(0x7feffc06d400 0x7feffc06d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7ff002200640 1 --2- 172.21.15.96:0/1163651987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc15b220 0x7feffc15f380 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7ff002200640 1 -- 172.21.15.96:0/1163651987 >> 172.21.15.96:0/1163651987 conn(0x7feffc0b19c0 msgr2=0x7feffc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:14.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f301ea00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f302015cbf0 0x7f302006cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59160/0 (socket says 172.21.15.96:59160) 2024-04-24T23:58:14.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f301ea00640 1 -- 172.21.15.96:0/3326660448 learned_addr learned my addr 172.21.15.96:0/3326660448 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7fc622000640 1 -- 172.21.15.96:0/1508341058 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc61800c6d0 con 0x7fc62c06e1c0 2024-04-24T23:58:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7ff002200640 1 -- 172.21.15.96:0/1163651987 shutdown_connections 2024-04-24T23:58:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7ff002200640 1 -- 172.21.15.96:0/1163651987 wait complete. 2024-04-24T23:58:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f51fd200640 1 -- 172.21.15.96:0/947470810 shutdown_connections 2024-04-24T23:58:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f5764e00640 1 --2- 172.21.15.96:0/2196379334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600af2a0 0x7f5760070f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f576015efc0 tx=0x7f575802c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4f7aab10c267e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.951+0000 7fad90c00640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad840d7c60 0x7fad840508e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad78007370 tx=0x7fad78007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f301ea00640 1 -- 172.21.15.96:0/3326660448 >> v2:172.21.15.155:3300/0 conn(0x7f3020071500 msgr2=0x7f302016c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f301ea00640 1 --2- 172.21.15.96:0/3326660448 >> v2:172.21.15.155:3300/0 conn(0x7f3020071500 0x7f302016c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f301ea00640 1 -- 172.21.15.96:0/3326660448 >> v1:172.21.15.155:6789/0 conn(0x7f302006d0b0 legacy=0x7f3020070df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-24T23:58:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f301ea00640 1 -- 172.21.15.96:0/3326660448 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302006db80 con 0x7f302015cbf0 2024-04-24T23:58:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.951+0000 7f301ea00640 1 --2- 172.21.15.96:0/3326660448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302015cbf0 0x7f302006cb70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f302006bfb0 tx=0x7f301802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee256737fabe248 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.952+0000 7fc622000640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc60c06bf00 0x7fc60c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.952+0000 7fc622000640 1 -- 172.21.15.96:0/1508341058 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc61808ab20 con 0x7fc62c06e1c0 2024-04-24T23:58:14.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7fc629400640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc60c06bf00 0x7fc60c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.951+0000 7f19b1e00640 1 Processor -- start 2024-04-24T23:58:14.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.951+0000 7f19b1e00640 1 -- start start 2024-04-24T23:58:14.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.952+0000 7f19b1e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac0cecc0 0x7f19ac0b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19b1e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19ac15e210 0x7f19ac15b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19b1e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19ac15e5f0 0x7f19ac2003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19b1e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac0d46f0 con 0x7f19ac0cecc0 2024-04-24T23:58:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19b1e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac0d4570 con 0x7f19ac15e210 2024-04-24T23:58:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19b1e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19ac0d4870 con 0x7f19ac15e5f0 2024-04-24T23:58:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7ff002200640 1 Processor -- start 2024-04-24T23:58:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.950+0000 7f51fd200640 1 -- 172.21.15.96:0/947470810 wait complete. 2024-04-24T23:58:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f51fd200640 1 Processor -- start 2024-04-24T23:58:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19aa000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19ac15e210 0x7f19ac15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19aa000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19ac15e210 0x7f19ac15b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:46154/0 (socket says 172.21.15.96:46154) 2024-04-24T23:58:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19aa000640 1 -- 172.21.15.96:0/3835431635 learned_addr learned my addr 172.21.15.96:0/3835431635 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19ab400640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19ac15e5f0 0x7f19ac2003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7f19aaa00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac0cecc0 0x7f19ac0b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.953+0000 7ff002200640 1 -- start start 2024-04-24T23:58:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.954+0000 7fc629400640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc60c06bf00 0x7fc60c06e3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc61c034000 tx=0x7fc61c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.954+0000 7f19aaa00640 1 -- 172.21.15.96:0/3835431635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19ac15e5f0 msgr2=0x7f19ac2003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.954+0000 7f19aaa00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19ac15e5f0 0x7f19ac2003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.954+0000 7f19aaa00640 1 -- 172.21.15.96:0/3835431635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19ac15e210 msgr2=0x7f19ac15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.954+0000 7f19aaa00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19ac15e210 0x7f19ac15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.954+0000 7f19aaa00640 1 -- 172.21.15.96:0/3835431635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac15bb00 con 0x7f19ac0cecc0 2024-04-24T23:58:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.954+0000 7f51fd200640 1 -- start start 2024-04-24T23:58:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.954+0000 7f19aaa00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac0cecc0 0x7f19ac0b9c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19a4031000 tx=0x7f19a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.955+0000 7ff002200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feffc06d400 0x7feffc13eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.955+0000 7ff002200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc070df0 0x7feffc0c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.955+0000 7ff002200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feffc15b220 0x7feffc15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.955+0000 7feffb400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feffc06d400 0x7feffc13eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51fd200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f80cf2b0 0x7f51f814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51fd200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51f80d26f0 0x7f51f80cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51fd200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f8161880 0x7f51f81f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51fd200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f51f80d1f10 con 0x7f51f8161880 2024-04-24T23:58:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51fd200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8161c60 con 0x7f51f80cf2b0 2024-04-24T23:58:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51fd200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f51f80b4490 con 0x7f51f80d26f0 2024-04-24T23:58:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7ff002200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7feffc06ed10 con 0x7feffc15b220 2024-04-24T23:58:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7ff002200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feffc06eb90 con 0x7feffc06d400 2024-04-24T23:58:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7ff002200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feffc15f8c0 con 0x7feffc070df0 2024-04-24T23:58:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7feffb400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feffc06d400 0x7feffc13eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:46170/0 (socket says 172.21.15.96:46170) 2024-04-24T23:58:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7feffb400640 1 -- 172.21.15.96:0/2252313004 learned_addr learned my addr 172.21.15.96:0/2252313004 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7feffaa00640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc070df0 0x7feffc0c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f19a3400640 1 -- 172.21.15.96:0/3835431635 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4040070 con 0x7f19ac0cecc0 2024-04-24T23:58:14.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7fad88c00640 1 -- 172.21.15.96:0/4178771006 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7801a070 con 0x7fad840d7c60 2024-04-24T23:58:14.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7fad88c00640 1 -- 172.21.15.96:0/4178771006 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7800f950 con 0x7fad840d7c60 2024-04-24T23:58:14.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7fad88c00640 1 -- 172.21.15.96:0/4178771006 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7800fd40 con 0x7fad840d7c60 2024-04-24T23:58:14.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7fc622000640 1 -- 172.21.15.96:0/1508341058 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc618017020 con 0x7fc62c06e1c0 2024-04-24T23:58:14.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51f7400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f80cf2b0 0x7f51f814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51f7400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f80cf2b0 0x7f51f814ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:46186/0 (socket says 172.21.15.96:46186) 2024-04-24T23:58:14.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51f7400640 1 -- 172.21.15.96:0/1798667715 learned_addr learned my addr 172.21.15.96:0/1798667715 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:14.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51f7e00640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f8161880 0x7f51f81f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f19a3400640 1 -- 172.21.15.96:0/3835431635 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a4031d50 con 0x7f19ac0cecc0 2024-04-24T23:58:14.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f19a3400640 1 -- 172.21.15.96:0/3835431635 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a403c660 con 0x7f19ac0cecc0 2024-04-24T23:58:14.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f51efe00640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51f80d26f0 0x7f51f80cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f575f400640 1 -- 172.21.15.96:0/2196379334 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758039070 con 0x7f57600af2a0 2024-04-24T23:58:14.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f575f400640 1 -- 172.21.15.96:0/2196379334 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575800b2e0 con 0x7f57600af2a0 2024-04-24T23:58:14.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f575f400640 1 -- 172.21.15.96:0/2196379334 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758009820 con 0x7f57600af2a0 2024-04-24T23:58:14.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f301d600640 1 -- 172.21.15.96:0/3326660448 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018036070 con 0x7f302015cbf0 2024-04-24T23:58:14.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f301d600640 1 -- 172.21.15.96:0/3326660448 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3018031600 con 0x7f302015cbf0 2024-04-24T23:58:14.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f301d600640 1 -- 172.21.15.96:0/3326660448 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30180319b0 con 0x7f302015cbf0 2024-04-24T23:58:14.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7feffbe00640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feffc15b220 0x7feffc15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:14.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7feffb400640 1 -- 172.21.15.96:0/2252313004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc070df0 msgr2=0x7feffc0c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7feffb400640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc070df0 0x7feffc0c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7feffb400640 1 -- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feffc15b220 msgr2=0x7feffc15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7f51f7e00640 1 -- 172.21.15.96:0/1798667715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51f80d26f0 msgr2=0x7f51f80cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7f51f7e00640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51f80d26f0 0x7f51f80cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7f51f7e00640 1 -- 172.21.15.96:0/1798667715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f80cf2b0 msgr2=0x7f51f814ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7f51f7e00640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f80cf2b0 0x7f51f814ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7f51f7e00640 1 -- 172.21.15.96:0/1798667715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f80cdbc0 con 0x7f51f8161880 2024-04-24T23:58:14.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7f3025600640 1 -- 172.21.15.96:0/3326660448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302015cbf0 msgr2=0x7f302006cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7f3025600640 1 --2- 172.21.15.96:0/3326660448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302015cbf0 0x7f302006cb70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f302006bfb0 tx=0x7f301802a710 comp rx=0 tx=0).stop 2024-04-24T23:58:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f5767800640 1 -- 172.21.15.96:0/2196379334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600af2a0 msgr2=0x7f5760070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f5767800640 1 --2- 172.21.15.96:0/2196379334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600af2a0 0x7f5760070f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f576015efc0 tx=0x7f575802c820 comp rx=0 tx=0).stop 2024-04-24T23:58:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f3025600640 1 -- 172.21.15.96:0/3326660448 shutdown_connections 2024-04-24T23:58:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f3025600640 1 --2- 172.21.15.96:0/3326660448 >> v2:172.21.15.155:3300/0 conn(0x7f3020071500 0x7f302016c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f3025600640 1 --2- 172.21.15.96:0/3326660448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302015cbf0 0x7f302006cb70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f3025600640 1 -- 172.21.15.96:0/3326660448 >> 172.21.15.96:0/3326660448 conn(0x7f30200b19c0 msgr2=0x7f30200b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:14.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f51f7e00640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f8161880 0x7f51f81f7100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f51f0031000 tx=0x7f51f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:14.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f3025600640 1 -- 172.21.15.96:0/3326660448 shutdown_connections 2024-04-24T23:58:14.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f3025600640 1 -- 172.21.15.96:0/3326660448 wait complete. 2024-04-24T23:58:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f5767800640 1 -- 172.21.15.96:0/2196379334 shutdown_connections 2024-04-24T23:58:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f5767800640 1 --2- 172.21.15.96:0/2196379334 >> v2:172.21.15.155:3300/0 conn(0x7f57600b32f0 0x7f57600b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f5767800640 1 --2- 172.21.15.96:0/2196379334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 0x7f5760071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f5767800640 1 --2- 172.21.15.96:0/2196379334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600af2a0 0x7f5760070f40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f5767800640 1 -- 172.21.15.96:0/2196379334 >> 172.21.15.96:0/2196379334 conn(0x7f57600b19c0 msgr2=0x7f57600b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7feffb400640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feffc15b220 0x7feffc15dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7feffb400640 1 -- 172.21.15.96:0/2252313004 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc1f9b80 con 0x7feffc06d400 2024-04-24T23:58:14.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7feffbe00640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feffc15b220 0x7feffc15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:14.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad84050f70 con 0x7fad840d7c60 2024-04-24T23:58:14.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad84051530 con 0x7fad840d7c60 2024-04-24T23:58:14.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.956+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ac15bde0 con 0x7f19ac0cecc0 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7feffb400640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feffc06d400 0x7feffc13eb10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefec00c4d0 tx=0x7fefec00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.960+0000 7feff3400640 1 -- 172.21.15.96:0/2252313004 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec018070 con 0x7feffc06d400 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.960+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feffc1f9e60 con 0x7feffc06d400 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.960+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feffc1fa420 con 0x7feffc06d400 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.960+0000 7feff3400640 1 -- 172.21.15.96:0/2252313004 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefec007500 con 0x7feffc06d400 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.960+0000 7feff3400640 1 -- 172.21.15.96:0/2252313004 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec004a20 con 0x7feffc06d400 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7f51ef400640 1 -- 172.21.15.96:0/1798667715 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0040070 con 0x7f51f8161880 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7f51ef400640 1 -- 172.21.15.96:0/1798667715 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f0031bc0 con 0x7f51f8161880 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7f51ef400640 1 -- 172.21.15.96:0/1798667715 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0040070 con 0x7f51f8161880 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f80cdea0 con 0x7f51f8161880 2024-04-24T23:58:15.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f80c9110 con 0x7f51f8161880 2024-04-24T23:58:15.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.960+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f80756b0 con 0x7f51f8161880 2024-04-24T23:58:15.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7f5767800640 1 -- 172.21.15.96:0/2196379334 shutdown_connections 2024-04-24T23:58:15.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.959+0000 7f5767800640 1 -- 172.21.15.96:0/2196379334 wait complete. 2024-04-24T23:58:15.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.957+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ac15c3a0 con 0x7f19ac0cecc0 2024-04-24T23:58:15.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.961+0000 7f3025600640 1 Processor -- start 2024-04-24T23:58:15.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.958+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac0ce610 con 0x7f19ac0cecc0 2024-04-24T23:58:15.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.961+0000 7f3025600640 1 -- start start 2024-04-24T23:58:15.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.962+0000 7f5767800640 1 Processor -- start 2024-04-24T23:58:15.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.962+0000 7f5767800640 1 -- start start 2024-04-24T23:58:15.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.962+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad84005390 con 0x7fad840d7c60 2024-04-24T23:58:15.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.961+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd4005290 con 0x7feffc06d400 2024-04-24T23:58:15.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.963+0000 7f3025600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302006d0b0 0x7f302015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.963+0000 7f3025600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3020071500 0x7f30200cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.963+0000 7f3025600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f302015cbf0 0x7f302009c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.964+0000 7f3025600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f302015cfd0 con 0x7f302006d0b0 2024-04-24T23:58:15.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.964+0000 7f3025600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f302006e660 con 0x7f302015cbf0 2024-04-24T23:58:15.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.964+0000 7f3025600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3020162e30 con 0x7f3020071500 2024-04-24T23:58:15.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.964+0000 7f301f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f302015cbf0 0x7f302009c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.964+0000 7f5767800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57600af2a0 0x7f57601577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.964+0000 7f301f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f302015cbf0 0x7f302009c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:46194/0 (socket says 172.21.15.96:46194) 2024-04-24T23:58:15.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.964+0000 7f301f400640 1 -- 172.21.15.96:0/3387117971 learned_addr learned my addr 172.21.15.96:0/3387117971 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:15.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.964+0000 7f301e000640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3020071500 0x7f30200cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.964+0000 7f5767800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600b32f0 0x7f57601537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f5767800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 0x7f5760145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7feff3400640 1 -- 172.21.15.96:0/2252313004 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefec01b070 con 0x7feffc06d400 2024-04-24T23:58:15.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f5764e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57600af2a0 0x7f57601577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f5764e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57600af2a0 0x7f57601577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:46202/0 (socket says 172.21.15.96:46202) 2024-04-24T23:58:15.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f5767800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f576015a900 con 0x7f57600b32f0 2024-04-24T23:58:15.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f5764e00640 1 -- 172.21.15.96:0/2185975055 learned_addr learned my addr 172.21.15.96:0/2185975055 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:15.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57600af680 con 0x7f57600af2a0 2024-04-24T23:58:15.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57600cf990 con 0x7f57600b47c0 2024-04-24T23:58:15.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f575fe00640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600b32f0 0x7f57601537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f5765800640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 0x7f5760145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.965+0000 7f301f400640 1 -- 172.21.15.96:0/3387117971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3020071500 msgr2=0x7f30200cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f301ea00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302006d0b0 0x7f302015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f301f400640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3020071500 0x7f30200cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f301f400640 1 -- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302006d0b0 msgr2=0x7f302015bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f301f400640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302006d0b0 0x7f302015bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f5764e00640 1 -- 172.21.15.96:0/2185975055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 msgr2=0x7f5760145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f5764e00640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 0x7f5760145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f5764e00640 1 -- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600b32f0 msgr2=0x7f57601537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f5764e00640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600b32f0 0x7f57601537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f301f400640 1 -- 172.21.15.96:0/3387117971 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30201505e0 con 0x7f302015cbf0 2024-04-24T23:58:15.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f5764e00640 1 -- 172.21.15.96:0/2185975055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57600acf40 con 0x7f57600af2a0 2024-04-24T23:58:15.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f5765800640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 0x7f5760145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:15.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f301ea00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302006d0b0 0x7f302015bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:15.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7f575fe00640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600b32f0 0x7f57601537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:15.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.967+0000 7f51ef400640 1 -- 172.21.15.96:0/1798667715 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f51f0039040 con 0x7f51f8161880 2024-04-24T23:58:15.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.967+0000 7f5764e00640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57600af2a0 0x7f57601577c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f575802ce10 tx=0x7f5758004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.967+0000 7feff3400640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefdc06be30 0x7fefdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.967+0000 7feff3400640 1 -- 172.21.15.96:0/2252313004 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fefec08a670 con 0x7feffc06d400 2024-04-24T23:58:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.966+0000 7fad88c00640 1 -- 172.21.15.96:0/4178771006 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad7801d070 con 0x7fad840d7c60 2024-04-24T23:58:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.968+0000 7fad88c00640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad6c06be80 0x7fad6c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.968+0000 7fad88c00640 1 -- 172.21.15.96:0/4178771006 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fad78056c30 con 0x7fad840d7c60 2024-04-24T23:58:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.968+0000 7f51ef400640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f51d406c230 0x7f51d406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.968+0000 7fad8be00640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad6c06be80 0x7fad6c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.968+0000 7f51ef400640 1 -- 172.21.15.96:0/1798667715 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f51f00319c0 con 0x7f51f8161880 2024-04-24T23:58:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.969+0000 7feffaa00640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefdc06be30 0x7fefdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.969+0000 7f51f7400640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f51d406c230 0x7f51d406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.970+0000 7f51f7400640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f51d406c230 0x7f51d406e6f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001220 tx=0x7f51e80011b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.971+0000 7feffaa00640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefdc06be30 0x7fefdc06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fefe8034000 tx=0x7fefe802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.971+0000 7fad8be00640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad6c06be80 0x7fad6c06e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fad80032000 tx=0x7fad80009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.968+0000 7f19a3400640 1 -- 172.21.15.96:0/3835431635 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19a4039040 con 0x7f19ac0cecc0 2024-04-24T23:58:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.969+0000 7f19a3400640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f198c06be30 0x7f198c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.969+0000 7f19aa000640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f198c06be30 0x7f198c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.970+0000 7f19aa000640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f198c06be30 0x7f198c06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f19ac15cfe0 tx=0x7f1998009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.971+0000 7f301f400640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f302015cbf0 0x7f302009c3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f300c00b410 tx=0x7f300c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.977+0000 7f51ef400640 1 -- 172.21.15.96:0/1798667715 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f51f0054080 con 0x7f51f8161880 2024-04-24T23:58:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.977+0000 7f19a3400640 1 -- 172.21.15.96:0/3835431635 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f19a40789c0 con 0x7f19ac0cecc0 2024-04-24T23:58:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.979+0000 7feff3400640 1 -- 172.21.15.96:0/2252313004 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fefec059090 con 0x7feffc06d400 2024-04-24T23:58:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.978+0000 7f575cc00640 1 -- 172.21.15.96:0/2185975055 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758039040 con 0x7f57600af2a0 2024-04-24T23:58:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.978+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57600ad220 con 0x7f57600af2a0 2024-04-24T23:58:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.978+0000 7f575cc00640 1 -- 172.21.15.96:0/2185975055 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758044070 con 0x7f57600af2a0 2024-04-24T23:58:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.978+0000 7f575cc00640 1 -- 172.21.15.96:0/2185975055 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758035c30 con 0x7f57600af2a0 2024-04-24T23:58:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.978+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57600ad7e0 con 0x7f57600af2a0 2024-04-24T23:58:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.978+0000 7f3016a00640 1 -- 172.21.15.96:0/3387117971 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c015020 con 0x7f302015cbf0 2024-04-24T23:58:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.978+0000 7f3025600640 1 -- 172.21.15.96:0/3387117971 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30200cf490 con 0x7f302015cbf0 2024-04-24T23:58:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.978+0000 7f3025600640 1 -- 172.21.15.96:0/3387117971 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30200cfd30 con 0x7f302015cbf0 2024-04-24T23:58:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.978+0000 7f3016a00640 1 -- 172.21.15.96:0/3387117971 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c011830 con 0x7f302015cbf0 2024-04-24T23:58:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.980+0000 7f3016a00640 1 -- 172.21.15.96:0/3387117971 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c011be0 con 0x7f302015cbf0 2024-04-24T23:58:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.980+0000 7f300be00640 1 -- 172.21.15.96:0/3387117971 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3020069110 con 0x7f302015cbf0 2024-04-24T23:58:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.982+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5760069110 con 0x7f57600af2a0 2024-04-24T23:58:15.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.982+0000 7f3016a00640 1 -- 172.21.15.96:0/3387117971 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f300c018020 con 0x7f302015cbf0 2024-04-24T23:58:15.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.983+0000 7f575cc00640 1 -- 172.21.15.96:0/2185975055 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f575800b2e0 con 0x7f57600af2a0 2024-04-24T23:58:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.983+0000 7f3016a00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f300006be30 0x7f300006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.984+0000 7f301ea00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f300006be30 0x7f300006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.984+0000 7f3016a00640 1 -- 172.21.15.96:0/3387117971 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f300c057020 con 0x7f302015cbf0 2024-04-24T23:58:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.984+0000 7f575cc00640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f574006be30 0x7f574006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.985+0000 7f575cc00640 1 -- 172.21.15.96:0/2185975055 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f57580abba0 con 0x7f57600af2a0 2024-04-24T23:58:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.985+0000 7f575fe00640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f574006be30 0x7f574006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.986+0000 7f575fe00640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f574006be30 0x7f574006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5760151a30 tx=0x7f5750008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.987+0000 7f301ea00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f300006be30 0x7f300006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3018033000 tx=0x7f3018009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.988+0000 7fad88c00640 1 -- 172.21.15.96:0/4178771006 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fad78059290 con 0x7fad840d7c60 2024-04-24T23:58:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.996+0000 7f19a3400640 1 -- 172.21.15.96:0/3835431635 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f19a407a920 con 0x7f19ac0cecc0 2024-04-24T23:58:15.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:14.999+0000 7f575cc00640 1 -- 172.21.15.96:0/2185975055 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f575807a540 con 0x7f57600af2a0 2024-04-24T23:58:15.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.013+0000 7f3016a00640 1 -- 172.21.15.96:0/3387117971 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f300c01f020 con 0x7f302015cbf0 2024-04-24T23:58:15.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.319+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0a98057d70 con 0x7f0a980e3160 2024-04-24T23:58:15.320 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:15.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.320+0000 7f0a8fe00640 1 -- 172.21.15.96:0/1779072782 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a9000f300 con 0x7f0a980e3160 2024-04-24T23:58:15.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.324+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0a8406be30 msgr2=0x7f0a8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.324+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0a8406be30 0x7f0a8406e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0050090 tx=0x7f0aa007ab20 comp rx=0 tx=0).stop 2024-04-24T23:58:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.325+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a980e3160 msgr2=0x7f0a98185e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.325+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a980e3160 0x7f0a98185e30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000d530 tx=0x7f0a9000d9f0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.325+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 shutdown_connections 2024-04-24T23:58:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.325+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0a8406be30 0x7f0a8406e2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.325+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a980e3160 0x7f0a98185e30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.325+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98053cb0 0x7f0a981858f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.325+0000 7f0aa6a00640 1 --2- 172.21.15.96:0/1779072782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a9803c0a0 0x7f0a980e40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.325+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 >> 172.21.15.96:0/1779072782 conn(0x7f0a98058ee0 msgr2=0x7f0a980e6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.326+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 shutdown_connections 2024-04-24T23:58:15.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.326+0000 7f0aa6a00640 1 -- 172.21.15.96:0/1779072782 wait complete. 2024-04-24T23:58:15.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-24T23:58:15.352 DEBUG:teuthology.parallel:result is None 2024-04-24T23:58:15.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.383+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f576006ec70 con 0x7f57600af2a0 2024-04-24T23:58:15.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.383+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc62c0756b0 con 0x7fc62c06e1c0 2024-04-24T23:58:15.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.384+0000 7fc622000640 1 -- 172.21.15.96:0/1508341058 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc618058ef0 con 0x7fc62c06e1c0 2024-04-24T23:58:15.384 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:15.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.384+0000 7f575cc00640 1 -- 172.21.15.96:0/2185975055 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5758079e40 con 0x7f57600af2a0 2024-04-24T23:58:15.384 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-24T23:58:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.386+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f574006be30 msgr2=0x7f574006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.386+0000 7f5767800640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f574006be30 0x7f574006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5760151a30 tx=0x7f5750008040 comp rx=0 tx=0).stop 2024-04-24T23:58:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.386+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57600af2a0 msgr2=0x7f57601577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.386+0000 7f5767800640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57600af2a0 0x7f57601577c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f575802ce10 tx=0x7f5758004a40 comp rx=0 tx=0).stop 2024-04-24T23:58:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 shutdown_connections 2024-04-24T23:58:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7f5767800640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57600b47c0 0x7f5760145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7f5767800640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f574006be30 0x7f574006e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7f5767800640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57600b32f0 0x7f57601537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7f5767800640 1 --2- 172.21.15.96:0/2185975055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57600af2a0 0x7f57601577c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 >> 172.21.15.96:0/2185975055 conn(0x7f57600b19c0 msgr2=0x7f5760070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc60c06bf00 msgr2=0x7fc60c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc60c06bf00 0x7fc60c06e3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc61c034000 tx=0x7fc61c02e000 comp rx=0 tx=0).stop 2024-04-24T23:58:15.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 shutdown_connections 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c06e1c0 msgr2=0x7fc62c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c06e1c0 0x7fc62c0b3ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc61800e7e0 tx=0x7fc61800eca0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 shutdown_connections 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc62c0cf3c0 0x7fc62c0acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc62c06e5a0 0x7fc62c0b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc60c06bf00 0x7fc60c06e3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 --2- 172.21.15.96:0/1508341058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c06e1c0 0x7fc62c0b3ab0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.387+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 >> 172.21.15.96:0/1508341058 conn(0x7fc62c0b1f10 msgr2=0x7fc62c0cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.388+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 shutdown_connections 2024-04-24T23:58:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.388+0000 7fc62b200640 1 -- 172.21.15.96:0/1508341058 wait complete. 2024-04-24T23:58:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.388+0000 7f5767800640 1 -- 172.21.15.96:0/2185975055 wait complete. 2024-04-24T23:58:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.390+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fefd4005850 con 0x7feffc06d400 2024-04-24T23:58:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.391+0000 7feff3400640 1 -- 172.21.15.96:0/2252313004 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fefec058990 con 0x7feffc06d400 2024-04-24T23:58:15.391 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefdc06be30 msgr2=0x7fefdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefdc06be30 0x7fefdc06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fefe8034000 tx=0x7fefe802e000 comp rx=0 tx=0).stop 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feffc06d400 msgr2=0x7feffc13eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feffc06d400 0x7feffc13eb10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefec00c4d0 tx=0x7fefec00c990 comp rx=0 tx=0).stop 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 shutdown_connections 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefdc06be30 0x7fefdc06e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feffc15b220 0x7feffc15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feffc070df0 0x7feffc0c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 --2- 172.21.15.96:0/2252313004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feffc06d400 0x7feffc13eb10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.394+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 >> 172.21.15.96:0/2252313004 conn(0x7feffc0b19c0 msgr2=0x7feffc0713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.395+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 shutdown_connections 2024-04-24T23:58:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.395+0000 7ff002200640 1 -- 172.21.15.96:0/2252313004 wait complete. 2024-04-24T23:58:15.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.406+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f51f815ec50 con 0x7f51f8161880 2024-04-24T23:58:15.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.407+0000 7f51ef400640 1 -- 172.21.15.96:0/1798667715 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51f007a7a0 con 0x7f51f8161880 2024-04-24T23:58:15.407 INFO:teuthology.orchestra.run.smithi096.stdout:55834574856 2024-04-24T23:58:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f51d406c230 msgr2=0x7f51d406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f51d406c230 0x7f51d406e6f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001220 tx=0x7f51e80011b0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f8161880 msgr2=0x7f51f81f7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f8161880 0x7f51f81f7100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f51f0031000 tx=0x7f51f0004a40 comp rx=0 tx=0).stop 2024-04-24T23:58:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 shutdown_connections 2024-04-24T23:58:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f51d406c230 0x7f51d406e6f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f8161880 0x7f51f81f7100 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51f80d26f0 0x7f51f80cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 --2- 172.21.15.96:0/1798667715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f80cf2b0 0x7f51f814ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.411+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 >> 172.21.15.96:0/1798667715 conn(0x7f51f808db00 msgr2=0x7f51f80cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.412+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 shutdown_connections 2024-04-24T23:58:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.412+0000 7f51fd200640 1 -- 172.21.15.96:0/1798667715 wait complete. 2024-04-24T23:58:15.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-04-24T23:58:15.413 DEBUG:teuthology.parallel:result is None 2024-04-24T23:58:15.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.414+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f19ac069110 con 0x7f19ac0cecc0 2024-04-24T23:58:15.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.414+0000 7f19a3400640 1 -- 172.21.15.96:0/3835431635 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19a407ec20 con 0x7f19ac0cecc0 2024-04-24T23:58:15.414 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:15.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-04-24T23:58:15.417 DEBUG:teuthology.parallel:result is None 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.417+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f198c06be30 msgr2=0x7f198c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.417+0000 7f19b1e00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f198c06be30 0x7f198c06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f19ac15cfe0 tx=0x7f1998009190 comp rx=0 tx=0).stop 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.417+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac0cecc0 msgr2=0x7f19ac0b9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.417+0000 7f19b1e00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac0cecc0 0x7f19ac0b9c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19a4031000 tx=0x7f19a4004a40 comp rx=0 tx=0).stop 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.418+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 shutdown_connections 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.418+0000 7f19b1e00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19ac15e5f0 0x7f19ac2003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.418+0000 7f19b1e00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19ac15e210 0x7f19ac15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.418+0000 7f19b1e00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f198c06be30 0x7f198c06e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.418+0000 7f19b1e00640 1 --2- 172.21.15.96:0/3835431635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ac0cecc0 0x7f19ac0b9c80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.418+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 >> 172.21.15.96:0/3835431635 conn(0x7f19ac08dbb0 msgr2=0x7f19ac0b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.418+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 shutdown_connections 2024-04-24T23:58:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.418+0000 7f19b1e00640 1 -- 172.21.15.96:0/3835431635 wait complete. 2024-04-24T23:58:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.419+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fad84056bf0 con 0x7fad840d7c60 2024-04-24T23:58:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.420+0000 7fad88c00640 1 -- 172.21.15.96:0/4178771006 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad78058b90 con 0x7fad840d7c60 2024-04-24T23:58:15.420 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-04-24T23:58:15.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-24T23:58:15.421 DEBUG:teuthology.parallel:result is None 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.422+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad6c06be80 msgr2=0x7fad6c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.422+0000 7fad92000640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad6c06be80 0x7fad6c06e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fad80032000 tx=0x7fad80009030 comp rx=0 tx=0).stop 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.422+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad840d7c60 msgr2=0x7fad840508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.422+0000 7fad92000640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad840d7c60 0x7fad840508e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad78007370 tx=0x7fad78007830 comp rx=0 tx=0).stop 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.422+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 shutdown_connections 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.422+0000 7fad92000640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad840d81f0 0x7fad8403e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.422+0000 7fad92000640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad8404d9b0 0x7fad8403dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.423+0000 7fad92000640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad6c06be80 0x7fad6c06e340 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.423+0000 7fad92000640 1 --2- 172.21.15.96:0/4178771006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad840d7c60 0x7fad840508e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.423+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 >> 172.21.15.96:0/4178771006 conn(0x7fad84058ee0 msgr2=0x7fad840e03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.423+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 shutdown_connections 2024-04-24T23:58:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.423+0000 7fad92000640 1 -- 172.21.15.96:0/4178771006 wait complete. 2024-04-24T23:58:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.430+0000 7f300be00640 1 -- 172.21.15.96:0/3387117971 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f30200b3840 con 0x7f302015cbf0 2024-04-24T23:58:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.431+0000 7f3016a00640 1 -- 172.21.15.96:0/3387117971 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f300c018310 con 0x7f302015cbf0 2024-04-24T23:58:15.431 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.433+0000 7f300be00640 1 -- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f300006be30 msgr2=0x7f300006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.433+0000 7f300be00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f300006be30 0x7f300006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3018033000 tx=0x7f3018009000 comp rx=0 tx=0).stop 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.433+0000 7f300be00640 1 -- 172.21.15.96:0/3387117971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f302015cbf0 msgr2=0x7f302009c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.433+0000 7f300be00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f302015cbf0 0x7f302009c3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f300c00b410 tx=0x7f300c009f90 comp rx=0 tx=0).stop 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.433+0000 7f300be00640 1 -- 172.21.15.96:0/3387117971 shutdown_connections 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.434+0000 7f300be00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f302015cbf0 0x7f302009c3e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.434+0000 7f300be00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3020071500 0x7f30200cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.434+0000 7f300be00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f300006be30 0x7f300006e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.434+0000 7f300be00640 1 --2- 172.21.15.96:0/3387117971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f302006d0b0 0x7f302015bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.434+0000 7f300be00640 1 -- 172.21.15.96:0/3387117971 >> 172.21.15.96:0/3387117971 conn(0x7f30200b19c0 msgr2=0x7f30200b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.434+0000 7f300be00640 1 -- 172.21.15.96:0/3387117971 shutdown_connections 2024-04-24T23:58:15.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.434+0000 7f300be00640 1 -- 172.21.15.96:0/3387117971 wait complete. 2024-04-24T23:58:15.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-04-24T23:58:15.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-04-24T23:58:15.440 DEBUG:teuthology.parallel:result is None 2024-04-24T23:58:15.440 DEBUG:teuthology.parallel:result is None 2024-04-24T23:58:15.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-24T23:58:15.443 DEBUG:teuthology.parallel:result is None 2024-04-24T23:58:15.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-04-24T23:58:15.451 DEBUG:teuthology.parallel:result is None 2024-04-24T23:58:15.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T23:58:15.451 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:58:15.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.684+0000 7ff6fb200640 1 Processor -- start 2024-04-24T23:58:15.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.684+0000 7ff6fb200640 1 -- start start 2024-04-24T23:58:15.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.685+0000 7ff6fb200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff6fc15a660 0x7ff6fc070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6fb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc15b8f0 0x7ff6fc0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6fb200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6fc06e900 con 0x7ff6fc0ce110 2024-04-24T23:58:15.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6fb200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff6fc0ce560 con 0x7ff6fc15a660 2024-04-24T23:58:15.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6fb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6fc15b460 con 0x7ff6fc15b8f0 2024-04-24T23:58:15.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6fa800640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff6fc0ce110 0x7ff6fc06cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51044/0 (socket says 172.21.15.96:51044) 2024-04-24T23:58:15.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6fa800640 1 -- 172.21.15.96:0/3252933892 learned_addr learned my addr 172.21.15.96:0/3252933892 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:15.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6f9e00640 1 --2- 172.21.15.96:0/3252933892 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc15a660 0x7ff6fc070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6f1400640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc15b8f0 0x7ff6fc0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602838382 0 0) 0x7ff6fc06e900 con 0x7ff6fc0ce110 2024-04-24T23:58:15.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.686+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6e0003520 con 0x7ff6fc0ce110 2024-04-24T23:58:15.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3566159218 0 0) 0x7ff6e0003520 con 0x7ff6fc0ce110 2024-04-24T23:58:15.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc15b8f0 msgr2=0x7ff6fc0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:15.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc15b8f0 0x7ff6fc0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc15a660 msgr2=0x7ff6fc070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 --2- 172.21.15.96:0/3252933892 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc15a660 0x7ff6fc070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc15ae10 con 0x7ff6fc0ce110 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7ff6f40019f0 con 0x7ff6fc0ce110 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 >> v1:172.21.15.96:6789/0 conn(0x7ff6fc0ce110 legacy=0x7ff6fc06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e00039b0 0x7ff6e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e0004800 0x7ff6e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc15b8f0 0x7ff6e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc0ce560 con 0x7ff6e00039b0 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc15b460 con 0x7ff6e0004800 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e000baa0 con 0x7ff6fc15b8f0 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9e00640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e00039b0 0x7ff6e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f1400640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e0004800 0x7ff6e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9e00640 1 -- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc15b8f0 msgr2=0x7ff6e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9e00640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc15b8f0 0x7ff6e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9e00640 1 -- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e0004800 msgr2=0x7ff6e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9e00640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e0004800 0x7ff6e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f9e00640 1 -- 172.21.15.96:0/3252933892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e0003520 con 0x7ff6e00039b0 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.687+0000 7ff6f1400640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e0004800 0x7ff6e0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.688+0000 7ff6f9e00640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e00039b0 0x7ff6e0003dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00b5c0 tx=0x7ff6e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31774f89da3151ee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.688+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec03a070 con 0x7ff6e00039b0 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.689+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ec035410 con 0x7ff6e00039b0 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.689+0000 7ff6f9400640 1 -- 172.21.15.96:0/3252933892 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00b600 con 0x7ff6e00039b0 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.689+0000 7ff6fb200640 1 -- 172.21.15.96:0/3252933892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e00039b0 msgr2=0x7ff6e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.689+0000 7ff6fb200640 1 --2- 172.21.15.96:0/3252933892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e00039b0 0x7ff6e0003dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00b5c0 tx=0x7ff6e0005830 comp rx=0 tx=0).stop 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.689+0000 7ff6fa800640 1 -- 172.21.15.96:0/3252933892 reap_dead start 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.689+0000 7ff6fb200640 1 -- 172.21.15.96:0/3252933892 shutdown_connections 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.689+0000 7ff6fb200640 1 -- 172.21.15.96:0/3252933892 >> 172.21.15.96:0/3252933892 conn(0x7ff6fc0b1f10 msgr2=0x7ff6fc0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.689+0000 7ff6fb200640 1 -- 172.21.15.96:0/3252933892 shutdown_connections 2024-04-24T23:58:15.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.689+0000 7ff6fb200640 1 -- 172.21.15.96:0/3252933892 wait complete. 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.691+0000 7ff6fb200640 1 Processor -- start 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.691+0000 7ff6fb200640 1 -- start start 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6fb200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e00039b0 0x7ff6fc1f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6fb200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6fc1f4ba0 0x7ff6fc158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6fb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0ad6e0 0x7ff6fc0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6fb200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc06e560 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6fb200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc06ebe0 con 0x7ff6e00039b0 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6fb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6fc06e6e0 con 0x7ff6fc0ad6e0 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6f1400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6fc1f4ba0 0x7ff6fc158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6f1400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6fc1f4ba0 0x7ff6fc158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59226/0 (socket says 172.21.15.96:59226) 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6f1400640 1 -- 172.21.15.96:0/975211556 learned_addr learned my addr 172.21.15.96:0/975211556 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6f9e00640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e00039b0 0x7ff6fc1f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6fa800640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0ad6e0 0x7ff6fc0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6f1400640 1 -- 172.21.15.96:0/975211556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0ad6e0 msgr2=0x7ff6fc0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6f1400640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0ad6e0 0x7ff6fc0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6f1400640 1 -- 172.21.15.96:0/975211556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e00039b0 msgr2=0x7ff6fc1f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6f1400640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e00039b0 0x7ff6fc1f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6f1400640 1 -- 172.21.15.96:0/975211556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc0cd510 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.692+0000 7ff6fa800640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0ad6e0 0x7ff6fc0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.693+0000 7ff6f1400640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6fc1f4ba0 0x7ff6fc158870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400ec80 tx=0x7ff6e400c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.693+0000 7ff6f2a00640 1 -- 172.21.15.96:0/975211556 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4017070 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.693+0000 7ff6f2a00640 1 -- 172.21.15.96:0/975211556 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e400ce70 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.693+0000 7ff6f2a00640 1 -- 172.21.15.96:0/975211556 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400b040 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.693+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc0c96c0 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.693+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc0cb400 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.694+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6fc067e40 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.695+0000 7ff6f2a00640 1 -- 172.21.15.96:0/975211556 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6e401a070 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.696+0000 7ff6f2a00640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff6d806be30 0x7ff6d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.696+0000 7ff6f2a00640 1 -- 172.21.15.96:0/975211556 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff6e408af80 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.696+0000 7ff6f9e00640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff6d806be30 0x7ff6d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:15.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.697+0000 7ff6f9e00640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff6d806be30 0x7ff6d806e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00057e0 tx=0x7ff6ec030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:15.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.700+0000 7ff6f2a00640 1 -- 172.21.15.96:0/975211556 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff6e4059800 con 0x7ff6fc1f4ba0 2024-04-24T23:58:15.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.882+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6fc0756b0 con 0x7ff6d806be30 2024-04-24T23:58:15.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.894+0000 7ff6f2a00640 1 -- 172.21.15.96:0/975211556 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7ff6fc0756b0 con 0x7ff6d806be30 2024-04-24T23:58:15.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:15.898 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-24T23:58:15.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff6d806be30 msgr2=0x7ff6d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff6d806be30 0x7ff6d806e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00057e0 tx=0x7ff6ec030000 comp rx=0 tx=0).stop 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6fc1f4ba0 msgr2=0x7ff6fc158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6fc1f4ba0 0x7ff6fc158870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400ec80 tx=0x7ff6e400c5c0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 shutdown_connections 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0ad6e0 0x7ff6fc0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff6d806be30 0x7ff6d806e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6fc1f4ba0 0x7ff6fc158870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 --2- 172.21.15.96:0/975211556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6e00039b0 0x7ff6fc1f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 >> 172.21.15.96:0/975211556 conn(0x7ff6fc0b1f10 msgr2=0x7ff6fc0acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 shutdown_connections 2024-04-24T23:58:15.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:15.898+0000 7ff6fb200640 1 -- 172.21.15.96:0/975211556 wait complete. 2024-04-24T23:58:15.916 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-24T23:58:14.302464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.547541"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552582+0000","last_change":"2024-04-24T23:58:05.798222+0000","last_active":"2024-04-24T23:58:07.552582+0000","last_peered":"2024-04-24T23:58:07.552582+0000","last_clean":"2024-04-24T23:58:07.552582+0000","last_became_active":"2024-04-24T23:58:05.797677+0000","last_became_peered":"2024-04-24T23:58:05.797677+0000","last_unstale":"2024-04-24T23:58:07.552582+0000","last_undegraded":"2024-04-24T23:58:07.552582+0000","last_fullsized":"2024-04-24T23:58:07.552582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:52.401878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779963+0000","last_change":"2024-04-24T23:58:05.795987+0000","last_active":"2024-04-24T23:58:06.779963+0000","last_peered":"2024-04-24T23:58:06.779963+0000","last_clean":"2024-04-24T23:58:06.779963+0000","last_became_active":"2024-04-24T23:58:05.794693+0000","last_became_peered":"2024-04-24T23:58:05.794693+0000","last_unstale":"2024-04-24T23:58:06.779963+0000","last_undegraded":"2024-04-24T23:58:06.779963+0000","last_fullsized":"2024-04-24T23:58:06.779963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549565+0000","last_change":"2024-04-24T23:58:05.792670+0000","last_active":"2024-04-24T23:58:07.549565+0000","last_peered":"2024-04-24T23:58:07.549565+0000","last_clean":"2024-04-24T23:58:07.549565+0000","last_became_active":"2024-04-24T23:58:05.792250+0000","last_became_peered":"2024-04-24T23:58:05.792250+0000","last_unstale":"2024-04-24T23:58:07.549565+0000","last_undegraded":"2024-04-24T23:58:07.549565+0000","last_fullsized":"2024-04-24T23:58:07.549565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549094+0000","last_change":"2024-04-24T23:58:05.797139+0000","last_active":"2024-04-24T23:58:07.549094+0000","last_peered":"2024-04-24T23:58:07.549094+0000","last_clean":"2024-04-24T23:58:07.549094+0000","last_became_active":"2024-04-24T23:58:05.796582+0000","last_became_peered":"2024-04-24T23:58:05.796582+0000","last_unstale":"2024-04-24T23:58:07.549094+0000","last_undegraded":"2024-04-24T23:58:07.549094+0000","last_fullsized":"2024-04-24T23:58:07.549094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:00.726837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548416+0000","last_change":"2024-04-24T23:58:05.800388+0000","last_active":"2024-04-24T23:58:07.548416+0000","last_peered":"2024-04-24T23:58:07.548416+0000","last_clean":"2024-04-24T23:58:07.548416+0000","last_became_active":"2024-04-24T23:58:05.799461+0000","last_became_peered":"2024-04-24T23:58:05.799461+0000","last_unstale":"2024-04-24T23:58:07.548416+0000","last_undegraded":"2024-04-24T23:58:07.548416+0000","last_fullsized":"2024-04-24T23:58:07.548416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548380+0000","last_change":"2024-04-24T23:58:05.790511+0000","last_active":"2024-04-24T23:58:07.548380+0000","last_peered":"2024-04-24T23:58:07.548380+0000","last_clean":"2024-04-24T23:58:07.548380+0000","last_became_active":"2024-04-24T23:58:05.790204+0000","last_became_peered":"2024-04-24T23:58:05.790204+0000","last_unstale":"2024-04-24T23:58:07.548380+0000","last_undegraded":"2024-04-24T23:58:07.548380+0000","last_fullsized":"2024-04-24T23:58:07.548380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549559+0000","last_change":"2024-04-24T23:58:05.803344+0000","last_active":"2024-04-24T23:58:07.549559+0000","last_peered":"2024-04-24T23:58:07.549559+0000","last_clean":"2024-04-24T23:58:07.549559+0000","last_became_active":"2024-04-24T23:58:05.802869+0000","last_became_peered":"2024-04-24T23:58:05.802869+0000","last_unstale":"2024-04-24T23:58:07.549559+0000","last_undegraded":"2024-04-24T23:58:07.549559+0000","last_fullsized":"2024-04-24T23:58:07.549559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548557+0000","last_change":"2024-04-24T23:58:05.796780+0000","last_active":"2024-04-24T23:58:07.548557+0000","last_peered":"2024-04-24T23:58:07.548557+0000","last_clean":"2024-04-24T23:58:07.548557+0000","last_became_active":"2024-04-24T23:58:05.796123+0000","last_became_peered":"2024-04-24T23:58:05.796123+0000","last_unstale":"2024-04-24T23:58:07.548557+0000","last_undegraded":"2024-04-24T23:58:07.548557+0000","last_fullsized":"2024-04-24T23:58:07.548557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552618+0000","last_change":"2024-04-24T23:58:05.798676+0000","last_active":"2024-04-24T23:58:07.552618+0000","last_peered":"2024-04-24T23:58:07.552618+0000","last_clean":"2024-04-24T23:58:07.552618+0000","last_became_active":"2024-04-24T23:58:05.798460+0000","last_became_peered":"2024-04-24T23:58:05.798460+0000","last_unstale":"2024-04-24T23:58:07.552618+0000","last_undegraded":"2024-04-24T23:58:07.552618+0000","last_fullsized":"2024-04-24T23:58:07.552618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:42.009820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780359+0000","last_change":"2024-04-24T23:58:05.790270+0000","last_active":"2024-04-24T23:58:06.780359+0000","last_peered":"2024-04-24T23:58:06.780359+0000","last_clean":"2024-04-24T23:58:06.780359+0000","last_became_active":"2024-04-24T23:58:05.789979+0000","last_became_peered":"2024-04-24T23:58:05.789979+0000","last_unstale":"2024-04-24T23:58:06.780359+0000","last_undegraded":"2024-04-24T23:58:06.780359+0000","last_fullsized":"2024-04-24T23:58:06.780359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781124+0000","last_change":"2024-04-24T23:58:05.793710+0000","last_active":"2024-04-24T23:58:06.781124+0000","last_peered":"2024-04-24T23:58:06.781124+0000","last_clean":"2024-04-24T23:58:06.781124+0000","last_became_active":"2024-04-24T23:58:05.793402+0000","last_became_peered":"2024-04-24T23:58:05.793402+0000","last_unstale":"2024-04-24T23:58:06.781124+0000","last_undegraded":"2024-04-24T23:58:06.781124+0000","last_fullsized":"2024-04-24T23:58:06.781124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782467+0000","last_change":"2024-04-24T23:58:05.768478+0000","last_active":"2024-04-24T23:58:06.782467+0000","last_peered":"2024-04-24T23:58:06.782467+0000","last_clean":"2024-04-24T23:58:06.782467+0000","last_became_active":"2024-04-24T23:58:05.768060+0000","last_became_peered":"2024-04-24T23:58:05.768060+0000","last_unstale":"2024-04-24T23:58:06.782467+0000","last_undegraded":"2024-04-24T23:58:06.782467+0000","last_fullsized":"2024-04-24T23:58:06.782467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:45.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550107+0000","last_change":"2024-04-24T23:58:05.801426+0000","last_active":"2024-04-24T23:58:07.550107+0000","last_peered":"2024-04-24T23:58:07.550107+0000","last_clean":"2024-04-24T23:58:07.550107+0000","last_became_active":"2024-04-24T23:58:05.801082+0000","last_became_peered":"2024-04-24T23:58:05.801082+0000","last_unstale":"2024-04-24T23:58:07.550107+0000","last_undegraded":"2024-04-24T23:58:07.550107+0000","last_fullsized":"2024-04-24T23:58:07.550107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548534+0000","last_change":"2024-04-24T23:58:05.790329+0000","last_active":"2024-04-24T23:58:07.548534+0000","last_peered":"2024-04-24T23:58:07.548534+0000","last_clean":"2024-04-24T23:58:07.548534+0000","last_became_active":"2024-04-24T23:58:05.787856+0000","last_became_peered":"2024-04-24T23:58:05.787856+0000","last_unstale":"2024-04-24T23:58:07.548534+0000","last_undegraded":"2024-04-24T23:58:07.548534+0000","last_fullsized":"2024-04-24T23:58:07.548534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:18.652571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779257+0000","last_change":"2024-04-24T23:58:05.784612+0000","last_active":"2024-04-24T23:58:06.779257+0000","last_peered":"2024-04-24T23:58:06.779257+0000","last_clean":"2024-04-24T23:58:06.779257+0000","last_became_active":"2024-04-24T23:58:05.784318+0000","last_became_peered":"2024-04-24T23:58:05.784318+0000","last_unstale":"2024-04-24T23:58:06.779257+0000","last_undegraded":"2024-04-24T23:58:06.779257+0000","last_fullsized":"2024-04-24T23:58:06.779257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547845+0000","last_change":"2024-04-24T23:58:05.802993+0000","last_active":"2024-04-24T23:58:07.547845+0000","last_peered":"2024-04-24T23:58:07.547845+0000","last_clean":"2024-04-24T23:58:07.547845+0000","last_became_active":"2024-04-24T23:58:05.802728+0000","last_became_peered":"2024-04-24T23:58:05.802728+0000","last_unstale":"2024-04-24T23:58:07.547845+0000","last_undegraded":"2024-04-24T23:58:07.547845+0000","last_fullsized":"2024-04-24T23:58:07.547845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550212+0000","last_change":"2024-04-24T23:58:05.804677+0000","last_active":"2024-04-24T23:58:07.550212+0000","last_peered":"2024-04-24T23:58:07.550212+0000","last_clean":"2024-04-24T23:58:07.550212+0000","last_became_active":"2024-04-24T23:58:05.804348+0000","last_became_peered":"2024-04-24T23:58:05.804348+0000","last_unstale":"2024-04-24T23:58:07.550212+0000","last_undegraded":"2024-04-24T23:58:07.550212+0000","last_fullsized":"2024-04-24T23:58:07.550212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:52.401878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549898+0000","last_change":"2024-04-24T23:58:05.791215+0000","last_active":"2024-04-24T23:58:07.549898+0000","last_peered":"2024-04-24T23:58:07.549898+0000","last_clean":"2024-04-24T23:58:07.549898+0000","last_became_active":"2024-04-24T23:58:05.790911+0000","last_became_peered":"2024-04-24T23:58:05.790911+0000","last_unstale":"2024-04-24T23:58:07.549898+0000","last_undegraded":"2024-04-24T23:58:07.549898+0000","last_fullsized":"2024-04-24T23:58:07.549898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:06.860406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552329+0000","last_change":"2024-04-24T23:58:05.799646+0000","last_active":"2024-04-24T23:58:07.552329+0000","last_peered":"2024-04-24T23:58:07.552329+0000","last_clean":"2024-04-24T23:58:07.552329+0000","last_became_active":"2024-04-24T23:58:05.799361+0000","last_became_peered":"2024-04-24T23:58:05.799361+0000","last_unstale":"2024-04-24T23:58:07.552329+0000","last_undegraded":"2024-04-24T23:58:07.552329+0000","last_fullsized":"2024-04-24T23:58:07.552329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:12.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779220+0000","last_change":"2024-04-24T23:58:05.772550+0000","last_active":"2024-04-24T23:58:06.779220+0000","last_peered":"2024-04-24T23:58:06.779220+0000","last_clean":"2024-04-24T23:58:06.779220+0000","last_became_active":"2024-04-24T23:58:05.772271+0000","last_became_peered":"2024-04-24T23:58:05.772271+0000","last_unstale":"2024-04-24T23:58:06.779220+0000","last_undegraded":"2024-04-24T23:58:06.779220+0000","last_fullsized":"2024-04-24T23:58:06.779220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548310+0000","last_change":"2024-04-24T23:58:05.787389+0000","last_active":"2024-04-24T23:58:07.548310+0000","last_peered":"2024-04-24T23:58:07.548310+0000","last_clean":"2024-04-24T23:58:07.548310+0000","last_became_active":"2024-04-24T23:58:05.786872+0000","last_became_peered":"2024-04-24T23:58:05.786872+0000","last_unstale":"2024-04-24T23:58:07.548310+0000","last_undegraded":"2024-04-24T23:58:07.548310+0000","last_fullsized":"2024-04-24T23:58:07.548310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:31.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548638+0000","last_change":"2024-04-24T23:58:05.798911+0000","last_active":"2024-04-24T23:58:07.548638+0000","last_peered":"2024-04-24T23:58:07.548638+0000","last_clean":"2024-04-24T23:58:07.548638+0000","last_became_active":"2024-04-24T23:58:05.798629+0000","last_became_peered":"2024-04-24T23:58:05.798629+0000","last_unstale":"2024-04-24T23:58:07.548638+0000","last_undegraded":"2024-04-24T23:58:07.548638+0000","last_fullsized":"2024-04-24T23:58:07.548638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551279+0000","last_change":"2024-04-24T23:58:05.788291+0000","last_active":"2024-04-24T23:58:07.551279+0000","last_peered":"2024-04-24T23:58:07.551279+0000","last_clean":"2024-04-24T23:58:07.551279+0000","last_became_active":"2024-04-24T23:58:05.787971+0000","last_became_peered":"2024-04-24T23:58:05.787971+0000","last_unstale":"2024-04-24T23:58:07.551279+0000","last_undegraded":"2024-04-24T23:58:07.551279+0000","last_fullsized":"2024-04-24T23:58:07.551279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548331+0000","last_change":"2024-04-24T23:58:05.786883+0000","last_active":"2024-04-24T23:58:07.548331+0000","last_peered":"2024-04-24T23:58:07.548331+0000","last_clean":"2024-04-24T23:58:07.548331+0000","last_became_active":"2024-04-24T23:58:05.786637+0000","last_became_peered":"2024-04-24T23:58:05.786637+0000","last_unstale":"2024-04-24T23:58:07.548331+0000","last_undegraded":"2024-04-24T23:58:07.548331+0000","last_fullsized":"2024-04-24T23:58:07.548331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552055+0000","last_change":"2024-04-24T23:58:05.797334+0000","last_active":"2024-04-24T23:58:07.552055+0000","last_peered":"2024-04-24T23:58:07.552055+0000","last_clean":"2024-04-24T23:58:07.552055+0000","last_became_active":"2024-04-24T23:58:05.797038+0000","last_became_peered":"2024-04-24T23:58:05.797038+0000","last_unstale":"2024-04-24T23:58:07.552055+0000","last_undegraded":"2024-04-24T23:58:07.552055+0000","last_fullsized":"2024-04-24T23:58:07.552055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780792+0000","last_change":"2024-04-24T23:58:05.786537+0000","last_active":"2024-04-24T23:58:06.780792+0000","last_peered":"2024-04-24T23:58:06.780792+0000","last_clean":"2024-04-24T23:58:06.780792+0000","last_became_active":"2024-04-24T23:58:05.780787+0000","last_became_peered":"2024-04-24T23:58:05.780787+0000","last_unstale":"2024-04-24T23:58:06.780792+0000","last_undegraded":"2024-04-24T23:58:06.780792+0000","last_fullsized":"2024-04-24T23:58:06.780792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780454+0000","last_change":"2024-04-24T23:58:05.797680+0000","last_active":"2024-04-24T23:58:06.780454+0000","last_peered":"2024-04-24T23:58:06.780454+0000","last_clean":"2024-04-24T23:58:06.780454+0000","last_became_active":"2024-04-24T23:58:05.796878+0000","last_became_peered":"2024-04-24T23:58:05.796878+0000","last_unstale":"2024-04-24T23:58:06.780454+0000","last_undegraded":"2024-04-24T23:58:06.780454+0000","last_fullsized":"2024-04-24T23:58:06.780454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551634+0000","last_change":"2024-04-24T23:58:05.794457+0000","last_active":"2024-04-24T23:58:07.551634+0000","last_peered":"2024-04-24T23:58:07.551634+0000","last_clean":"2024-04-24T23:58:07.551634+0000","last_became_active":"2024-04-24T23:58:05.794121+0000","last_became_peered":"2024-04-24T23:58:05.794121+0000","last_unstale":"2024-04-24T23:58:07.551634+0000","last_undegraded":"2024-04-24T23:58:07.551634+0000","last_fullsized":"2024-04-24T23:58:07.551634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548655+0000","last_change":"2024-04-24T23:58:05.787183+0000","last_active":"2024-04-24T23:58:07.548655+0000","last_peered":"2024-04-24T23:58:07.548655+0000","last_clean":"2024-04-24T23:58:07.548655+0000","last_became_active":"2024-04-24T23:58:05.786561+0000","last_became_peered":"2024-04-24T23:58:05.786561+0000","last_unstale":"2024-04-24T23:58:07.548655+0000","last_undegraded":"2024-04-24T23:58:07.548655+0000","last_fullsized":"2024-04-24T23:58:07.548655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:20.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548872+0000","last_change":"2024-04-24T23:58:05.785799+0000","last_active":"2024-04-24T23:58:07.548872+0000","last_peered":"2024-04-24T23:58:07.548872+0000","last_clean":"2024-04-24T23:58:07.548872+0000","last_became_active":"2024-04-24T23:58:05.785513+0000","last_became_peered":"2024-04-24T23:58:05.785513+0000","last_unstale":"2024-04-24T23:58:07.548872+0000","last_undegraded":"2024-04-24T23:58:07.548872+0000","last_fullsized":"2024-04-24T23:58:07.548872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549958+0000","last_change":"2024-04-24T23:58:05.786627+0000","last_active":"2024-04-24T23:58:07.549958+0000","last_peered":"2024-04-24T23:58:07.549958+0000","last_clean":"2024-04-24T23:58:07.549958+0000","last_became_active":"2024-04-24T23:58:05.786354+0000","last_became_peered":"2024-04-24T23:58:05.786354+0000","last_unstale":"2024-04-24T23:58:07.549958+0000","last_undegraded":"2024-04-24T23:58:07.549958+0000","last_fullsized":"2024-04-24T23:58:07.549958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:43.209580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778470+0000","last_change":"2024-04-24T23:58:05.774049+0000","last_active":"2024-04-24T23:58:06.778470+0000","last_peered":"2024-04-24T23:58:06.778470+0000","last_clean":"2024-04-24T23:58:06.778470+0000","last_became_active":"2024-04-24T23:58:05.773704+0000","last_became_peered":"2024-04-24T23:58:05.773704+0000","last_unstale":"2024-04-24T23:58:06.778470+0000","last_undegraded":"2024-04-24T23:58:06.778470+0000","last_fullsized":"2024-04-24T23:58:06.778470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:20.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781658+0000","last_change":"2024-04-24T23:58:05.790510+0000","last_active":"2024-04-24T23:58:06.781658+0000","last_peered":"2024-04-24T23:58:06.781658+0000","last_clean":"2024-04-24T23:58:06.781658+0000","last_became_active":"2024-04-24T23:58:05.790154+0000","last_became_peered":"2024-04-24T23:58:05.790154+0000","last_unstale":"2024-04-24T23:58:06.781658+0000","last_undegraded":"2024-04-24T23:58:06.781658+0000","last_fullsized":"2024-04-24T23:58:06.781658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:19.886869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550429+0000","last_change":"2024-04-24T23:58:04.771651+0000","last_active":"2024-04-24T23:58:07.550429+0000","last_peered":"2024-04-24T23:58:07.550429+0000","last_clean":"2024-04-24T23:58:07.550429+0000","last_became_active":"2024-04-24T23:58:04.771304+0000","last_became_peered":"2024-04-24T23:58:04.771304+0000","last_unstale":"2024-04-24T23:58:07.550429+0000","last_undegraded":"2024-04-24T23:58:07.550429+0000","last_fullsized":"2024-04-24T23:58:07.550429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548744+0000","last_change":"2024-04-24T23:58:05.770296+0000","last_active":"2024-04-24T23:58:07.548744+0000","last_peered":"2024-04-24T23:58:07.548744+0000","last_clean":"2024-04-24T23:58:07.548744+0000","last_became_active":"2024-04-24T23:58:05.769888+0000","last_became_peered":"2024-04-24T23:58:05.769888+0000","last_unstale":"2024-04-24T23:58:07.548744+0000","last_undegraded":"2024-04-24T23:58:07.548744+0000","last_fullsized":"2024-04-24T23:58:07.548744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780802+0000","last_change":"2024-04-24T23:58:04.776522+0000","last_active":"2024-04-24T23:58:06.780802+0000","last_peered":"2024-04-24T23:58:06.780802+0000","last_clean":"2024-04-24T23:58:06.780802+0000","last_became_active":"2024-04-24T23:58:04.776214+0000","last_became_peered":"2024-04-24T23:58:04.776214+0000","last_unstale":"2024-04-24T23:58:06.780802+0000","last_undegraded":"2024-04-24T23:58:06.780802+0000","last_fullsized":"2024-04-24T23:58:06.780802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551072+0000","last_change":"2024-04-24T23:58:04.763540+0000","last_active":"2024-04-24T23:58:07.551072+0000","last_peered":"2024-04-24T23:58:07.551072+0000","last_clean":"2024-04-24T23:58:07.551072+0000","last_became_active":"2024-04-24T23:58:04.763262+0000","last_became_peered":"2024-04-24T23:58:04.763262+0000","last_unstale":"2024-04-24T23:58:07.551072+0000","last_undegraded":"2024-04-24T23:58:07.551072+0000","last_fullsized":"2024-04-24T23:58:07.551072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:33.619150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550335+0000","last_change":"2024-04-24T23:58:05.803405+0000","last_active":"2024-04-24T23:58:07.550335+0000","last_peered":"2024-04-24T23:58:07.550335+0000","last_clean":"2024-04-24T23:58:07.550335+0000","last_became_active":"2024-04-24T23:58:05.802932+0000","last_became_peered":"2024-04-24T23:58:05.802932+0000","last_unstale":"2024-04-24T23:58:07.550335+0000","last_undegraded":"2024-04-24T23:58:07.550335+0000","last_fullsized":"2024-04-24T23:58:07.550335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548491+0000","last_change":"2024-04-24T23:58:04.776492+0000","last_active":"2024-04-24T23:58:07.548491+0000","last_peered":"2024-04-24T23:58:07.548491+0000","last_clean":"2024-04-24T23:58:07.548491+0000","last_became_active":"2024-04-24T23:58:04.776141+0000","last_became_peered":"2024-04-24T23:58:04.776141+0000","last_unstale":"2024-04-24T23:58:07.548491+0000","last_undegraded":"2024-04-24T23:58:07.548491+0000","last_fullsized":"2024-04-24T23:58:07.548491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779315+0000","last_change":"2024-04-24T23:58:05.784472+0000","last_active":"2024-04-24T23:58:06.779315+0000","last_peered":"2024-04-24T23:58:06.779315+0000","last_clean":"2024-04-24T23:58:06.779315+0000","last_became_active":"2024-04-24T23:58:05.784189+0000","last_became_peered":"2024-04-24T23:58:05.784189+0000","last_unstale":"2024-04-24T23:58:06.779315+0000","last_undegraded":"2024-04-24T23:58:06.779315+0000","last_fullsized":"2024-04-24T23:58:06.779315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778959+0000","last_change":"2024-04-24T23:58:04.770884+0000","last_active":"2024-04-24T23:58:06.778959+0000","last_peered":"2024-04-24T23:58:06.778959+0000","last_clean":"2024-04-24T23:58:06.778959+0000","last_became_active":"2024-04-24T23:58:04.770285+0000","last_became_peered":"2024-04-24T23:58:04.770285+0000","last_unstale":"2024-04-24T23:58:06.778959+0000","last_undegraded":"2024-04-24T23:58:06.778959+0000","last_fullsized":"2024-04-24T23:58:06.778959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548778+0000","last_change":"2024-04-24T23:58:05.784538+0000","last_active":"2024-04-24T23:58:07.548778+0000","last_peered":"2024-04-24T23:58:07.548778+0000","last_clean":"2024-04-24T23:58:07.548778+0000","last_became_active":"2024-04-24T23:58:05.784301+0000","last_became_peered":"2024-04-24T23:58:05.784301+0000","last_unstale":"2024-04-24T23:58:07.548778+0000","last_undegraded":"2024-04-24T23:58:07.548778+0000","last_fullsized":"2024-04-24T23:58:07.548778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548917+0000","last_change":"2024-04-24T23:58:04.769622+0000","last_active":"2024-04-24T23:58:07.548917+0000","last_peered":"2024-04-24T23:58:07.548917+0000","last_clean":"2024-04-24T23:58:07.548917+0000","last_became_active":"2024-04-24T23:58:04.769264+0000","last_became_peered":"2024-04-24T23:58:04.769264+0000","last_unstale":"2024-04-24T23:58:07.548917+0000","last_undegraded":"2024-04-24T23:58:07.548917+0000","last_fullsized":"2024-04-24T23:58:07.548917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549427+0000","last_change":"2024-04-24T23:58:05.785033+0000","last_active":"2024-04-24T23:58:07.549427+0000","last_peered":"2024-04-24T23:58:07.549427+0000","last_clean":"2024-04-24T23:58:07.549427+0000","last_became_active":"2024-04-24T23:58:05.784760+0000","last_became_peered":"2024-04-24T23:58:05.784760+0000","last_unstale":"2024-04-24T23:58:07.549427+0000","last_undegraded":"2024-04-24T23:58:07.549427+0000","last_fullsized":"2024-04-24T23:58:07.549427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779774+0000","last_change":"2024-04-24T23:58:04.770638+0000","last_active":"2024-04-24T23:58:06.779774+0000","last_peered":"2024-04-24T23:58:06.779774+0000","last_clean":"2024-04-24T23:58:06.779774+0000","last_became_active":"2024-04-24T23:58:04.770332+0000","last_became_peered":"2024-04-24T23:58:04.770332+0000","last_unstale":"2024-04-24T23:58:06.779774+0000","last_undegraded":"2024-04-24T23:58:06.779774+0000","last_fullsized":"2024-04-24T23:58:06.779774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782618+0000","last_change":"2024-04-24T23:58:05.786124+0000","last_active":"2024-04-24T23:58:06.782618+0000","last_peered":"2024-04-24T23:58:06.782618+0000","last_clean":"2024-04-24T23:58:06.782618+0000","last_became_active":"2024-04-24T23:58:05.785737+0000","last_became_peered":"2024-04-24T23:58:05.785737+0000","last_unstale":"2024-04-24T23:58:06.782618+0000","last_undegraded":"2024-04-24T23:58:06.782618+0000","last_fullsized":"2024-04-24T23:58:06.782618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:48.097493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779149+0000","last_change":"2024-04-24T23:58:04.759666+0000","last_active":"2024-04-24T23:58:06.779149+0000","last_peered":"2024-04-24T23:58:06.779149+0000","last_clean":"2024-04-24T23:58:06.779149+0000","last_became_active":"2024-04-24T23:58:04.759342+0000","last_became_peered":"2024-04-24T23:58:04.759342+0000","last_unstale":"2024-04-24T23:58:06.779149+0000","last_undegraded":"2024-04-24T23:58:06.779149+0000","last_fullsized":"2024-04-24T23:58:06.779149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551828+0000","last_change":"2024-04-24T23:58:05.793926+0000","last_active":"2024-04-24T23:58:07.551828+0000","last_peered":"2024-04-24T23:58:07.551828+0000","last_clean":"2024-04-24T23:58:07.551828+0000","last_became_active":"2024-04-24T23:58:05.792484+0000","last_became_peered":"2024-04-24T23:58:05.792484+0000","last_unstale":"2024-04-24T23:58:07.551828+0000","last_undegraded":"2024-04-24T23:58:07.551828+0000","last_fullsized":"2024-04-24T23:58:07.551828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:11.381479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548797+0000","last_change":"2024-04-24T23:58:04.776767+0000","last_active":"2024-04-24T23:58:07.548797+0000","last_peered":"2024-04-24T23:58:07.548797+0000","last_clean":"2024-04-24T23:58:07.548797+0000","last_became_active":"2024-04-24T23:58:04.776452+0000","last_became_peered":"2024-04-24T23:58:04.776452+0000","last_unstale":"2024-04-24T23:58:07.548797+0000","last_undegraded":"2024-04-24T23:58:07.548797+0000","last_fullsized":"2024-04-24T23:58:07.548797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:07:03.630911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549293+0000","last_change":"2024-04-24T23:58:05.790152+0000","last_active":"2024-04-24T23:58:07.549293+0000","last_peered":"2024-04-24T23:58:07.549293+0000","last_clean":"2024-04-24T23:58:07.549293+0000","last_became_active":"2024-04-24T23:58:05.789858+0000","last_became_peered":"2024-04-24T23:58:05.789858+0000","last_unstale":"2024-04-24T23:58:07.549293+0000","last_undegraded":"2024-04-24T23:58:07.549293+0000","last_fullsized":"2024-04-24T23:58:07.549293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548956+0000","last_change":"2024-04-24T23:58:04.771292+0000","last_active":"2024-04-24T23:58:07.548956+0000","last_peered":"2024-04-24T23:58:07.548956+0000","last_clean":"2024-04-24T23:58:07.548956+0000","last_became_active":"2024-04-24T23:58:04.770724+0000","last_became_peered":"2024-04-24T23:58:04.770724+0000","last_unstale":"2024-04-24T23:58:07.548956+0000","last_undegraded":"2024-04-24T23:58:07.548956+0000","last_fullsized":"2024-04-24T23:58:07.548956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548794+0000","last_change":"2024-04-24T23:58:05.802304+0000","last_active":"2024-04-24T23:58:07.548794+0000","last_peered":"2024-04-24T23:58:07.548794+0000","last_clean":"2024-04-24T23:58:07.548794+0000","last_became_active":"2024-04-24T23:58:05.799845+0000","last_became_peered":"2024-04-24T23:58:05.799845+0000","last_unstale":"2024-04-24T23:58:07.548794+0000","last_undegraded":"2024-04-24T23:58:07.548794+0000","last_fullsized":"2024-04-24T23:58:07.548794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778378+0000","last_change":"2024-04-24T23:58:04.765718+0000","last_active":"2024-04-24T23:58:06.778378+0000","last_peered":"2024-04-24T23:58:06.778378+0000","last_clean":"2024-04-24T23:58:06.778378+0000","last_became_active":"2024-04-24T23:58:04.765445+0000","last_became_peered":"2024-04-24T23:58:04.765445+0000","last_unstale":"2024-04-24T23:58:06.778378+0000","last_undegraded":"2024-04-24T23:58:06.778378+0000","last_fullsized":"2024-04-24T23:58:06.778378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780131+0000","last_change":"2024-04-24T23:58:05.775138+0000","last_active":"2024-04-24T23:58:06.780131+0000","last_peered":"2024-04-24T23:58:06.780131+0000","last_clean":"2024-04-24T23:58:06.780131+0000","last_became_active":"2024-04-24T23:58:05.774820+0000","last_became_peered":"2024-04-24T23:58:05.774820+0000","last_unstale":"2024-04-24T23:58:06.780131+0000","last_undegraded":"2024-04-24T23:58:06.780131+0000","last_fullsized":"2024-04-24T23:58:06.780131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547528+0000","last_change":"2024-04-24T23:58:04.756238+0000","last_active":"2024-04-24T23:58:07.547528+0000","last_peered":"2024-04-24T23:58:07.547528+0000","last_clean":"2024-04-24T23:58:07.547528+0000","last_became_active":"2024-04-24T23:58:04.755948+0000","last_became_peered":"2024-04-24T23:58:04.755948+0000","last_unstale":"2024-04-24T23:58:07.547528+0000","last_undegraded":"2024-04-24T23:58:07.547528+0000","last_fullsized":"2024-04-24T23:58:07.547528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549775+0000","last_change":"2024-04-24T23:58:05.792006+0000","last_active":"2024-04-24T23:58:07.549775+0000","last_peered":"2024-04-24T23:58:07.549775+0000","last_clean":"2024-04-24T23:58:07.549775+0000","last_became_active":"2024-04-24T23:58:05.791717+0000","last_became_peered":"2024-04-24T23:58:05.791717+0000","last_unstale":"2024-04-24T23:58:07.549775+0000","last_undegraded":"2024-04-24T23:58:07.549775+0000","last_fullsized":"2024-04-24T23:58:07.549775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782855+0000","last_change":"2024-04-24T23:58:04.762742+0000","last_active":"2024-04-24T23:58:06.782855+0000","last_peered":"2024-04-24T23:58:06.782855+0000","last_clean":"2024-04-24T23:58:06.782855+0000","last_became_active":"2024-04-24T23:58:04.757739+0000","last_became_peered":"2024-04-24T23:58:04.757739+0000","last_unstale":"2024-04-24T23:58:06.782855+0000","last_undegraded":"2024-04-24T23:58:06.782855+0000","last_fullsized":"2024-04-24T23:58:06.782855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:32:19.430261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552485+0000","last_change":"2024-04-24T23:58:05.804538+0000","last_active":"2024-04-24T23:58:07.552485+0000","last_peered":"2024-04-24T23:58:07.552485+0000","last_clean":"2024-04-24T23:58:07.552485+0000","last_became_active":"2024-04-24T23:58:05.804208+0000","last_became_peered":"2024-04-24T23:58:05.804208+0000","last_unstale":"2024-04-24T23:58:07.552485+0000","last_undegraded":"2024-04-24T23:58:07.552485+0000","last_fullsized":"2024-04-24T23:58:07.552485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.648636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549908+0000","last_change":"2024-04-24T23:58:04.760983+0000","last_active":"2024-04-24T23:58:07.549908+0000","last_peered":"2024-04-24T23:58:07.549908+0000","last_clean":"2024-04-24T23:58:07.549908+0000","last_became_active":"2024-04-24T23:58:04.760235+0000","last_became_peered":"2024-04-24T23:58:04.760235+0000","last_unstale":"2024-04-24T23:58:07.549908+0000","last_undegraded":"2024-04-24T23:58:07.549908+0000","last_fullsized":"2024-04-24T23:58:07.549908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552862+0000","last_change":"2024-04-24T23:58:05.803645+0000","last_active":"2024-04-24T23:58:07.552862+0000","last_peered":"2024-04-24T23:58:07.552862+0000","last_clean":"2024-04-24T23:58:07.552862+0000","last_became_active":"2024-04-24T23:58:05.803374+0000","last_became_peered":"2024-04-24T23:58:05.803374+0000","last_unstale":"2024-04-24T23:58:07.552862+0000","last_undegraded":"2024-04-24T23:58:07.552862+0000","last_fullsized":"2024-04-24T23:58:07.552862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:04:24.025118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780094+0000","last_change":"2024-04-24T23:58:04.773468+0000","last_active":"2024-04-24T23:58:06.780094+0000","last_peered":"2024-04-24T23:58:06.780094+0000","last_clean":"2024-04-24T23:58:06.780094+0000","last_became_active":"2024-04-24T23:58:04.773164+0000","last_became_peered":"2024-04-24T23:58:04.773164+0000","last_unstale":"2024-04-24T23:58:06.780094+0000","last_undegraded":"2024-04-24T23:58:06.780094+0000","last_fullsized":"2024-04-24T23:58:06.780094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549683+0000","last_change":"2024-04-24T23:58:05.796911+0000","last_active":"2024-04-24T23:58:07.549683+0000","last_peered":"2024-04-24T23:58:07.549683+0000","last_clean":"2024-04-24T23:58:07.549683+0000","last_became_active":"2024-04-24T23:58:05.796117+0000","last_became_peered":"2024-04-24T23:58:05.796117+0000","last_unstale":"2024-04-24T23:58:07.549683+0000","last_undegraded":"2024-04-24T23:58:07.549683+0000","last_fullsized":"2024-04-24T23:58:07.549683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:12.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550141+0000","last_change":"2024-04-24T23:58:04.772549+0000","last_active":"2024-04-24T23:58:07.550141+0000","last_peered":"2024-04-24T23:58:07.550141+0000","last_clean":"2024-04-24T23:58:07.550141+0000","last_became_active":"2024-04-24T23:58:04.771951+0000","last_became_peered":"2024-04-24T23:58:04.771951+0000","last_unstale":"2024-04-24T23:58:07.550141+0000","last_undegraded":"2024-04-24T23:58:07.550141+0000","last_fullsized":"2024-04-24T23:58:07.550141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:16:27.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551720+0000","last_change":"2024-04-24T23:58:05.793353+0000","last_active":"2024-04-24T23:58:07.551720+0000","last_peered":"2024-04-24T23:58:07.551720+0000","last_clean":"2024-04-24T23:58:07.551720+0000","last_became_active":"2024-04-24T23:58:05.793021+0000","last_became_peered":"2024-04-24T23:58:05.793021+0000","last_unstale":"2024-04-24T23:58:07.551720+0000","last_undegraded":"2024-04-24T23:58:07.551720+0000","last_fullsized":"2024-04-24T23:58:07.551720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:00.726837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547872+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:58:07.547872+0000","last_peered":"2024-04-24T23:58:07.547872+0000","last_clean":"2024-04-24T23:58:07.547872+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:58:07.547872+0000","last_undegraded":"2024-04-24T23:58:07.547872+0000","last_fullsized":"2024-04-24T23:58:07.547872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547780+0000","last_change":"2024-04-24T23:58:04.772159+0000","last_active":"2024-04-24T23:58:07.547780+0000","last_peered":"2024-04-24T23:58:07.547780+0000","last_clean":"2024-04-24T23:58:07.547780+0000","last_became_active":"2024-04-24T23:58:04.771791+0000","last_became_peered":"2024-04-24T23:58:04.771791+0000","last_unstale":"2024-04-24T23:58:07.547780+0000","last_undegraded":"2024-04-24T23:58:07.547780+0000","last_fullsized":"2024-04-24T23:58:07.547780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:16:27.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549665+0000","last_change":"2024-04-24T23:58:05.798331+0000","last_active":"2024-04-24T23:58:07.549665+0000","last_peered":"2024-04-24T23:58:07.549665+0000","last_clean":"2024-04-24T23:58:07.549665+0000","last_became_active":"2024-04-24T23:58:05.797998+0000","last_became_peered":"2024-04-24T23:58:05.797998+0000","last_unstale":"2024-04-24T23:58:07.549665+0000","last_undegraded":"2024-04-24T23:58:07.549665+0000","last_fullsized":"2024-04-24T23:58:07.549665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547517+0000","last_change":"2024-04-24T23:58:04.774140+0000","last_active":"2024-04-24T23:58:07.547517+0000","last_peered":"2024-04-24T23:58:07.547517+0000","last_clean":"2024-04-24T23:58:07.547517+0000","last_became_active":"2024-04-24T23:58:04.773822+0000","last_became_peered":"2024-04-24T23:58:04.773822+0000","last_unstale":"2024-04-24T23:58:07.547517+0000","last_undegraded":"2024-04-24T23:58:07.547517+0000","last_fullsized":"2024-04-24T23:58:07.547517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548141+0000","last_change":"2024-04-24T23:58:05.770614+0000","last_active":"2024-04-24T23:58:07.548141+0000","last_peered":"2024-04-24T23:58:07.548141+0000","last_clean":"2024-04-24T23:58:07.548141+0000","last_became_active":"2024-04-24T23:58:05.770229+0000","last_became_peered":"2024-04-24T23:58:05.770229+0000","last_unstale":"2024-04-24T23:58:07.548141+0000","last_undegraded":"2024-04-24T23:58:07.548141+0000","last_fullsized":"2024-04-24T23:58:07.548141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.247528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550130+0000","last_change":"2024-04-24T23:58:04.754168+0000","last_active":"2024-04-24T23:58:07.550130+0000","last_peered":"2024-04-24T23:58:07.550130+0000","last_clean":"2024-04-24T23:58:07.550130+0000","last_became_active":"2024-04-24T23:58:04.753801+0000","last_became_peered":"2024-04-24T23:58:04.753801+0000","last_unstale":"2024-04-24T23:58:07.550130+0000","last_undegraded":"2024-04-24T23:58:07.550130+0000","last_fullsized":"2024-04-24T23:58:07.550130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779072+0000","last_change":"2024-04-24T23:58:05.797159+0000","last_active":"2024-04-24T23:58:06.779072+0000","last_peered":"2024-04-24T23:58:06.779072+0000","last_clean":"2024-04-24T23:58:06.779072+0000","last_became_active":"2024-04-24T23:58:05.796588+0000","last_became_peered":"2024-04-24T23:58:05.796588+0000","last_unstale":"2024-04-24T23:58:06.779072+0000","last_undegraded":"2024-04-24T23:58:06.779072+0000","last_fullsized":"2024-04-24T23:58:06.779072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549111+0000","last_change":"2024-04-24T23:58:04.771298+0000","last_active":"2024-04-24T23:58:07.549111+0000","last_peered":"2024-04-24T23:58:07.549111+0000","last_clean":"2024-04-24T23:58:07.549111+0000","last_became_active":"2024-04-24T23:58:04.770304+0000","last_became_peered":"2024-04-24T23:58:04.770304+0000","last_unstale":"2024-04-24T23:58:07.549111+0000","last_undegraded":"2024-04-24T23:58:07.549111+0000","last_fullsized":"2024-04-24T23:58:07.549111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782155+0000","last_change":"2024-04-24T23:58:05.776073+0000","last_active":"2024-04-24T23:58:06.782155+0000","last_peered":"2024-04-24T23:58:06.782155+0000","last_clean":"2024-04-24T23:58:06.782155+0000","last_became_active":"2024-04-24T23:58:05.775750+0000","last_became_peered":"2024-04-24T23:58:05.775750+0000","last_unstale":"2024-04-24T23:58:06.782155+0000","last_undegraded":"2024-04-24T23:58:06.782155+0000","last_fullsized":"2024-04-24T23:58:06.782155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:39.153771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779645+0000","last_change":"2024-04-24T23:58:04.758156+0000","last_active":"2024-04-24T23:58:06.779645+0000","last_peered":"2024-04-24T23:58:06.779645+0000","last_clean":"2024-04-24T23:58:06.779645+0000","last_became_active":"2024-04-24T23:58:04.757677+0000","last_became_peered":"2024-04-24T23:58:04.757677+0000","last_unstale":"2024-04-24T23:58:06.779645+0000","last_undegraded":"2024-04-24T23:58:06.779645+0000","last_fullsized":"2024-04-24T23:58:06.779645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:05.846034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549139+0000","last_change":"2024-04-24T23:58:05.796265+0000","last_active":"2024-04-24T23:58:07.549139+0000","last_peered":"2024-04-24T23:58:07.549139+0000","last_clean":"2024-04-24T23:58:07.549139+0000","last_became_active":"2024-04-24T23:58:05.795946+0000","last_became_peered":"2024-04-24T23:58:05.795946+0000","last_unstale":"2024-04-24T23:58:07.549139+0000","last_undegraded":"2024-04-24T23:58:07.549139+0000","last_fullsized":"2024-04-24T23:58:07.549139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:11.381479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551980+0000","last_change":"2024-04-24T23:58:04.779614+0000","last_active":"2024-04-24T23:58:07.551980+0000","last_peered":"2024-04-24T23:58:07.551980+0000","last_clean":"2024-04-24T23:58:07.551980+0000","last_became_active":"2024-04-24T23:58:04.779349+0000","last_became_peered":"2024-04-24T23:58:04.779349+0000","last_unstale":"2024-04-24T23:58:07.551980+0000","last_undegraded":"2024-04-24T23:58:07.551980+0000","last_fullsized":"2024-04-24T23:58:07.551980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:03.060917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779784+0000","last_change":"2024-04-24T23:58:05.797066+0000","last_active":"2024-04-24T23:58:06.779784+0000","last_peered":"2024-04-24T23:58:06.779784+0000","last_clean":"2024-04-24T23:58:06.779784+0000","last_became_active":"2024-04-24T23:58:05.796781+0000","last_became_peered":"2024-04-24T23:58:05.796781+0000","last_unstale":"2024-04-24T23:58:06.779784+0000","last_undegraded":"2024-04-24T23:58:06.779784+0000","last_fullsized":"2024-04-24T23:58:06.779784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779750+0000","last_change":"2024-04-24T23:58:04.762718+0000","last_active":"2024-04-24T23:58:06.779750+0000","last_peered":"2024-04-24T23:58:06.779750+0000","last_clean":"2024-04-24T23:58:06.779750+0000","last_became_active":"2024-04-24T23:58:04.762332+0000","last_became_peered":"2024-04-24T23:58:04.762332+0000","last_unstale":"2024-04-24T23:58:06.779750+0000","last_undegraded":"2024-04-24T23:58:06.779750+0000","last_fullsized":"2024-04-24T23:58:06.779750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:42.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552274+0000","last_change":"2024-04-24T23:58:05.804598+0000","last_active":"2024-04-24T23:58:07.552274+0000","last_peered":"2024-04-24T23:58:07.552274+0000","last_clean":"2024-04-24T23:58:07.552274+0000","last_became_active":"2024-04-24T23:58:05.804304+0000","last_became_peered":"2024-04-24T23:58:05.804304+0000","last_unstale":"2024-04-24T23:58:07.552274+0000","last_undegraded":"2024-04-24T23:58:07.552274+0000","last_fullsized":"2024-04-24T23:58:07.552274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778978+0000","last_change":"2024-04-24T23:58:04.771715+0000","last_active":"2024-04-24T23:58:06.778978+0000","last_peered":"2024-04-24T23:58:06.778978+0000","last_clean":"2024-04-24T23:58:06.778978+0000","last_became_active":"2024-04-24T23:58:04.771411+0000","last_became_peered":"2024-04-24T23:58:04.771411+0000","last_unstale":"2024-04-24T23:58:06.778978+0000","last_undegraded":"2024-04-24T23:58:06.778978+0000","last_fullsized":"2024-04-24T23:58:06.778978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549805+0000","last_change":"2024-04-24T23:58:05.790643+0000","last_active":"2024-04-24T23:58:07.549805+0000","last_peered":"2024-04-24T23:58:07.549805+0000","last_clean":"2024-04-24T23:58:07.549805+0000","last_became_active":"2024-04-24T23:58:05.789742+0000","last_became_peered":"2024-04-24T23:58:05.789742+0000","last_unstale":"2024-04-24T23:58:07.549805+0000","last_undegraded":"2024-04-24T23:58:07.549805+0000","last_fullsized":"2024-04-24T23:58:07.549805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547503+0000","last_change":"2024-04-24T23:58:04.778586+0000","last_active":"2024-04-24T23:58:07.547503+0000","last_peered":"2024-04-24T23:58:07.547503+0000","last_clean":"2024-04-24T23:58:07.547503+0000","last_became_active":"2024-04-24T23:58:04.778296+0000","last_became_peered":"2024-04-24T23:58:04.778296+0000","last_unstale":"2024-04-24T23:58:07.547503+0000","last_undegraded":"2024-04-24T23:58:07.547503+0000","last_fullsized":"2024-04-24T23:58:07.547503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781615+0000","last_change":"2024-04-24T23:58:05.793469+0000","last_active":"2024-04-24T23:58:06.781615+0000","last_peered":"2024-04-24T23:58:06.781615+0000","last_clean":"2024-04-24T23:58:06.781615+0000","last_became_active":"2024-04-24T23:58:05.793129+0000","last_became_peered":"2024-04-24T23:58:05.793129+0000","last_unstale":"2024-04-24T23:58:06.781615+0000","last_undegraded":"2024-04-24T23:58:06.781615+0000","last_fullsized":"2024-04-24T23:58:06.781615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:23.767095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779337+0000","last_change":"2024-04-24T23:58:04.769158+0000","last_active":"2024-04-24T23:58:06.779337+0000","last_peered":"2024-04-24T23:58:06.779337+0000","last_clean":"2024-04-24T23:58:06.779337+0000","last_became_active":"2024-04-24T23:58:04.768707+0000","last_became_peered":"2024-04-24T23:58:04.768707+0000","last_unstale":"2024-04-24T23:58:06.779337+0000","last_undegraded":"2024-04-24T23:58:06.779337+0000","last_fullsized":"2024-04-24T23:58:06.779337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550571+0000","last_change":"2024-04-24T23:58:05.797038+0000","last_active":"2024-04-24T23:58:07.550571+0000","last_peered":"2024-04-24T23:58:07.550571+0000","last_clean":"2024-04-24T23:58:07.550571+0000","last_became_active":"2024-04-24T23:58:05.796524+0000","last_became_peered":"2024-04-24T23:58:05.796524+0000","last_unstale":"2024-04-24T23:58:07.550571+0000","last_undegraded":"2024-04-24T23:58:07.550571+0000","last_fullsized":"2024-04-24T23:58:07.550571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779397+0000","last_change":"2024-04-24T23:58:04.767745+0000","last_active":"2024-04-24T23:58:06.779397+0000","last_peered":"2024-04-24T23:58:06.779397+0000","last_clean":"2024-04-24T23:58:06.779397+0000","last_became_active":"2024-04-24T23:58:04.767416+0000","last_became_peered":"2024-04-24T23:58:04.767416+0000","last_unstale":"2024-04-24T23:58:06.779397+0000","last_undegraded":"2024-04-24T23:58:06.779397+0000","last_fullsized":"2024-04-24T23:58:06.779397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:47.083120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550336+0000","last_change":"2024-04-24T23:58:05.792064+0000","last_active":"2024-04-24T23:58:07.550336+0000","last_peered":"2024-04-24T23:58:07.550336+0000","last_clean":"2024-04-24T23:58:07.550336+0000","last_became_active":"2024-04-24T23:58:05.790769+0000","last_became_peered":"2024-04-24T23:58:05.790769+0000","last_unstale":"2024-04-24T23:58:07.550336+0000","last_undegraded":"2024-04-24T23:58:07.550336+0000","last_fullsized":"2024-04-24T23:58:07.550336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549106+0000","last_change":"2024-04-24T23:58:04.778697+0000","last_active":"2024-04-24T23:58:07.549106+0000","last_peered":"2024-04-24T23:58:07.549106+0000","last_clean":"2024-04-24T23:58:07.549106+0000","last_became_active":"2024-04-24T23:58:04.778416+0000","last_became_peered":"2024-04-24T23:58:04.778416+0000","last_unstale":"2024-04-24T23:58:07.549106+0000","last_undegraded":"2024-04-24T23:58:07.549106+0000","last_fullsized":"2024-04-24T23:58:07.549106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:05.846034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780654+0000","last_change":"2024-04-24T23:58:05.771222+0000","last_active":"2024-04-24T23:58:06.780654+0000","last_peered":"2024-04-24T23:58:06.780654+0000","last_clean":"2024-04-24T23:58:06.780654+0000","last_became_active":"2024-04-24T23:58:05.769336+0000","last_became_peered":"2024-04-24T23:58:05.769336+0000","last_unstale":"2024-04-24T23:58:06.780654+0000","last_undegraded":"2024-04-24T23:58:06.780654+0000","last_fullsized":"2024-04-24T23:58:06.780654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548707+0000","last_change":"2024-04-24T23:58:05.788629+0000","last_active":"2024-04-24T23:58:07.548707+0000","last_peered":"2024-04-24T23:58:07.548707+0000","last_clean":"2024-04-24T23:58:07.548707+0000","last_became_active":"2024-04-24T23:58:05.788319+0000","last_became_peered":"2024-04-24T23:58:05.788319+0000","last_unstale":"2024-04-24T23:58:07.548707+0000","last_undegraded":"2024-04-24T23:58:07.548707+0000","last_fullsized":"2024-04-24T23:58:07.548707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551482+0000","last_change":"2024-04-24T23:58:04.777211+0000","last_active":"2024-04-24T23:58:07.551482+0000","last_peered":"2024-04-24T23:58:07.551482+0000","last_clean":"2024-04-24T23:58:07.551482+0000","last_became_active":"2024-04-24T23:58:04.776698+0000","last_became_peered":"2024-04-24T23:58:04.776698+0000","last_unstale":"2024-04-24T23:58:07.551482+0000","last_undegraded":"2024-04-24T23:58:07.551482+0000","last_fullsized":"2024-04-24T23:58:07.551482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:47.083120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549778+0000","last_change":"2024-04-24T23:58:05.792287+0000","last_active":"2024-04-24T23:58:07.549778+0000","last_peered":"2024-04-24T23:58:07.549778+0000","last_clean":"2024-04-24T23:58:07.549778+0000","last_became_active":"2024-04-24T23:58:05.791111+0000","last_became_peered":"2024-04-24T23:58:05.791111+0000","last_unstale":"2024-04-24T23:58:07.549778+0000","last_undegraded":"2024-04-24T23:58:07.549778+0000","last_fullsized":"2024-04-24T23:58:07.549778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.648636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551807+0000","last_change":"2024-04-24T23:58:04.777424+0000","last_active":"2024-04-24T23:58:07.551807+0000","last_peered":"2024-04-24T23:58:07.551807+0000","last_clean":"2024-04-24T23:58:07.551807+0000","last_became_active":"2024-04-24T23:58:04.777129+0000","last_became_peered":"2024-04-24T23:58:04.777129+0000","last_unstale":"2024-04-24T23:58:07.551807+0000","last_undegraded":"2024-04-24T23:58:07.551807+0000","last_fullsized":"2024-04-24T23:58:07.551807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:42.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549197+0000","last_change":"2024-04-24T23:58:05.783822+0000","last_active":"2024-04-24T23:58:07.549197+0000","last_peered":"2024-04-24T23:58:07.549197+0000","last_clean":"2024-04-24T23:58:07.549197+0000","last_became_active":"2024-04-24T23:58:05.783517+0000","last_became_peered":"2024-04-24T23:58:05.783517+0000","last_unstale":"2024-04-24T23:58:07.549197+0000","last_undegraded":"2024-04-24T23:58:07.549197+0000","last_fullsized":"2024-04-24T23:58:07.549197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551826+0000","last_change":"2024-04-24T23:58:04.760821+0000","last_active":"2024-04-24T23:58:07.551826+0000","last_peered":"2024-04-24T23:58:07.551826+0000","last_clean":"2024-04-24T23:58:07.551826+0000","last_became_active":"2024-04-24T23:58:04.760384+0000","last_became_peered":"2024-04-24T23:58:04.760384+0000","last_unstale":"2024-04-24T23:58:07.551826+0000","last_undegraded":"2024-04-24T23:58:07.551826+0000","last_fullsized":"2024-04-24T23:58:07.551826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551776+0000","last_change":"2024-04-24T23:58:05.800284+0000","last_active":"2024-04-24T23:58:07.551776+0000","last_peered":"2024-04-24T23:58:07.551776+0000","last_clean":"2024-04-24T23:58:07.551776+0000","last_became_active":"2024-04-24T23:58:05.799756+0000","last_became_peered":"2024-04-24T23:58:05.799756+0000","last_unstale":"2024-04-24T23:58:07.551776+0000","last_undegraded":"2024-04-24T23:58:07.551776+0000","last_fullsized":"2024-04-24T23:58:07.551776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549323+0000","last_change":"2024-04-24T23:58:04.770489+0000","last_active":"2024-04-24T23:58:07.549323+0000","last_peered":"2024-04-24T23:58:07.549323+0000","last_clean":"2024-04-24T23:58:07.549323+0000","last_became_active":"2024-04-24T23:58:04.770181+0000","last_became_peered":"2024-04-24T23:58:04.770181+0000","last_unstale":"2024-04-24T23:58:07.549323+0000","last_undegraded":"2024-04-24T23:58:07.549323+0000","last_fullsized":"2024-04-24T23:58:07.549323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:44.729552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:58:15.920 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:58:16.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.159+0000 7f6ddc200640 1 Processor -- start 2024-04-24T23:58:16.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.159+0000 7f6ddc200640 1 -- start start 2024-04-24T23:58:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.160+0000 7f6ddc200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6dd415c230 0x7f6dd4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.160+0000 7f6ddc200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd40af120 0x7f6dd406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.161+0000 7f6ddc200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd4160b20 con 0x7f6dd40acda0 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.161+0000 7f6ddc200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd415c610 con 0x7f6dd415c230 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.161+0000 7f6ddc200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd40ad230 con 0x7f6dd40af120 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.161+0000 7f6dd8e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6dd40acda0 0x7f6dd40aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51052/0 (socket says 172.21.15.96:51052) 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.161+0000 7f6dd8e00640 1 -- 172.21.15.96:0/1185881707 learned_addr learned my addr 172.21.15.96:0/1185881707 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.161+0000 7f6dd9800640 1 --2- 172.21.15.96:0/1185881707 >> v2:172.21.15.155:3300/0 conn(0x7f6dd415c230 0x7f6dd4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.161+0000 7f6dda200640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd40af120 0x7f6dd406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.161+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740230668 0 0) 0x7f6dd4160b20 con 0x7f6dd40acda0 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.161+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dbc003520 con 0x7f6dd40acda0 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982530020 0 0) 0x7f6dbc003520 con 0x7f6dd40acda0 2024-04-24T23:58:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd40af120 msgr2=0x7f6dd406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd40af120 0x7f6dd406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 >> v2:172.21.15.155:3300/0 conn(0x7f6dd415c230 msgr2=0x7f6dd4071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 --2- 172.21.15.96:0/1185881707 >> v2:172.21.15.155:3300/0 conn(0x7f6dd415c230 0x7f6dd4071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd415fd60 con 0x7f6dd40acda0 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f6dc0001670 con 0x7f6dd40acda0 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 >> v1:172.21.15.96:6789/0 conn(0x7f6dd40acda0 legacy=0x7f6dd40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0039b0 0x7f6dbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dbc004800 0x7f6dbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd40af120 0x7f6dbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd415c610 con 0x7f6dbc0039b0 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd40ad230 con 0x7f6dbc004800 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6dbc00b9c0 con 0x7f6dd40af120 2024-04-24T23:58:16.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd9800640 1 --2- 172.21.15.96:0/1185881707 >> v2:172.21.15.155:3300/0 conn(0x7f6dd415c230 0x7f6dd4071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd9800640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0039b0 0x7f6dbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dda200640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd40af120 0x7f6dbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.162+0000 7f6dd8e00640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dbc004800 0x7f6dbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.163+0000 7f6dd9800640 1 -- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd40af120 msgr2=0x7f6dbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.163+0000 7f6dd9800640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd40af120 0x7f6dbc0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.163+0000 7f6dd9800640 1 -- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dbc004800 msgr2=0x7f6dbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.163+0000 7f6dd9800640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dbc004800 0x7f6dbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.163+0000 7f6dd9800640 1 -- 172.21.15.96:0/1185881707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dbc003520 con 0x7f6dbc0039b0 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.163+0000 7f6dd8e00640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dbc004800 0x7f6dbc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.163+0000 7f6dd9800640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0039b0 0x7f6dbc003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009c70 tx=0x7f6dbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac56a9f52a083dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8009840 con 0x7f6dbc0039b0 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8004020 con 0x7f6dbc0039b0 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6dd3e00640 1 -- 172.21.15.96:0/1185881707 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80043d0 con 0x7f6dbc0039b0 2024-04-24T23:58:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6ddc200640 1 -- 172.21.15.96:0/1185881707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0039b0 msgr2=0x7f6dbc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6ddc200640 1 --2- 172.21.15.96:0/1185881707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0039b0 0x7f6dbc003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009c70 tx=0x7f6dbc005830 comp rx=0 tx=0).stop 2024-04-24T23:58:16.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6dda200640 1 -- 172.21.15.96:0/1185881707 reap_dead start 2024-04-24T23:58:16.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6ddc200640 1 -- 172.21.15.96:0/1185881707 shutdown_connections 2024-04-24T23:58:16.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6ddc200640 1 -- 172.21.15.96:0/1185881707 >> 172.21.15.96:0/1185881707 conn(0x7f6dd40b19c0 msgr2=0x7f6dd40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:16.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6ddc200640 1 -- 172.21.15.96:0/1185881707 shutdown_connections 2024-04-24T23:58:16.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.164+0000 7f6ddc200640 1 -- 172.21.15.96:0/1185881707 wait complete. 2024-04-24T23:58:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.166+0000 7f6ddc200640 1 Processor -- start 2024-04-24T23:58:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.166+0000 7f6ddc200640 1 -- start start 2024-04-24T23:58:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.167+0000 7f6ddc200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dbc0039b0 0x7f6dd4151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.167+0000 7f6ddc200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4152470 0x7f6dd415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.167+0000 7f6ddc200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd41529c0 0x7f6dd415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.167+0000 7f6ddc200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4160600 con 0x7f6dd4152470 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.167+0000 7f6ddc200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4160320 con 0x7f6dd41529c0 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.167+0000 7f6ddc200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd40ad4d0 con 0x7f6dbc0039b0 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.167+0000 7f6dd8e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4152470 0x7f6dd415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.167+0000 7f6dd8e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4152470 0x7f6dd415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59238/0 (socket says 172.21.15.96:59238) 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.167+0000 7f6dd8e00640 1 -- 172.21.15.96:0/2169051719 learned_addr learned my addr 172.21.15.96:0/2169051719 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dda200640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd41529c0 0x7f6dd415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd9800640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dbc0039b0 0x7f6dd4151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd8e00640 1 -- 172.21.15.96:0/2169051719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dbc0039b0 msgr2=0x7f6dd4151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd8e00640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dbc0039b0 0x7f6dd4151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd8e00640 1 -- 172.21.15.96:0/2169051719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd41529c0 msgr2=0x7f6dd415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd8e00640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd41529c0 0x7f6dd415f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd8e00640 1 -- 172.21.15.96:0/2169051719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd409ada0 con 0x7f6dd4152470 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd8e00640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4152470 0x7f6dd415ec90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000d7f0 tx=0x7f6dc000dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd1600640 1 -- 172.21.15.96:0/2169051719 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0019070 con 0x7f6dd4152470 2024-04-24T23:58:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd1600640 1 -- 172.21.15.96:0/2169051719 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc00072d0 con 0x7f6dd4152470 2024-04-24T23:58:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6dd1600640 1 -- 172.21.15.96:0/2169051719 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00047e0 con 0x7f6dd4152470 2024-04-24T23:58:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.168+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd409b080 con 0x7f6dd4152470 2024-04-24T23:58:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.169+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd409b640 con 0x7f6dd4152470 2024-04-24T23:58:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.170+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd4069110 con 0x7f6dd4152470 2024-04-24T23:58:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.170+0000 7f6dd1600640 1 -- 172.21.15.96:0/2169051719 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6dc001c070 con 0x7f6dd4152470 2024-04-24T23:58:16.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.171+0000 7f6dd1600640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6db406be60 0x7f6db406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.171+0000 7f6dd1600640 1 -- 172.21.15.96:0/2169051719 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6dc008a9e0 con 0x7f6dd4152470 2024-04-24T23:58:16.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.171+0000 7f6dd9800640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6db406be60 0x7f6db406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.172+0000 7f6dd9800640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6db406be60 0x7f6db406e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8032000 tx=0x7f6dc8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:16.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.176+0000 7f6dd1600640 1 -- 172.21.15.96:0/2169051719 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6dc0059390 con 0x7f6dd4152470 2024-04-24T23:58:16.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.359+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6dd40b08d0 con 0x7f6db406be60 2024-04-24T23:58:16.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.377+0000 7f6dd1600640 1 -- 172.21.15.96:0/2169051719 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f6dd40b08d0 con 0x7f6db406be60 2024-04-24T23:58:16.381 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:16.382 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-24T23:58:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6db406be60 msgr2=0x7f6db406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6db406be60 0x7f6db406e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8032000 tx=0x7f6dc8008030 comp rx=0 tx=0).stop 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4152470 msgr2=0x7f6dd415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4152470 0x7f6dd415ec90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000d7f0 tx=0x7f6dc000dcb0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 shutdown_connections 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd41529c0 0x7f6dd415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6db406be60 0x7f6db406e320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4152470 0x7f6dd415ec90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 --2- 172.21.15.96:0/2169051719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dbc0039b0 0x7f6dd4151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 >> 172.21.15.96:0/2169051719 conn(0x7f6dd40b19c0 msgr2=0x7f6dd40af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 shutdown_connections 2024-04-24T23:58:16.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.383+0000 7f6ddc200640 1 -- 172.21.15.96:0/2169051719 wait complete. 2024-04-24T23:58:16.400 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-24T23:58:16.303505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003063"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552582+0000","last_change":"2024-04-24T23:58:05.798222+0000","last_active":"2024-04-24T23:58:07.552582+0000","last_peered":"2024-04-24T23:58:07.552582+0000","last_clean":"2024-04-24T23:58:07.552582+0000","last_became_active":"2024-04-24T23:58:05.797677+0000","last_became_peered":"2024-04-24T23:58:05.797677+0000","last_unstale":"2024-04-24T23:58:07.552582+0000","last_undegraded":"2024-04-24T23:58:07.552582+0000","last_fullsized":"2024-04-24T23:58:07.552582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:52.401878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779963+0000","last_change":"2024-04-24T23:58:05.795987+0000","last_active":"2024-04-24T23:58:06.779963+0000","last_peered":"2024-04-24T23:58:06.779963+0000","last_clean":"2024-04-24T23:58:06.779963+0000","last_became_active":"2024-04-24T23:58:05.794693+0000","last_became_peered":"2024-04-24T23:58:05.794693+0000","last_unstale":"2024-04-24T23:58:06.779963+0000","last_undegraded":"2024-04-24T23:58:06.779963+0000","last_fullsized":"2024-04-24T23:58:06.779963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549565+0000","last_change":"2024-04-24T23:58:05.792670+0000","last_active":"2024-04-24T23:58:07.549565+0000","last_peered":"2024-04-24T23:58:07.549565+0000","last_clean":"2024-04-24T23:58:07.549565+0000","last_became_active":"2024-04-24T23:58:05.792250+0000","last_became_peered":"2024-04-24T23:58:05.792250+0000","last_unstale":"2024-04-24T23:58:07.549565+0000","last_undegraded":"2024-04-24T23:58:07.549565+0000","last_fullsized":"2024-04-24T23:58:07.549565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549094+0000","last_change":"2024-04-24T23:58:05.797139+0000","last_active":"2024-04-24T23:58:07.549094+0000","last_peered":"2024-04-24T23:58:07.549094+0000","last_clean":"2024-04-24T23:58:07.549094+0000","last_became_active":"2024-04-24T23:58:05.796582+0000","last_became_peered":"2024-04-24T23:58:05.796582+0000","last_unstale":"2024-04-24T23:58:07.549094+0000","last_undegraded":"2024-04-24T23:58:07.549094+0000","last_fullsized":"2024-04-24T23:58:07.549094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:00.726837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548416+0000","last_change":"2024-04-24T23:58:05.800388+0000","last_active":"2024-04-24T23:58:07.548416+0000","last_peered":"2024-04-24T23:58:07.548416+0000","last_clean":"2024-04-24T23:58:07.548416+0000","last_became_active":"2024-04-24T23:58:05.799461+0000","last_became_peered":"2024-04-24T23:58:05.799461+0000","last_unstale":"2024-04-24T23:58:07.548416+0000","last_undegraded":"2024-04-24T23:58:07.548416+0000","last_fullsized":"2024-04-24T23:58:07.548416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548380+0000","last_change":"2024-04-24T23:58:05.790511+0000","last_active":"2024-04-24T23:58:07.548380+0000","last_peered":"2024-04-24T23:58:07.548380+0000","last_clean":"2024-04-24T23:58:07.548380+0000","last_became_active":"2024-04-24T23:58:05.790204+0000","last_became_peered":"2024-04-24T23:58:05.790204+0000","last_unstale":"2024-04-24T23:58:07.548380+0000","last_undegraded":"2024-04-24T23:58:07.548380+0000","last_fullsized":"2024-04-24T23:58:07.548380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549559+0000","last_change":"2024-04-24T23:58:05.803344+0000","last_active":"2024-04-24T23:58:07.549559+0000","last_peered":"2024-04-24T23:58:07.549559+0000","last_clean":"2024-04-24T23:58:07.549559+0000","last_became_active":"2024-04-24T23:58:05.802869+0000","last_became_peered":"2024-04-24T23:58:05.802869+0000","last_unstale":"2024-04-24T23:58:07.549559+0000","last_undegraded":"2024-04-24T23:58:07.549559+0000","last_fullsized":"2024-04-24T23:58:07.549559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548557+0000","last_change":"2024-04-24T23:58:05.796780+0000","last_active":"2024-04-24T23:58:07.548557+0000","last_peered":"2024-04-24T23:58:07.548557+0000","last_clean":"2024-04-24T23:58:07.548557+0000","last_became_active":"2024-04-24T23:58:05.796123+0000","last_became_peered":"2024-04-24T23:58:05.796123+0000","last_unstale":"2024-04-24T23:58:07.548557+0000","last_undegraded":"2024-04-24T23:58:07.548557+0000","last_fullsized":"2024-04-24T23:58:07.548557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552618+0000","last_change":"2024-04-24T23:58:05.798676+0000","last_active":"2024-04-24T23:58:07.552618+0000","last_peered":"2024-04-24T23:58:07.552618+0000","last_clean":"2024-04-24T23:58:07.552618+0000","last_became_active":"2024-04-24T23:58:05.798460+0000","last_became_peered":"2024-04-24T23:58:05.798460+0000","last_unstale":"2024-04-24T23:58:07.552618+0000","last_undegraded":"2024-04-24T23:58:07.552618+0000","last_fullsized":"2024-04-24T23:58:07.552618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:42.009820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780359+0000","last_change":"2024-04-24T23:58:05.790270+0000","last_active":"2024-04-24T23:58:06.780359+0000","last_peered":"2024-04-24T23:58:06.780359+0000","last_clean":"2024-04-24T23:58:06.780359+0000","last_became_active":"2024-04-24T23:58:05.789979+0000","last_became_peered":"2024-04-24T23:58:05.789979+0000","last_unstale":"2024-04-24T23:58:06.780359+0000","last_undegraded":"2024-04-24T23:58:06.780359+0000","last_fullsized":"2024-04-24T23:58:06.780359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781124+0000","last_change":"2024-04-24T23:58:05.793710+0000","last_active":"2024-04-24T23:58:06.781124+0000","last_peered":"2024-04-24T23:58:06.781124+0000","last_clean":"2024-04-24T23:58:06.781124+0000","last_became_active":"2024-04-24T23:58:05.793402+0000","last_became_peered":"2024-04-24T23:58:05.793402+0000","last_unstale":"2024-04-24T23:58:06.781124+0000","last_undegraded":"2024-04-24T23:58:06.781124+0000","last_fullsized":"2024-04-24T23:58:06.781124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782467+0000","last_change":"2024-04-24T23:58:05.768478+0000","last_active":"2024-04-24T23:58:06.782467+0000","last_peered":"2024-04-24T23:58:06.782467+0000","last_clean":"2024-04-24T23:58:06.782467+0000","last_became_active":"2024-04-24T23:58:05.768060+0000","last_became_peered":"2024-04-24T23:58:05.768060+0000","last_unstale":"2024-04-24T23:58:06.782467+0000","last_undegraded":"2024-04-24T23:58:06.782467+0000","last_fullsized":"2024-04-24T23:58:06.782467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:45.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550107+0000","last_change":"2024-04-24T23:58:05.801426+0000","last_active":"2024-04-24T23:58:07.550107+0000","last_peered":"2024-04-24T23:58:07.550107+0000","last_clean":"2024-04-24T23:58:07.550107+0000","last_became_active":"2024-04-24T23:58:05.801082+0000","last_became_peered":"2024-04-24T23:58:05.801082+0000","last_unstale":"2024-04-24T23:58:07.550107+0000","last_undegraded":"2024-04-24T23:58:07.550107+0000","last_fullsized":"2024-04-24T23:58:07.550107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548534+0000","last_change":"2024-04-24T23:58:05.790329+0000","last_active":"2024-04-24T23:58:07.548534+0000","last_peered":"2024-04-24T23:58:07.548534+0000","last_clean":"2024-04-24T23:58:07.548534+0000","last_became_active":"2024-04-24T23:58:05.787856+0000","last_became_peered":"2024-04-24T23:58:05.787856+0000","last_unstale":"2024-04-24T23:58:07.548534+0000","last_undegraded":"2024-04-24T23:58:07.548534+0000","last_fullsized":"2024-04-24T23:58:07.548534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:18.652571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779257+0000","last_change":"2024-04-24T23:58:05.784612+0000","last_active":"2024-04-24T23:58:06.779257+0000","last_peered":"2024-04-24T23:58:06.779257+0000","last_clean":"2024-04-24T23:58:06.779257+0000","last_became_active":"2024-04-24T23:58:05.784318+0000","last_became_peered":"2024-04-24T23:58:05.784318+0000","last_unstale":"2024-04-24T23:58:06.779257+0000","last_undegraded":"2024-04-24T23:58:06.779257+0000","last_fullsized":"2024-04-24T23:58:06.779257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547845+0000","last_change":"2024-04-24T23:58:05.802993+0000","last_active":"2024-04-24T23:58:07.547845+0000","last_peered":"2024-04-24T23:58:07.547845+0000","last_clean":"2024-04-24T23:58:07.547845+0000","last_became_active":"2024-04-24T23:58:05.802728+0000","last_became_peered":"2024-04-24T23:58:05.802728+0000","last_unstale":"2024-04-24T23:58:07.547845+0000","last_undegraded":"2024-04-24T23:58:07.547845+0000","last_fullsized":"2024-04-24T23:58:07.547845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550212+0000","last_change":"2024-04-24T23:58:05.804677+0000","last_active":"2024-04-24T23:58:07.550212+0000","last_peered":"2024-04-24T23:58:07.550212+0000","last_clean":"2024-04-24T23:58:07.550212+0000","last_became_active":"2024-04-24T23:58:05.804348+0000","last_became_peered":"2024-04-24T23:58:05.804348+0000","last_unstale":"2024-04-24T23:58:07.550212+0000","last_undegraded":"2024-04-24T23:58:07.550212+0000","last_fullsized":"2024-04-24T23:58:07.550212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:52.401878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549898+0000","last_change":"2024-04-24T23:58:05.791215+0000","last_active":"2024-04-24T23:58:07.549898+0000","last_peered":"2024-04-24T23:58:07.549898+0000","last_clean":"2024-04-24T23:58:07.549898+0000","last_became_active":"2024-04-24T23:58:05.790911+0000","last_became_peered":"2024-04-24T23:58:05.790911+0000","last_unstale":"2024-04-24T23:58:07.549898+0000","last_undegraded":"2024-04-24T23:58:07.549898+0000","last_fullsized":"2024-04-24T23:58:07.549898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:06.860406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552329+0000","last_change":"2024-04-24T23:58:05.799646+0000","last_active":"2024-04-24T23:58:07.552329+0000","last_peered":"2024-04-24T23:58:07.552329+0000","last_clean":"2024-04-24T23:58:07.552329+0000","last_became_active":"2024-04-24T23:58:05.799361+0000","last_became_peered":"2024-04-24T23:58:05.799361+0000","last_unstale":"2024-04-24T23:58:07.552329+0000","last_undegraded":"2024-04-24T23:58:07.552329+0000","last_fullsized":"2024-04-24T23:58:07.552329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:12.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779220+0000","last_change":"2024-04-24T23:58:05.772550+0000","last_active":"2024-04-24T23:58:06.779220+0000","last_peered":"2024-04-24T23:58:06.779220+0000","last_clean":"2024-04-24T23:58:06.779220+0000","last_became_active":"2024-04-24T23:58:05.772271+0000","last_became_peered":"2024-04-24T23:58:05.772271+0000","last_unstale":"2024-04-24T23:58:06.779220+0000","last_undegraded":"2024-04-24T23:58:06.779220+0000","last_fullsized":"2024-04-24T23:58:06.779220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548310+0000","last_change":"2024-04-24T23:58:05.787389+0000","last_active":"2024-04-24T23:58:07.548310+0000","last_peered":"2024-04-24T23:58:07.548310+0000","last_clean":"2024-04-24T23:58:07.548310+0000","last_became_active":"2024-04-24T23:58:05.786872+0000","last_became_peered":"2024-04-24T23:58:05.786872+0000","last_unstale":"2024-04-24T23:58:07.548310+0000","last_undegraded":"2024-04-24T23:58:07.548310+0000","last_fullsized":"2024-04-24T23:58:07.548310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:31.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548638+0000","last_change":"2024-04-24T23:58:05.798911+0000","last_active":"2024-04-24T23:58:07.548638+0000","last_peered":"2024-04-24T23:58:07.548638+0000","last_clean":"2024-04-24T23:58:07.548638+0000","last_became_active":"2024-04-24T23:58:05.798629+0000","last_became_peered":"2024-04-24T23:58:05.798629+0000","last_unstale":"2024-04-24T23:58:07.548638+0000","last_undegraded":"2024-04-24T23:58:07.548638+0000","last_fullsized":"2024-04-24T23:58:07.548638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551279+0000","last_change":"2024-04-24T23:58:05.788291+0000","last_active":"2024-04-24T23:58:07.551279+0000","last_peered":"2024-04-24T23:58:07.551279+0000","last_clean":"2024-04-24T23:58:07.551279+0000","last_became_active":"2024-04-24T23:58:05.787971+0000","last_became_peered":"2024-04-24T23:58:05.787971+0000","last_unstale":"2024-04-24T23:58:07.551279+0000","last_undegraded":"2024-04-24T23:58:07.551279+0000","last_fullsized":"2024-04-24T23:58:07.551279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548331+0000","last_change":"2024-04-24T23:58:05.786883+0000","last_active":"2024-04-24T23:58:07.548331+0000","last_peered":"2024-04-24T23:58:07.548331+0000","last_clean":"2024-04-24T23:58:07.548331+0000","last_became_active":"2024-04-24T23:58:05.786637+0000","last_became_peered":"2024-04-24T23:58:05.786637+0000","last_unstale":"2024-04-24T23:58:07.548331+0000","last_undegraded":"2024-04-24T23:58:07.548331+0000","last_fullsized":"2024-04-24T23:58:07.548331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552055+0000","last_change":"2024-04-24T23:58:05.797334+0000","last_active":"2024-04-24T23:58:07.552055+0000","last_peered":"2024-04-24T23:58:07.552055+0000","last_clean":"2024-04-24T23:58:07.552055+0000","last_became_active":"2024-04-24T23:58:05.797038+0000","last_became_peered":"2024-04-24T23:58:05.797038+0000","last_unstale":"2024-04-24T23:58:07.552055+0000","last_undegraded":"2024-04-24T23:58:07.552055+0000","last_fullsized":"2024-04-24T23:58:07.552055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780792+0000","last_change":"2024-04-24T23:58:05.786537+0000","last_active":"2024-04-24T23:58:06.780792+0000","last_peered":"2024-04-24T23:58:06.780792+0000","last_clean":"2024-04-24T23:58:06.780792+0000","last_became_active":"2024-04-24T23:58:05.780787+0000","last_became_peered":"2024-04-24T23:58:05.780787+0000","last_unstale":"2024-04-24T23:58:06.780792+0000","last_undegraded":"2024-04-24T23:58:06.780792+0000","last_fullsized":"2024-04-24T23:58:06.780792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780454+0000","last_change":"2024-04-24T23:58:05.797680+0000","last_active":"2024-04-24T23:58:06.780454+0000","last_peered":"2024-04-24T23:58:06.780454+0000","last_clean":"2024-04-24T23:58:06.780454+0000","last_became_active":"2024-04-24T23:58:05.796878+0000","last_became_peered":"2024-04-24T23:58:05.796878+0000","last_unstale":"2024-04-24T23:58:06.780454+0000","last_undegraded":"2024-04-24T23:58:06.780454+0000","last_fullsized":"2024-04-24T23:58:06.780454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:49.580420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551634+0000","last_change":"2024-04-24T23:58:05.794457+0000","last_active":"2024-04-24T23:58:07.551634+0000","last_peered":"2024-04-24T23:58:07.551634+0000","last_clean":"2024-04-24T23:58:07.551634+0000","last_became_active":"2024-04-24T23:58:05.794121+0000","last_became_peered":"2024-04-24T23:58:05.794121+0000","last_unstale":"2024-04-24T23:58:07.551634+0000","last_undegraded":"2024-04-24T23:58:07.551634+0000","last_fullsized":"2024-04-24T23:58:07.551634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:02:47.437167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548655+0000","last_change":"2024-04-24T23:58:05.787183+0000","last_active":"2024-04-24T23:58:07.548655+0000","last_peered":"2024-04-24T23:58:07.548655+0000","last_clean":"2024-04-24T23:58:07.548655+0000","last_became_active":"2024-04-24T23:58:05.786561+0000","last_became_peered":"2024-04-24T23:58:05.786561+0000","last_unstale":"2024-04-24T23:58:07.548655+0000","last_undegraded":"2024-04-24T23:58:07.548655+0000","last_fullsized":"2024-04-24T23:58:07.548655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:20.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548872+0000","last_change":"2024-04-24T23:58:05.785799+0000","last_active":"2024-04-24T23:58:07.548872+0000","last_peered":"2024-04-24T23:58:07.548872+0000","last_clean":"2024-04-24T23:58:07.548872+0000","last_became_active":"2024-04-24T23:58:05.785513+0000","last_became_peered":"2024-04-24T23:58:05.785513+0000","last_unstale":"2024-04-24T23:58:07.548872+0000","last_undegraded":"2024-04-24T23:58:07.548872+0000","last_fullsized":"2024-04-24T23:58:07.548872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549958+0000","last_change":"2024-04-24T23:58:05.786627+0000","last_active":"2024-04-24T23:58:07.549958+0000","last_peered":"2024-04-24T23:58:07.549958+0000","last_clean":"2024-04-24T23:58:07.549958+0000","last_became_active":"2024-04-24T23:58:05.786354+0000","last_became_peered":"2024-04-24T23:58:05.786354+0000","last_unstale":"2024-04-24T23:58:07.549958+0000","last_undegraded":"2024-04-24T23:58:07.549958+0000","last_fullsized":"2024-04-24T23:58:07.549958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:43.209580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778470+0000","last_change":"2024-04-24T23:58:05.774049+0000","last_active":"2024-04-24T23:58:06.778470+0000","last_peered":"2024-04-24T23:58:06.778470+0000","last_clean":"2024-04-24T23:58:06.778470+0000","last_became_active":"2024-04-24T23:58:05.773704+0000","last_became_peered":"2024-04-24T23:58:05.773704+0000","last_unstale":"2024-04-24T23:58:06.778470+0000","last_undegraded":"2024-04-24T23:58:06.778470+0000","last_fullsized":"2024-04-24T23:58:06.778470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:20.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781658+0000","last_change":"2024-04-24T23:58:05.790510+0000","last_active":"2024-04-24T23:58:06.781658+0000","last_peered":"2024-04-24T23:58:06.781658+0000","last_clean":"2024-04-24T23:58:06.781658+0000","last_became_active":"2024-04-24T23:58:05.790154+0000","last_became_peered":"2024-04-24T23:58:05.790154+0000","last_unstale":"2024-04-24T23:58:06.781658+0000","last_undegraded":"2024-04-24T23:58:06.781658+0000","last_fullsized":"2024-04-24T23:58:06.781658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:19.886869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550429+0000","last_change":"2024-04-24T23:58:04.771651+0000","last_active":"2024-04-24T23:58:07.550429+0000","last_peered":"2024-04-24T23:58:07.550429+0000","last_clean":"2024-04-24T23:58:07.550429+0000","last_became_active":"2024-04-24T23:58:04.771304+0000","last_became_peered":"2024-04-24T23:58:04.771304+0000","last_unstale":"2024-04-24T23:58:07.550429+0000","last_undegraded":"2024-04-24T23:58:07.550429+0000","last_fullsized":"2024-04-24T23:58:07.550429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548744+0000","last_change":"2024-04-24T23:58:05.770296+0000","last_active":"2024-04-24T23:58:07.548744+0000","last_peered":"2024-04-24T23:58:07.548744+0000","last_clean":"2024-04-24T23:58:07.548744+0000","last_became_active":"2024-04-24T23:58:05.769888+0000","last_became_peered":"2024-04-24T23:58:05.769888+0000","last_unstale":"2024-04-24T23:58:07.548744+0000","last_undegraded":"2024-04-24T23:58:07.548744+0000","last_fullsized":"2024-04-24T23:58:07.548744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:56.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780802+0000","last_change":"2024-04-24T23:58:04.776522+0000","last_active":"2024-04-24T23:58:06.780802+0000","last_peered":"2024-04-24T23:58:06.780802+0000","last_clean":"2024-04-24T23:58:06.780802+0000","last_became_active":"2024-04-24T23:58:04.776214+0000","last_became_peered":"2024-04-24T23:58:04.776214+0000","last_unstale":"2024-04-24T23:58:06.780802+0000","last_undegraded":"2024-04-24T23:58:06.780802+0000","last_fullsized":"2024-04-24T23:58:06.780802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551072+0000","last_change":"2024-04-24T23:58:04.763540+0000","last_active":"2024-04-24T23:58:07.551072+0000","last_peered":"2024-04-24T23:58:07.551072+0000","last_clean":"2024-04-24T23:58:07.551072+0000","last_became_active":"2024-04-24T23:58:04.763262+0000","last_became_peered":"2024-04-24T23:58:04.763262+0000","last_unstale":"2024-04-24T23:58:07.551072+0000","last_undegraded":"2024-04-24T23:58:07.551072+0000","last_fullsized":"2024-04-24T23:58:07.551072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:33.619150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550335+0000","last_change":"2024-04-24T23:58:05.803405+0000","last_active":"2024-04-24T23:58:07.550335+0000","last_peered":"2024-04-24T23:58:07.550335+0000","last_clean":"2024-04-24T23:58:07.550335+0000","last_became_active":"2024-04-24T23:58:05.802932+0000","last_became_peered":"2024-04-24T23:58:05.802932+0000","last_unstale":"2024-04-24T23:58:07.550335+0000","last_undegraded":"2024-04-24T23:58:07.550335+0000","last_fullsized":"2024-04-24T23:58:07.550335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548491+0000","last_change":"2024-04-24T23:58:04.776492+0000","last_active":"2024-04-24T23:58:07.548491+0000","last_peered":"2024-04-24T23:58:07.548491+0000","last_clean":"2024-04-24T23:58:07.548491+0000","last_became_active":"2024-04-24T23:58:04.776141+0000","last_became_peered":"2024-04-24T23:58:04.776141+0000","last_unstale":"2024-04-24T23:58:07.548491+0000","last_undegraded":"2024-04-24T23:58:07.548491+0000","last_fullsized":"2024-04-24T23:58:07.548491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779315+0000","last_change":"2024-04-24T23:58:05.784472+0000","last_active":"2024-04-24T23:58:06.779315+0000","last_peered":"2024-04-24T23:58:06.779315+0000","last_clean":"2024-04-24T23:58:06.779315+0000","last_became_active":"2024-04-24T23:58:05.784189+0000","last_became_peered":"2024-04-24T23:58:05.784189+0000","last_unstale":"2024-04-24T23:58:06.779315+0000","last_undegraded":"2024-04-24T23:58:06.779315+0000","last_fullsized":"2024-04-24T23:58:06.779315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778959+0000","last_change":"2024-04-24T23:58:04.770884+0000","last_active":"2024-04-24T23:58:06.778959+0000","last_peered":"2024-04-24T23:58:06.778959+0000","last_clean":"2024-04-24T23:58:06.778959+0000","last_became_active":"2024-04-24T23:58:04.770285+0000","last_became_peered":"2024-04-24T23:58:04.770285+0000","last_unstale":"2024-04-24T23:58:06.778959+0000","last_undegraded":"2024-04-24T23:58:06.778959+0000","last_fullsized":"2024-04-24T23:58:06.778959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548778+0000","last_change":"2024-04-24T23:58:05.784538+0000","last_active":"2024-04-24T23:58:07.548778+0000","last_peered":"2024-04-24T23:58:07.548778+0000","last_clean":"2024-04-24T23:58:07.548778+0000","last_became_active":"2024-04-24T23:58:05.784301+0000","last_became_peered":"2024-04-24T23:58:05.784301+0000","last_unstale":"2024-04-24T23:58:07.548778+0000","last_undegraded":"2024-04-24T23:58:07.548778+0000","last_fullsized":"2024-04-24T23:58:07.548778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:33.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548917+0000","last_change":"2024-04-24T23:58:04.769622+0000","last_active":"2024-04-24T23:58:07.548917+0000","last_peered":"2024-04-24T23:58:07.548917+0000","last_clean":"2024-04-24T23:58:07.548917+0000","last_became_active":"2024-04-24T23:58:04.769264+0000","last_became_peered":"2024-04-24T23:58:04.769264+0000","last_unstale":"2024-04-24T23:58:07.548917+0000","last_undegraded":"2024-04-24T23:58:07.548917+0000","last_fullsized":"2024-04-24T23:58:07.548917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549427+0000","last_change":"2024-04-24T23:58:05.785033+0000","last_active":"2024-04-24T23:58:07.549427+0000","last_peered":"2024-04-24T23:58:07.549427+0000","last_clean":"2024-04-24T23:58:07.549427+0000","last_became_active":"2024-04-24T23:58:05.784760+0000","last_became_peered":"2024-04-24T23:58:05.784760+0000","last_unstale":"2024-04-24T23:58:07.549427+0000","last_undegraded":"2024-04-24T23:58:07.549427+0000","last_fullsized":"2024-04-24T23:58:07.549427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779774+0000","last_change":"2024-04-24T23:58:04.770638+0000","last_active":"2024-04-24T23:58:06.779774+0000","last_peered":"2024-04-24T23:58:06.779774+0000","last_clean":"2024-04-24T23:58:06.779774+0000","last_became_active":"2024-04-24T23:58:04.770332+0000","last_became_peered":"2024-04-24T23:58:04.770332+0000","last_unstale":"2024-04-24T23:58:06.779774+0000","last_undegraded":"2024-04-24T23:58:06.779774+0000","last_fullsized":"2024-04-24T23:58:06.779774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782618+0000","last_change":"2024-04-24T23:58:05.786124+0000","last_active":"2024-04-24T23:58:06.782618+0000","last_peered":"2024-04-24T23:58:06.782618+0000","last_clean":"2024-04-24T23:58:06.782618+0000","last_became_active":"2024-04-24T23:58:05.785737+0000","last_became_peered":"2024-04-24T23:58:05.785737+0000","last_unstale":"2024-04-24T23:58:06.782618+0000","last_undegraded":"2024-04-24T23:58:06.782618+0000","last_fullsized":"2024-04-24T23:58:06.782618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:48.097493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779149+0000","last_change":"2024-04-24T23:58:04.759666+0000","last_active":"2024-04-24T23:58:06.779149+0000","last_peered":"2024-04-24T23:58:06.779149+0000","last_clean":"2024-04-24T23:58:06.779149+0000","last_became_active":"2024-04-24T23:58:04.759342+0000","last_became_peered":"2024-04-24T23:58:04.759342+0000","last_unstale":"2024-04-24T23:58:06.779149+0000","last_undegraded":"2024-04-24T23:58:06.779149+0000","last_fullsized":"2024-04-24T23:58:06.779149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551828+0000","last_change":"2024-04-24T23:58:05.793926+0000","last_active":"2024-04-24T23:58:07.551828+0000","last_peered":"2024-04-24T23:58:07.551828+0000","last_clean":"2024-04-24T23:58:07.551828+0000","last_became_active":"2024-04-24T23:58:05.792484+0000","last_became_peered":"2024-04-24T23:58:05.792484+0000","last_unstale":"2024-04-24T23:58:07.551828+0000","last_undegraded":"2024-04-24T23:58:07.551828+0000","last_fullsized":"2024-04-24T23:58:07.551828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:11.381479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548797+0000","last_change":"2024-04-24T23:58:04.776767+0000","last_active":"2024-04-24T23:58:07.548797+0000","last_peered":"2024-04-24T23:58:07.548797+0000","last_clean":"2024-04-24T23:58:07.548797+0000","last_became_active":"2024-04-24T23:58:04.776452+0000","last_became_peered":"2024-04-24T23:58:04.776452+0000","last_unstale":"2024-04-24T23:58:07.548797+0000","last_undegraded":"2024-04-24T23:58:07.548797+0000","last_fullsized":"2024-04-24T23:58:07.548797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:07:03.630911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549293+0000","last_change":"2024-04-24T23:58:05.790152+0000","last_active":"2024-04-24T23:58:07.549293+0000","last_peered":"2024-04-24T23:58:07.549293+0000","last_clean":"2024-04-24T23:58:07.549293+0000","last_became_active":"2024-04-24T23:58:05.789858+0000","last_became_peered":"2024-04-24T23:58:05.789858+0000","last_unstale":"2024-04-24T23:58:07.549293+0000","last_undegraded":"2024-04-24T23:58:07.549293+0000","last_fullsized":"2024-04-24T23:58:07.549293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548956+0000","last_change":"2024-04-24T23:58:04.771292+0000","last_active":"2024-04-24T23:58:07.548956+0000","last_peered":"2024-04-24T23:58:07.548956+0000","last_clean":"2024-04-24T23:58:07.548956+0000","last_became_active":"2024-04-24T23:58:04.770724+0000","last_became_peered":"2024-04-24T23:58:04.770724+0000","last_unstale":"2024-04-24T23:58:07.548956+0000","last_undegraded":"2024-04-24T23:58:07.548956+0000","last_fullsized":"2024-04-24T23:58:07.548956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548794+0000","last_change":"2024-04-24T23:58:05.802304+0000","last_active":"2024-04-24T23:58:07.548794+0000","last_peered":"2024-04-24T23:58:07.548794+0000","last_clean":"2024-04-24T23:58:07.548794+0000","last_became_active":"2024-04-24T23:58:05.799845+0000","last_became_peered":"2024-04-24T23:58:05.799845+0000","last_unstale":"2024-04-24T23:58:07.548794+0000","last_undegraded":"2024-04-24T23:58:07.548794+0000","last_fullsized":"2024-04-24T23:58:07.548794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778378+0000","last_change":"2024-04-24T23:58:04.765718+0000","last_active":"2024-04-24T23:58:06.778378+0000","last_peered":"2024-04-24T23:58:06.778378+0000","last_clean":"2024-04-24T23:58:06.778378+0000","last_became_active":"2024-04-24T23:58:04.765445+0000","last_became_peered":"2024-04-24T23:58:04.765445+0000","last_unstale":"2024-04-24T23:58:06.778378+0000","last_undegraded":"2024-04-24T23:58:06.778378+0000","last_fullsized":"2024-04-24T23:58:06.778378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780131+0000","last_change":"2024-04-24T23:58:05.775138+0000","last_active":"2024-04-24T23:58:06.780131+0000","last_peered":"2024-04-24T23:58:06.780131+0000","last_clean":"2024-04-24T23:58:06.780131+0000","last_became_active":"2024-04-24T23:58:05.774820+0000","last_became_peered":"2024-04-24T23:58:05.774820+0000","last_unstale":"2024-04-24T23:58:06.780131+0000","last_undegraded":"2024-04-24T23:58:06.780131+0000","last_fullsized":"2024-04-24T23:58:06.780131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547528+0000","last_change":"2024-04-24T23:58:04.756238+0000","last_active":"2024-04-24T23:58:07.547528+0000","last_peered":"2024-04-24T23:58:07.547528+0000","last_clean":"2024-04-24T23:58:07.547528+0000","last_became_active":"2024-04-24T23:58:04.755948+0000","last_became_peered":"2024-04-24T23:58:04.755948+0000","last_unstale":"2024-04-24T23:58:07.547528+0000","last_undegraded":"2024-04-24T23:58:07.547528+0000","last_fullsized":"2024-04-24T23:58:07.547528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549775+0000","last_change":"2024-04-24T23:58:05.792006+0000","last_active":"2024-04-24T23:58:07.549775+0000","last_peered":"2024-04-24T23:58:07.549775+0000","last_clean":"2024-04-24T23:58:07.549775+0000","last_became_active":"2024-04-24T23:58:05.791717+0000","last_became_peered":"2024-04-24T23:58:05.791717+0000","last_unstale":"2024-04-24T23:58:07.549775+0000","last_undegraded":"2024-04-24T23:58:07.549775+0000","last_fullsized":"2024-04-24T23:58:07.549775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782855+0000","last_change":"2024-04-24T23:58:04.762742+0000","last_active":"2024-04-24T23:58:06.782855+0000","last_peered":"2024-04-24T23:58:06.782855+0000","last_clean":"2024-04-24T23:58:06.782855+0000","last_became_active":"2024-04-24T23:58:04.757739+0000","last_became_peered":"2024-04-24T23:58:04.757739+0000","last_unstale":"2024-04-24T23:58:06.782855+0000","last_undegraded":"2024-04-24T23:58:06.782855+0000","last_fullsized":"2024-04-24T23:58:06.782855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:32:19.430261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552485+0000","last_change":"2024-04-24T23:58:05.804538+0000","last_active":"2024-04-24T23:58:07.552485+0000","last_peered":"2024-04-24T23:58:07.552485+0000","last_clean":"2024-04-24T23:58:07.552485+0000","last_became_active":"2024-04-24T23:58:05.804208+0000","last_became_peered":"2024-04-24T23:58:05.804208+0000","last_unstale":"2024-04-24T23:58:07.552485+0000","last_undegraded":"2024-04-24T23:58:07.552485+0000","last_fullsized":"2024-04-24T23:58:07.552485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.648636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549908+0000","last_change":"2024-04-24T23:58:04.760983+0000","last_active":"2024-04-24T23:58:07.549908+0000","last_peered":"2024-04-24T23:58:07.549908+0000","last_clean":"2024-04-24T23:58:07.549908+0000","last_became_active":"2024-04-24T23:58:04.760235+0000","last_became_peered":"2024-04-24T23:58:04.760235+0000","last_unstale":"2024-04-24T23:58:07.549908+0000","last_undegraded":"2024-04-24T23:58:07.549908+0000","last_fullsized":"2024-04-24T23:58:07.549908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:22.752722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552862+0000","last_change":"2024-04-24T23:58:05.803645+0000","last_active":"2024-04-24T23:58:07.552862+0000","last_peered":"2024-04-24T23:58:07.552862+0000","last_clean":"2024-04-24T23:58:07.552862+0000","last_became_active":"2024-04-24T23:58:05.803374+0000","last_became_peered":"2024-04-24T23:58:05.803374+0000","last_unstale":"2024-04-24T23:58:07.552862+0000","last_undegraded":"2024-04-24T23:58:07.552862+0000","last_fullsized":"2024-04-24T23:58:07.552862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:04:24.025118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780094+0000","last_change":"2024-04-24T23:58:04.773468+0000","last_active":"2024-04-24T23:58:06.780094+0000","last_peered":"2024-04-24T23:58:06.780094+0000","last_clean":"2024-04-24T23:58:06.780094+0000","last_became_active":"2024-04-24T23:58:04.773164+0000","last_became_peered":"2024-04-24T23:58:04.773164+0000","last_unstale":"2024-04-24T23:58:06.780094+0000","last_undegraded":"2024-04-24T23:58:06.780094+0000","last_fullsized":"2024-04-24T23:58:06.780094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549683+0000","last_change":"2024-04-24T23:58:05.796911+0000","last_active":"2024-04-24T23:58:07.549683+0000","last_peered":"2024-04-24T23:58:07.549683+0000","last_clean":"2024-04-24T23:58:07.549683+0000","last_became_active":"2024-04-24T23:58:05.796117+0000","last_became_peered":"2024-04-24T23:58:05.796117+0000","last_unstale":"2024-04-24T23:58:07.549683+0000","last_undegraded":"2024-04-24T23:58:07.549683+0000","last_fullsized":"2024-04-24T23:58:07.549683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:12.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550141+0000","last_change":"2024-04-24T23:58:04.772549+0000","last_active":"2024-04-24T23:58:07.550141+0000","last_peered":"2024-04-24T23:58:07.550141+0000","last_clean":"2024-04-24T23:58:07.550141+0000","last_became_active":"2024-04-24T23:58:04.771951+0000","last_became_peered":"2024-04-24T23:58:04.771951+0000","last_unstale":"2024-04-24T23:58:07.550141+0000","last_undegraded":"2024-04-24T23:58:07.550141+0000","last_fullsized":"2024-04-24T23:58:07.550141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:16:27.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551720+0000","last_change":"2024-04-24T23:58:05.793353+0000","last_active":"2024-04-24T23:58:07.551720+0000","last_peered":"2024-04-24T23:58:07.551720+0000","last_clean":"2024-04-24T23:58:07.551720+0000","last_became_active":"2024-04-24T23:58:05.793021+0000","last_became_peered":"2024-04-24T23:58:05.793021+0000","last_unstale":"2024-04-24T23:58:07.551720+0000","last_undegraded":"2024-04-24T23:58:07.551720+0000","last_fullsized":"2024-04-24T23:58:07.551720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:00.726837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547872+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:58:07.547872+0000","last_peered":"2024-04-24T23:58:07.547872+0000","last_clean":"2024-04-24T23:58:07.547872+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:58:07.547872+0000","last_undegraded":"2024-04-24T23:58:07.547872+0000","last_fullsized":"2024-04-24T23:58:07.547872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547780+0000","last_change":"2024-04-24T23:58:04.772159+0000","last_active":"2024-04-24T23:58:07.547780+0000","last_peered":"2024-04-24T23:58:07.547780+0000","last_clean":"2024-04-24T23:58:07.547780+0000","last_became_active":"2024-04-24T23:58:04.771791+0000","last_became_peered":"2024-04-24T23:58:04.771791+0000","last_unstale":"2024-04-24T23:58:07.547780+0000","last_undegraded":"2024-04-24T23:58:07.547780+0000","last_fullsized":"2024-04-24T23:58:07.547780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:16:27.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549665+0000","last_change":"2024-04-24T23:58:05.798331+0000","last_active":"2024-04-24T23:58:07.549665+0000","last_peered":"2024-04-24T23:58:07.549665+0000","last_clean":"2024-04-24T23:58:07.549665+0000","last_became_active":"2024-04-24T23:58:05.797998+0000","last_became_peered":"2024-04-24T23:58:05.797998+0000","last_unstale":"2024-04-24T23:58:07.549665+0000","last_undegraded":"2024-04-24T23:58:07.549665+0000","last_fullsized":"2024-04-24T23:58:07.549665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547517+0000","last_change":"2024-04-24T23:58:04.774140+0000","last_active":"2024-04-24T23:58:07.547517+0000","last_peered":"2024-04-24T23:58:07.547517+0000","last_clean":"2024-04-24T23:58:07.547517+0000","last_became_active":"2024-04-24T23:58:04.773822+0000","last_became_peered":"2024-04-24T23:58:04.773822+0000","last_unstale":"2024-04-24T23:58:07.547517+0000","last_undegraded":"2024-04-24T23:58:07.547517+0000","last_fullsized":"2024-04-24T23:58:07.547517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548141+0000","last_change":"2024-04-24T23:58:05.770614+0000","last_active":"2024-04-24T23:58:07.548141+0000","last_peered":"2024-04-24T23:58:07.548141+0000","last_clean":"2024-04-24T23:58:07.548141+0000","last_became_active":"2024-04-24T23:58:05.770229+0000","last_became_peered":"2024-04-24T23:58:05.770229+0000","last_unstale":"2024-04-24T23:58:07.548141+0000","last_undegraded":"2024-04-24T23:58:07.548141+0000","last_fullsized":"2024-04-24T23:58:07.548141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.247528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550130+0000","last_change":"2024-04-24T23:58:04.754168+0000","last_active":"2024-04-24T23:58:07.550130+0000","last_peered":"2024-04-24T23:58:07.550130+0000","last_clean":"2024-04-24T23:58:07.550130+0000","last_became_active":"2024-04-24T23:58:04.753801+0000","last_became_peered":"2024-04-24T23:58:04.753801+0000","last_unstale":"2024-04-24T23:58:07.550130+0000","last_undegraded":"2024-04-24T23:58:07.550130+0000","last_fullsized":"2024-04-24T23:58:07.550130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779072+0000","last_change":"2024-04-24T23:58:05.797159+0000","last_active":"2024-04-24T23:58:06.779072+0000","last_peered":"2024-04-24T23:58:06.779072+0000","last_clean":"2024-04-24T23:58:06.779072+0000","last_became_active":"2024-04-24T23:58:05.796588+0000","last_became_peered":"2024-04-24T23:58:05.796588+0000","last_unstale":"2024-04-24T23:58:06.779072+0000","last_undegraded":"2024-04-24T23:58:06.779072+0000","last_fullsized":"2024-04-24T23:58:06.779072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:55.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549111+0000","last_change":"2024-04-24T23:58:04.771298+0000","last_active":"2024-04-24T23:58:07.549111+0000","last_peered":"2024-04-24T23:58:07.549111+0000","last_clean":"2024-04-24T23:58:07.549111+0000","last_became_active":"2024-04-24T23:58:04.770304+0000","last_became_peered":"2024-04-24T23:58:04.770304+0000","last_unstale":"2024-04-24T23:58:07.549111+0000","last_undegraded":"2024-04-24T23:58:07.549111+0000","last_fullsized":"2024-04-24T23:58:07.549111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.782155+0000","last_change":"2024-04-24T23:58:05.776073+0000","last_active":"2024-04-24T23:58:06.782155+0000","last_peered":"2024-04-24T23:58:06.782155+0000","last_clean":"2024-04-24T23:58:06.782155+0000","last_became_active":"2024-04-24T23:58:05.775750+0000","last_became_peered":"2024-04-24T23:58:05.775750+0000","last_unstale":"2024-04-24T23:58:06.782155+0000","last_undegraded":"2024-04-24T23:58:06.782155+0000","last_fullsized":"2024-04-24T23:58:06.782155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:39.153771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779645+0000","last_change":"2024-04-24T23:58:04.758156+0000","last_active":"2024-04-24T23:58:06.779645+0000","last_peered":"2024-04-24T23:58:06.779645+0000","last_clean":"2024-04-24T23:58:06.779645+0000","last_became_active":"2024-04-24T23:58:04.757677+0000","last_became_peered":"2024-04-24T23:58:04.757677+0000","last_unstale":"2024-04-24T23:58:06.779645+0000","last_undegraded":"2024-04-24T23:58:06.779645+0000","last_fullsized":"2024-04-24T23:58:06.779645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:05.846034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549139+0000","last_change":"2024-04-24T23:58:05.796265+0000","last_active":"2024-04-24T23:58:07.549139+0000","last_peered":"2024-04-24T23:58:07.549139+0000","last_clean":"2024-04-24T23:58:07.549139+0000","last_became_active":"2024-04-24T23:58:05.795946+0000","last_became_peered":"2024-04-24T23:58:05.795946+0000","last_unstale":"2024-04-24T23:58:07.549139+0000","last_undegraded":"2024-04-24T23:58:07.549139+0000","last_fullsized":"2024-04-24T23:58:07.549139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:11.381479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551980+0000","last_change":"2024-04-24T23:58:04.779614+0000","last_active":"2024-04-24T23:58:07.551980+0000","last_peered":"2024-04-24T23:58:07.551980+0000","last_clean":"2024-04-24T23:58:07.551980+0000","last_became_active":"2024-04-24T23:58:04.779349+0000","last_became_peered":"2024-04-24T23:58:04.779349+0000","last_unstale":"2024-04-24T23:58:07.551980+0000","last_undegraded":"2024-04-24T23:58:07.551980+0000","last_fullsized":"2024-04-24T23:58:07.551980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:03.060917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779784+0000","last_change":"2024-04-24T23:58:05.797066+0000","last_active":"2024-04-24T23:58:06.779784+0000","last_peered":"2024-04-24T23:58:06.779784+0000","last_clean":"2024-04-24T23:58:06.779784+0000","last_became_active":"2024-04-24T23:58:05.796781+0000","last_became_peered":"2024-04-24T23:58:05.796781+0000","last_unstale":"2024-04-24T23:58:06.779784+0000","last_undegraded":"2024-04-24T23:58:06.779784+0000","last_fullsized":"2024-04-24T23:58:06.779784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:26.934363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779750+0000","last_change":"2024-04-24T23:58:04.762718+0000","last_active":"2024-04-24T23:58:06.779750+0000","last_peered":"2024-04-24T23:58:06.779750+0000","last_clean":"2024-04-24T23:58:06.779750+0000","last_became_active":"2024-04-24T23:58:04.762332+0000","last_became_peered":"2024-04-24T23:58:04.762332+0000","last_unstale":"2024-04-24T23:58:06.779750+0000","last_undegraded":"2024-04-24T23:58:06.779750+0000","last_fullsized":"2024-04-24T23:58:06.779750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:42.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.552274+0000","last_change":"2024-04-24T23:58:05.804598+0000","last_active":"2024-04-24T23:58:07.552274+0000","last_peered":"2024-04-24T23:58:07.552274+0000","last_clean":"2024-04-24T23:58:07.552274+0000","last_became_active":"2024-04-24T23:58:05.804304+0000","last_became_peered":"2024-04-24T23:58:05.804304+0000","last_unstale":"2024-04-24T23:58:07.552274+0000","last_undegraded":"2024-04-24T23:58:07.552274+0000","last_fullsized":"2024-04-24T23:58:07.552274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:56.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.778978+0000","last_change":"2024-04-24T23:58:04.771715+0000","last_active":"2024-04-24T23:58:06.778978+0000","last_peered":"2024-04-24T23:58:06.778978+0000","last_clean":"2024-04-24T23:58:06.778978+0000","last_became_active":"2024-04-24T23:58:04.771411+0000","last_became_peered":"2024-04-24T23:58:04.771411+0000","last_unstale":"2024-04-24T23:58:06.778978+0000","last_undegraded":"2024-04-24T23:58:06.778978+0000","last_fullsized":"2024-04-24T23:58:06.778978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:44.908025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549805+0000","last_change":"2024-04-24T23:58:05.790643+0000","last_active":"2024-04-24T23:58:07.549805+0000","last_peered":"2024-04-24T23:58:07.549805+0000","last_clean":"2024-04-24T23:58:07.549805+0000","last_became_active":"2024-04-24T23:58:05.789742+0000","last_became_peered":"2024-04-24T23:58:05.789742+0000","last_unstale":"2024-04-24T23:58:07.549805+0000","last_undegraded":"2024-04-24T23:58:07.549805+0000","last_fullsized":"2024-04-24T23:58:07.549805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.547503+0000","last_change":"2024-04-24T23:58:04.778586+0000","last_active":"2024-04-24T23:58:07.547503+0000","last_peered":"2024-04-24T23:58:07.547503+0000","last_clean":"2024-04-24T23:58:07.547503+0000","last_became_active":"2024-04-24T23:58:04.778296+0000","last_became_peered":"2024-04-24T23:58:04.778296+0000","last_unstale":"2024-04-24T23:58:07.547503+0000","last_undegraded":"2024-04-24T23:58:07.547503+0000","last_fullsized":"2024-04-24T23:58:07.547503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:38.139398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.781615+0000","last_change":"2024-04-24T23:58:05.793469+0000","last_active":"2024-04-24T23:58:06.781615+0000","last_peered":"2024-04-24T23:58:06.781615+0000","last_clean":"2024-04-24T23:58:06.781615+0000","last_became_active":"2024-04-24T23:58:05.793129+0000","last_became_peered":"2024-04-24T23:58:05.793129+0000","last_unstale":"2024-04-24T23:58:06.781615+0000","last_undegraded":"2024-04-24T23:58:06.781615+0000","last_fullsized":"2024-04-24T23:58:06.781615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:23.767095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779337+0000","last_change":"2024-04-24T23:58:04.769158+0000","last_active":"2024-04-24T23:58:06.779337+0000","last_peered":"2024-04-24T23:58:06.779337+0000","last_clean":"2024-04-24T23:58:06.779337+0000","last_became_active":"2024-04-24T23:58:04.768707+0000","last_became_peered":"2024-04-24T23:58:04.768707+0000","last_unstale":"2024-04-24T23:58:06.779337+0000","last_undegraded":"2024-04-24T23:58:06.779337+0000","last_fullsized":"2024-04-24T23:58:06.779337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:18.872497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550571+0000","last_change":"2024-04-24T23:58:05.797038+0000","last_active":"2024-04-24T23:58:07.550571+0000","last_peered":"2024-04-24T23:58:07.550571+0000","last_clean":"2024-04-24T23:58:07.550571+0000","last_became_active":"2024-04-24T23:58:05.796524+0000","last_became_peered":"2024-04-24T23:58:05.796524+0000","last_unstale":"2024-04-24T23:58:07.550571+0000","last_undegraded":"2024-04-24T23:58:07.550571+0000","last_fullsized":"2024-04-24T23:58:07.550571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:00.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.779397+0000","last_change":"2024-04-24T23:58:04.767745+0000","last_active":"2024-04-24T23:58:06.779397+0000","last_peered":"2024-04-24T23:58:06.779397+0000","last_clean":"2024-04-24T23:58:06.779397+0000","last_became_active":"2024-04-24T23:58:04.767416+0000","last_became_peered":"2024-04-24T23:58:04.767416+0000","last_unstale":"2024-04-24T23:58:06.779397+0000","last_undegraded":"2024-04-24T23:58:06.779397+0000","last_fullsized":"2024-04-24T23:58:06.779397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:47.083120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.550336+0000","last_change":"2024-04-24T23:58:05.792064+0000","last_active":"2024-04-24T23:58:07.550336+0000","last_peered":"2024-04-24T23:58:07.550336+0000","last_clean":"2024-04-24T23:58:07.550336+0000","last_became_active":"2024-04-24T23:58:05.790769+0000","last_became_peered":"2024-04-24T23:58:05.790769+0000","last_unstale":"2024-04-24T23:58:07.550336+0000","last_undegraded":"2024-04-24T23:58:07.550336+0000","last_fullsized":"2024-04-24T23:58:07.550336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549106+0000","last_change":"2024-04-24T23:58:04.778697+0000","last_active":"2024-04-24T23:58:07.549106+0000","last_peered":"2024-04-24T23:58:07.549106+0000","last_clean":"2024-04-24T23:58:07.549106+0000","last_became_active":"2024-04-24T23:58:04.778416+0000","last_became_peered":"2024-04-24T23:58:04.778416+0000","last_unstale":"2024-04-24T23:58:07.549106+0000","last_undegraded":"2024-04-24T23:58:07.549106+0000","last_fullsized":"2024-04-24T23:58:07.549106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:05.846034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:06.780654+0000","last_change":"2024-04-24T23:58:05.771222+0000","last_active":"2024-04-24T23:58:06.780654+0000","last_peered":"2024-04-24T23:58:06.780654+0000","last_clean":"2024-04-24T23:58:06.780654+0000","last_became_active":"2024-04-24T23:58:05.769336+0000","last_became_peered":"2024-04-24T23:58:05.769336+0000","last_unstale":"2024-04-24T23:58:06.780654+0000","last_undegraded":"2024-04-24T23:58:06.780654+0000","last_fullsized":"2024-04-24T23:58:06.780654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:43.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.548707+0000","last_change":"2024-04-24T23:58:05.788629+0000","last_active":"2024-04-24T23:58:07.548707+0000","last_peered":"2024-04-24T23:58:07.548707+0000","last_clean":"2024-04-24T23:58:07.548707+0000","last_became_active":"2024-04-24T23:58:05.788319+0000","last_became_peered":"2024-04-24T23:58:05.788319+0000","last_unstale":"2024-04-24T23:58:07.548707+0000","last_undegraded":"2024-04-24T23:58:07.548707+0000","last_fullsized":"2024-04-24T23:58:07.548707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551482+0000","last_change":"2024-04-24T23:58:04.777211+0000","last_active":"2024-04-24T23:58:07.551482+0000","last_peered":"2024-04-24T23:58:07.551482+0000","last_clean":"2024-04-24T23:58:07.551482+0000","last_became_active":"2024-04-24T23:58:04.776698+0000","last_became_peered":"2024-04-24T23:58:04.776698+0000","last_unstale":"2024-04-24T23:58:07.551482+0000","last_undegraded":"2024-04-24T23:58:07.551482+0000","last_fullsized":"2024-04-24T23:58:07.551482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:47.083120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549778+0000","last_change":"2024-04-24T23:58:05.792287+0000","last_active":"2024-04-24T23:58:07.549778+0000","last_peered":"2024-04-24T23:58:07.549778+0000","last_clean":"2024-04-24T23:58:07.549778+0000","last_became_active":"2024-04-24T23:58:05.791111+0000","last_became_peered":"2024-04-24T23:58:05.791111+0000","last_unstale":"2024-04-24T23:58:07.549778+0000","last_undegraded":"2024-04-24T23:58:07.549778+0000","last_fullsized":"2024-04-24T23:58:07.549778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.648636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551807+0000","last_change":"2024-04-24T23:58:04.777424+0000","last_active":"2024-04-24T23:58:07.551807+0000","last_peered":"2024-04-24T23:58:07.551807+0000","last_clean":"2024-04-24T23:58:07.551807+0000","last_became_active":"2024-04-24T23:58:04.777129+0000","last_became_peered":"2024-04-24T23:58:04.777129+0000","last_unstale":"2024-04-24T23:58:07.551807+0000","last_undegraded":"2024-04-24T23:58:07.551807+0000","last_fullsized":"2024-04-24T23:58:07.551807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:42.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549197+0000","last_change":"2024-04-24T23:58:05.783822+0000","last_active":"2024-04-24T23:58:07.549197+0000","last_peered":"2024-04-24T23:58:07.549197+0000","last_clean":"2024-04-24T23:58:07.549197+0000","last_became_active":"2024-04-24T23:58:05.783517+0000","last_became_peered":"2024-04-24T23:58:05.783517+0000","last_unstale":"2024-04-24T23:58:07.549197+0000","last_undegraded":"2024-04-24T23:58:07.549197+0000","last_fullsized":"2024-04-24T23:58:07.549197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:58:30.393654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551826+0000","last_change":"2024-04-24T23:58:04.760821+0000","last_active":"2024-04-24T23:58:07.551826+0000","last_peered":"2024-04-24T23:58:07.551826+0000","last_clean":"2024-04-24T23:58:07.551826+0000","last_became_active":"2024-04-24T23:58:04.760384+0000","last_became_peered":"2024-04-24T23:58:04.760384+0000","last_unstale":"2024-04-24T23:58:07.551826+0000","last_undegraded":"2024-04-24T23:58:07.551826+0000","last_fullsized":"2024-04-24T23:58:07.551826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:29.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.551776+0000","last_change":"2024-04-24T23:58:05.800284+0000","last_active":"2024-04-24T23:58:07.551776+0000","last_peered":"2024-04-24T23:58:07.551776+0000","last_clean":"2024-04-24T23:58:07.551776+0000","last_became_active":"2024-04-24T23:58:05.799756+0000","last_became_peered":"2024-04-24T23:58:05.799756+0000","last_unstale":"2024-04-24T23:58:07.551776+0000","last_undegraded":"2024-04-24T23:58:07.551776+0000","last_fullsized":"2024-04-24T23:58:07.551776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:04.723506+0000","last_clean_scrub_stamp":"2024-04-24T23:58:04.723506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:39:31.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T23:58:07.549323+0000","last_change":"2024-04-24T23:58:04.770489+0000","last_active":"2024-04-24T23:58:07.549323+0000","last_peered":"2024-04-24T23:58:07.549323+0000","last_clean":"2024-04-24T23:58:07.549323+0000","last_became_active":"2024-04-24T23:58:04.770181+0000","last_became_peered":"2024-04-24T23:58:04.770181+0000","last_unstale":"2024-04-24T23:58:07.549323+0000","last_undegraded":"2024-04-24T23:58:07.549323+0000","last_fullsized":"2024-04-24T23:58:07.549323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:58:03.709133+0000","last_clean_scrub_stamp":"2024-04-24T23:58:03.709133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:44.729552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:58:16.405 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T23:58:16.405 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T23:58:16.405 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T23:58:16.405 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T23:58:16.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.629+0000 7fe831600640 1 Processor -- start 2024-04-24T23:58:16.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.629+0000 7fe831600640 1 -- start start 2024-04-24T23:58:16.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe831600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe82c072a90 0x7fe82c15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe831600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0d00b0 0x7fe82c0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe831600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82c15f9c0 con 0x7fe82c0b4390 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe831600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c0d0a60 con 0x7fe82c072a90 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe831600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c15f120 con 0x7fe82c0d00b0 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82aa00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe82c072a90 0x7fe82c15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82aa00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe82c072a90 0x7fe82c15eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59244/0 (socket says 172.21.15.96:59244) 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82aa00640 1 -- 172.21.15.96:0/3451612594 learned_addr learned my addr 172.21.15.96:0/3451612594 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe823e00640 1 --1- 172.21.15.96:0/3451612594 >> v1:172.21.15.96:6789/0 conn(0x7fe82c0b4390 0x7fe82c071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51056/0 (socket says 172.21.15.96:51056) 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82b400640 1 --2- 172.21.15.96:0/3451612594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0d00b0 0x7fe82c0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82aa00640 1 -- 172.21.15.96:0/3451612594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0d00b0 msgr2=0x7fe82c0d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82aa00640 1 --2- 172.21.15.96:0/3451612594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0d00b0 0x7fe82c0d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82aa00640 1 -- 172.21.15.96:0/3451612594 >> v1:172.21.15.96:6789/0 conn(0x7fe82c0b4390 legacy=0x7fe82c071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82aa00640 1 -- 172.21.15.96:0/3451612594 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c15f400 con 0x7fe82c072a90 2024-04-24T23:58:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82a000640 1 -- 172.21.15.96:0/3451612594 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 184063535 0 0) 0x7fe82c15f9c0 con 0x7fe82c0b4390 2024-04-24T23:58:16.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.631+0000 7fe82b400640 1 --2- 172.21.15.96:0/3451612594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0d00b0 0x7fe82c0d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.632+0000 7fe82aa00640 1 --2- 172.21.15.96:0/3451612594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 0x7fe82c15eab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009870 tx=0x7fe81c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c52469f29ee2270 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe82a000640 1 -- 172.21.15.96:0/3451612594 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c037070 con 0x7fe82c072a90 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe82a000640 1 -- 172.21.15.96:0/3451612594 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c032440 con 0x7fe82c072a90 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe82a000640 1 -- 172.21.15.96:0/3451612594 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c032810 con 0x7fe82c072a90 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe831600640 1 -- 172.21.15.96:0/3451612594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 msgr2=0x7fe82c15eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe831600640 1 --2- 172.21.15.96:0/3451612594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 0x7fe82c15eab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009870 tx=0x7fe81c02a1c0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe831600640 1 -- 172.21.15.96:0/3451612594 shutdown_connections 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe831600640 1 --2- 172.21.15.96:0/3451612594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0d00b0 0x7fe82c0d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe831600640 1 --2- 172.21.15.96:0/3451612594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 0x7fe82c15eab0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe831600640 1 -- 172.21.15.96:0/3451612594 >> 172.21.15.96:0/3451612594 conn(0x7fe82c06b4e0 msgr2=0x7fe82c06b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe831600640 1 -- 172.21.15.96:0/3451612594 shutdown_connections 2024-04-24T23:58:16.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.633+0000 7fe831600640 1 -- 172.21.15.96:0/3451612594 wait complete. 2024-04-24T23:58:16.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.635+0000 7fe831600640 1 Processor -- start 2024-04-24T23:58:16.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.635+0000 7fe831600640 1 -- start start 2024-04-24T23:58:16.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.636+0000 7fe831600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 0x7fe82c150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.636+0000 7fe831600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0b4390 0x7fe82c09d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.636+0000 7fe831600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c0d00b0 0x7fe82c09d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.636+0000 7fe831600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0b4820 con 0x7fe82c072a90 2024-04-24T23:58:16.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.636+0000 7fe831600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c15b5d0 con 0x7fe82c0d00b0 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.636+0000 7fe831600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c072290 con 0x7fe82c0b4390 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.636+0000 7fe82aa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 0x7fe82c150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.636+0000 7fe82aa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 0x7fe82c150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59252/0 (socket says 172.21.15.96:59252) 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.636+0000 7fe82aa00640 1 -- 172.21.15.96:0/4112406376 learned_addr learned my addr 172.21.15.96:0/4112406376 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe82aa00640 1 -- 172.21.15.96:0/4112406376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0b4390 msgr2=0x7fe82c09d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe82aa00640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0b4390 0x7fe82c09d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe82aa00640 1 -- 172.21.15.96:0/4112406376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c0d00b0 msgr2=0x7fe82c09d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe82aa00640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c0d00b0 0x7fe82c09d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe82aa00640 1 -- 172.21.15.96:0/4112406376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c09bf80 con 0x7fe82c072a90 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe82aa00640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 0x7fe82c150740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000c00 tx=0x7fe81c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe822a00640 1 -- 172.21.15.96:0/4112406376 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c037040 con 0x7fe82c072a90 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe822a00640 1 -- 172.21.15.96:0/4112406376 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c042070 con 0x7fe82c072a90 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe822a00640 1 -- 172.21.15.96:0/4112406376 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c030bd0 con 0x7fe82c072a90 2024-04-24T23:58:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c09c260 con 0x7fe82c072a90 2024-04-24T23:58:16.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.637+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c09c820 con 0x7fe82c072a90 2024-04-24T23:58:16.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.639+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c069110 con 0x7fe82c072a90 2024-04-24T23:58:16.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.639+0000 7fe822a00640 1 -- 172.21.15.96:0/4112406376 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe81c02ad10 con 0x7fe82c072a90 2024-04-24T23:58:16.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.640+0000 7fe822a00640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:16.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.640+0000 7fe822a00640 1 -- 172.21.15.96:0/4112406376 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe81c0ab7e0 con 0x7fe82c072a90 2024-04-24T23:58:16.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.640+0000 7fe823e00640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:16.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.641+0000 7fe823e00640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe80806be30 0x7fe80806e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0aef30 tx=0x7fe814007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:16.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.645+0000 7fe822a00640 1 -- 172.21.15.96:0/4112406376 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe81c045360 con 0x7fe82c072a90 2024-04-24T23:58:16.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.880+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe82c06bb10 con 0x7fe82c072a90 2024-04-24T23:58:16.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.880+0000 7fe822a00640 1 -- 172.21.15.96:0/4112406376 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe81c07a0f0 con 0x7fe82c072a90 2024-04-24T23:58:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:16.880 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.882+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe80806be30 msgr2=0x7fe80806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.882+0000 7fe831600640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe80806be30 0x7fe80806e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0aef30 tx=0x7fe814007960 comp rx=0 tx=0).stop 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.882+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 msgr2=0x7fe82c150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.882+0000 7fe831600640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 0x7fe82c150740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000c00 tx=0x7fe81c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.882+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 shutdown_connections 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.883+0000 7fe831600640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c0d00b0 0x7fe82c09d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.883+0000 7fe831600640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82c0b4390 0x7fe82c09d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.883+0000 7fe831600640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.883+0000 7fe831600640 1 --2- 172.21.15.96:0/4112406376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe82c072a90 0x7fe82c150740 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.883+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 >> 172.21.15.96:0/4112406376 conn(0x7fe82c06b4e0 msgr2=0x7fe82c15da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.883+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 shutdown_connections 2024-04-24T23:58:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:16.883+0000 7fe831600640 1 -- 172.21.15.96:0/4112406376 wait complete. 2024-04-24T23:58:16.900 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T23:58:16.900 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:17.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.083+0000 7f0550600640 1 Processor -- start 2024-04-24T23:58:17.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.083+0000 7f0550600640 1 -- start start 2024-04-24T23:58:17.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f0550600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f054815c230 0x7f0548071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f0550600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05480af120 0x7f054806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f0550600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0548160b20 con 0x7f05480acda0 2024-04-24T23:58:17.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f0550600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f054815c610 con 0x7f054815c230 2024-04-24T23:58:17.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f0550600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f05480ad230 con 0x7f05480af120 2024-04-24T23:58:17.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f054dc00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f054815c230 0x7f0548071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f054dc00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f054815c230 0x7f0548071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35474/0 (socket says 172.21.15.96:35474) 2024-04-24T23:58:17.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f054dc00640 1 -- 172.21.15.96:0/4181611426 learned_addr learned my addr 172.21.15.96:0/4181611426 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:17.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f054e600640 1 --2- 172.21.15.96:0/4181611426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05480af120 0x7f054806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f054dc00640 1 -- 172.21.15.96:0/4181611426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05480af120 msgr2=0x7f054806cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:17.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f054dc00640 1 --2- 172.21.15.96:0/4181611426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05480af120 0x7f054806cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.085+0000 7f054dc00640 1 -- 172.21.15.96:0/4181611426 >> v1:172.21.15.155:6789/0 conn(0x7f05480acda0 legacy=0x7f05480aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:17.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.086+0000 7f054dc00640 1 -- 172.21.15.96:0/4181611426 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054815fd60 con 0x7f054815c230 2024-04-24T23:58:17.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.087+0000 7f054dc00640 1 --2- 172.21.15.96:0/4181611426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 0x7f0548071800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f053c009870 tx=0x7f053c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e13c65f50702f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:17.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.087+0000 7f0547e00640 1 -- 172.21.15.96:0/4181611426 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c037070 con 0x7f054815c230 2024-04-24T23:58:17.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.087+0000 7f0547e00640 1 -- 172.21.15.96:0/4181611426 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c032440 con 0x7f054815c230 2024-04-24T23:58:17.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.087+0000 7f0547e00640 1 -- 172.21.15.96:0/4181611426 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c032810 con 0x7f054815c230 2024-04-24T23:58:17.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.087+0000 7f0550600640 1 -- 172.21.15.96:0/4181611426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 msgr2=0x7f0548071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.087+0000 7f0550600640 1 --2- 172.21.15.96:0/4181611426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 0x7f0548071800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f053c009870 tx=0x7f053c02a210 comp rx=0 tx=0).stop 2024-04-24T23:58:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.088+0000 7f0550600640 1 -- 172.21.15.96:0/4181611426 shutdown_connections 2024-04-24T23:58:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.088+0000 7f0550600640 1 --2- 172.21.15.96:0/4181611426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05480af120 0x7f054806cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.088+0000 7f0550600640 1 --2- 172.21.15.96:0/4181611426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 0x7f0548071800 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.088+0000 7f0550600640 1 -- 172.21.15.96:0/4181611426 >> 172.21.15.96:0/4181611426 conn(0x7f05480b19c0 msgr2=0x7f05480b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.088+0000 7f0550600640 1 -- 172.21.15.96:0/4181611426 shutdown_connections 2024-04-24T23:58:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.088+0000 7f0550600640 1 -- 172.21.15.96:0/4181611426 wait complete. 2024-04-24T23:58:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.089+0000 7f0550600640 1 Processor -- start 2024-04-24T23:58:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.090+0000 7f0550600640 1 -- start start 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.090+0000 7f0550600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05480acda0 0x7f054814e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.090+0000 7f0550600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05480af120 0x7f054815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.090+0000 7f0550600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 0x7f05480b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.090+0000 7f0550600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0548160600 con 0x7f054815c230 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.090+0000 7f0550600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0548160320 con 0x7f05480acda0 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.090+0000 7f0550600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f05480ad4d0 con 0x7f05480af120 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054e600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 0x7f05480b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054e600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 0x7f05480b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35490/0 (socket says 172.21.15.96:35490) 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054e600640 1 -- 172.21.15.96:0/1638271846 learned_addr learned my addr 172.21.15.96:0/1638271846 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:17.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054dc00640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05480acda0 0x7f054814e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054e600640 1 -- 172.21.15.96:0/1638271846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05480af120 msgr2=0x7f054815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054e600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05480af120 0x7f054815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054e600640 1 -- 172.21.15.96:0/1638271846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05480acda0 msgr2=0x7f054814e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054e600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05480acda0 0x7f054814e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054e600640 1 -- 172.21.15.96:0/1638271846 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054815dc20 con 0x7f054815c230 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054dc00640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05480acda0 0x7f054814e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.091+0000 7f054e600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 0x7f05480b0b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0540007d90 tx=0x7f054000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.092+0000 7f0545600640 1 -- 172.21.15.96:0/1638271846 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540014420 con 0x7f054815c230 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.092+0000 7f0545600640 1 -- 172.21.15.96:0/1638271846 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540019070 con 0x7f054815c230 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.092+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054815df00 con 0x7f054815c230 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.092+0000 7f0545600640 1 -- 172.21.15.96:0/1638271846 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540014820 con 0x7f054815c230 2024-04-24T23:58:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.092+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054815e4c0 con 0x7f054815c230 2024-04-24T23:58:17.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.093+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0548069110 con 0x7f054815c230 2024-04-24T23:58:17.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.094+0000 7f0545600640 1 -- 172.21.15.96:0/1638271846 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05400149c0 con 0x7f054815c230 2024-04-24T23:58:17.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.095+0000 7f0545600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f052806be30 0x7f052806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.095+0000 7f0545600640 1 -- 172.21.15.96:0/1638271846 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f054008b750 con 0x7f054815c230 2024-04-24T23:58:17.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.095+0000 7f054dc00640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f052806be30 0x7f052806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.096+0000 7f054dc00640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f052806be30 0x7f052806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f053c034000 tx=0x7f053c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:17.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.101+0000 7f0545600640 1 -- 172.21.15.96:0/1638271846 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f054005a060 con 0x7f054815c230 2024-04-24T23:58:17.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.299+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05480ce6f0 con 0x7f054815c230 2024-04-24T23:58:17.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.300+0000 7f0545600640 1 -- 172.21.15.96:0/1638271846 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7f0540059960 con 0x7f054815c230 2024-04-24T23:58:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:17.301 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:17.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f052806be30 msgr2=0x7f052806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f052806be30 0x7f052806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f053c034000 tx=0x7f053c02e000 comp rx=0 tx=0).stop 2024-04-24T23:58:17.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 msgr2=0x7f05480b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 0x7f05480b0b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0540007d90 tx=0x7f054000e4b0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 shutdown_connections 2024-04-24T23:58:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f052806be30 0x7f052806e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f054815c230 0x7f05480b0b10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05480af120 0x7f054815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 --2- 172.21.15.96:0/1638271846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05480acda0 0x7f054814e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 >> 172.21.15.96:0/1638271846 conn(0x7f05480b19c0 msgr2=0x7f054806d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 shutdown_connections 2024-04-24T23:58:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.303+0000 7f0550600640 1 -- 172.21.15.96:0/1638271846 wait complete. 2024-04-24T23:58:17.321 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:17.321 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.521+0000 7fe16ec00640 1 Processor -- start 2024-04-24T23:58:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.521+0000 7fe16ec00640 1 -- start start 2024-04-24T23:58:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe16ec00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe1681551c0 0x7fe16815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe16ec00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe16806edb0 0x7fe1680b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe16ec00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16815f750 con 0x7fe1680b3200 2024-04-24T23:58:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe16ec00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe16815f190 con 0x7fe1681551c0 2024-04-24T23:58:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe16ec00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe16815f470 con 0x7fe16806edb0 2024-04-24T23:58:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe167e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe1681551c0 0x7fe16815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe167e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe1681551c0 0x7fe16815e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35502/0 (socket says 172.21.15.96:35502) 2024-04-24T23:58:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe167e00640 1 -- 172.21.15.96:0/3191682599 learned_addr learned my addr 172.21.15.96:0/3191682599 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe16cc00640 1 --1- 172.21.15.96:0/3191682599 >> v1:172.21.15.96:6789/0 conn(0x7fe1680b3200 0x7fe1680726d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45854/0 (socket says 172.21.15.96:45854) 2024-04-24T23:58:17.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe15f400640 1 --2- 172.21.15.96:0/3191682599 >> v2:172.21.15.155:3300/0 conn(0x7fe16806edb0 0x7fe1680b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe167e00640 1 -- 172.21.15.96:0/3191682599 >> v2:172.21.15.155:3300/0 conn(0x7fe16806edb0 msgr2=0x7fe1680b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:17.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe167e00640 1 --2- 172.21.15.96:0/3191682599 >> v2:172.21.15.155:3300/0 conn(0x7fe16806edb0 0x7fe1680b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.523+0000 7fe167e00640 1 -- 172.21.15.96:0/3191682599 >> v1:172.21.15.96:6789/0 conn(0x7fe1680b3200 legacy=0x7fe1680726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.524+0000 7fe167e00640 1 -- 172.21.15.96:0/3191682599 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe168071150 con 0x7fe1681551c0 2024-04-24T23:58:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.525+0000 7fe167e00640 1 --2- 172.21.15.96:0/3191682599 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1681551c0 0x7fe16815e7f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe1680d0dd0 tx=0x7fe15802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e61f53d88f7ceb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.525+0000 7fe167400640 1 -- 172.21.15.96:0/3191682599 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158036070 con 0x7fe1681551c0 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.525+0000 7fe167400640 1 -- 172.21.15.96:0/3191682599 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe158031600 con 0x7fe1681551c0 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.525+0000 7fe167400640 1 -- 172.21.15.96:0/3191682599 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1580319d0 con 0x7fe1681551c0 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.525+0000 7fe16ec00640 1 -- 172.21.15.96:0/3191682599 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1681551c0 msgr2=0x7fe16815e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.525+0000 7fe16ec00640 1 --2- 172.21.15.96:0/3191682599 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1681551c0 0x7fe16815e7f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe1680d0dd0 tx=0x7fe15802a6a0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.526+0000 7fe16ec00640 1 -- 172.21.15.96:0/3191682599 shutdown_connections 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.526+0000 7fe16ec00640 1 --2- 172.21.15.96:0/3191682599 >> v2:172.21.15.155:3300/0 conn(0x7fe16806edb0 0x7fe1680b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.526+0000 7fe16ec00640 1 --2- 172.21.15.96:0/3191682599 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1681551c0 0x7fe16815e7f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.526+0000 7fe16ec00640 1 -- 172.21.15.96:0/3191682599 >> 172.21.15.96:0/3191682599 conn(0x7fe1680b19c0 msgr2=0x7fe1680b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.526+0000 7fe16ec00640 1 -- 172.21.15.96:0/3191682599 shutdown_connections 2024-04-24T23:58:17.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.526+0000 7fe16ec00640 1 -- 172.21.15.96:0/3191682599 wait complete. 2024-04-24T23:58:17.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.527+0000 7fe16ec00640 1 Processor -- start 2024-04-24T23:58:17.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.528+0000 7fe16ec00640 1 -- start start 2024-04-24T23:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.528+0000 7fe16ec00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16806edb0 0x7fe168141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe16ec00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1680b3200 0x7fe16813ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe16ec00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1681551c0 0x7fe1680adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe16ec00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe16815ed30 con 0x7fe16806edb0 2024-04-24T23:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe16ec00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe1681555a0 con 0x7fe1680b3200 2024-04-24T23:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe16ec00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe16815eeb0 con 0x7fe1681551c0 2024-04-24T23:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe167e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16806edb0 0x7fe168141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe167e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16806edb0 0x7fe168141e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35512/0 (socket says 172.21.15.96:35512) 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe167e00640 1 -- 172.21.15.96:0/536908480 learned_addr learned my addr 172.21.15.96:0/536908480 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe15f400640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1680b3200 0x7fe16813ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe167e00640 1 -- 172.21.15.96:0/536908480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1681551c0 msgr2=0x7fe1680adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe167e00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1681551c0 0x7fe1680adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe167e00640 1 -- 172.21.15.96:0/536908480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1680b3200 msgr2=0x7fe16813ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe167e00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1680b3200 0x7fe16813ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe167e00640 1 -- 172.21.15.96:0/536908480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe168142340 con 0x7fe16806edb0 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.529+0000 7fe167e00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16806edb0 0x7fe168141e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe158009f40 tx=0x7fe158004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.530+0000 7fe164c00640 1 -- 172.21.15.96:0/536908480 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15803f020 con 0x7fe16806edb0 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.530+0000 7fe164c00640 1 -- 172.21.15.96:0/536908480 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe158037040 con 0x7fe16806edb0 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.530+0000 7fe164c00640 1 -- 172.21.15.96:0/536908480 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158036070 con 0x7fe16806edb0 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.530+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16809cd10 con 0x7fe16806edb0 2024-04-24T23:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.530+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16809d2d0 con 0x7fe16806edb0 2024-04-24T23:58:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.531+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe168069110 con 0x7fe16806edb0 2024-04-24T23:58:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.532+0000 7fe164c00640 1 -- 172.21.15.96:0/536908480 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe158042020 con 0x7fe16806edb0 2024-04-24T23:58:17.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.533+0000 7fe164c00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe14406be60 0x7fe14406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.533+0000 7fe164c00640 1 -- 172.21.15.96:0/536908480 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe1580ab4a0 con 0x7fe16806edb0 2024-04-24T23:58:17.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.533+0000 7fe15f400640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe14406be60 0x7fe14406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.534+0000 7fe15f400640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe14406be60 0x7fe14406e320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe16806d1e0 tx=0x7fe150008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.537+0000 7fe164c00640 1 -- 172.21.15.96:0/536908480 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe158049030 con 0x7fe16806edb0 2024-04-24T23:58:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.732+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe1680b4e00 con 0x7fe16806edb0 2024-04-24T23:58:17.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.733+0000 7fe164c00640 1 -- 172.21.15.96:0/536908480 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fe168142340 con 0x7fe16806edb0 2024-04-24T23:58:17.733 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:17.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe14406be60 msgr2=0x7fe14406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe14406be60 0x7fe14406e320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe16806d1e0 tx=0x7fe150008040 comp rx=0 tx=0).stop 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16806edb0 msgr2=0x7fe168141e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16806edb0 0x7fe168141e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe158009f40 tx=0x7fe158004a40 comp rx=0 tx=0).stop 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 shutdown_connections 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1681551c0 0x7fe1680adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1680b3200 0x7fe16813ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe14406be60 0x7fe14406e320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 --2- 172.21.15.96:0/536908480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16806edb0 0x7fe168141e00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 >> 172.21.15.96:0/536908480 conn(0x7fe1680b19c0 msgr2=0x7fe1680b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 shutdown_connections 2024-04-24T23:58:17.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.736+0000 7fe16ec00640 1 -- 172.21.15.96:0/536908480 wait complete. 2024-04-24T23:58:17.755 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:17.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.950+0000 7f2b82400640 1 Processor -- start 2024-04-24T23:58:17.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.950+0000 7f2b82400640 1 -- start start 2024-04-24T23:58:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b82400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 0x7f2b7c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b82400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2b7c0cf3e0 0x7f2b7c0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b82400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2b7c1415d0 0x7f2b7c141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b82400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2b7c0ce620 con 0x7f2b7c1415d0 2024-04-24T23:58:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b82400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2b7c0ce900 con 0x7f2b7c0cf3e0 2024-04-24T23:58:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b82400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c0cebe0 con 0x7f2b7c13ef60 2024-04-24T23:58:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b81a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2b7c1415d0 0x7f2b7c141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b81a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2b7c1415d0 0x7f2b7c141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35520/0 (socket says 172.21.15.96:35520) 2024-04-24T23:58:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b81a00640 1 -- 172.21.15.96:0/830095213 learned_addr learned my addr 172.21.15.96:0/830095213 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:17.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b7be00640 1 --2- 172.21.15.96:0/830095213 >> v2:172.21.15.155:3300/0 conn(0x7f2b7c0cf3e0 0x7f2b7c0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.952+0000 7f2b81000640 1 --2- 172.21.15.96:0/830095213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 0x7f2b7c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.953+0000 7f2b81a00640 1 -- 172.21.15.96:0/830095213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 msgr2=0x7f2b7c15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:17.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.953+0000 7f2b81a00640 1 --2- 172.21.15.96:0/830095213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 0x7f2b7c15cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.953+0000 7f2b81a00640 1 -- 172.21.15.96:0/830095213 >> v2:172.21.15.155:3300/0 conn(0x7f2b7c0cf3e0 msgr2=0x7f2b7c0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:17.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.953+0000 7f2b81a00640 1 --2- 172.21.15.96:0/830095213 >> v2:172.21.15.155:3300/0 conn(0x7f2b7c0cf3e0 0x7f2b7c0cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.953+0000 7f2b81a00640 1 -- 172.21.15.96:0/830095213 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c0ccb10 con 0x7f2b7c1415d0 2024-04-24T23:58:17.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.954+0000 7f2b81a00640 1 --2- 172.21.15.96:0/830095213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 0x7f2b7c141a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0708d0 tx=0x7f2b7402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b54d2cd8e659d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:17.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.954+0000 7f2b7b400640 1 -- 172.21.15.96:0/830095213 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74036070 con 0x7f2b7c1415d0 2024-04-24T23:58:17.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.954+0000 7f2b7b400640 1 -- 172.21.15.96:0/830095213 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74031600 con 0x7f2b7c1415d0 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.954+0000 7f2b7b400640 1 -- 172.21.15.96:0/830095213 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b740319d0 con 0x7f2b7c1415d0 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.955+0000 7f2b82400640 1 -- 172.21.15.96:0/830095213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 msgr2=0x7f2b7c141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.955+0000 7f2b82400640 1 --2- 172.21.15.96:0/830095213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 0x7f2b7c141a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0708d0 tx=0x7f2b7402a6a0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.955+0000 7f2b82400640 1 -- 172.21.15.96:0/830095213 shutdown_connections 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.955+0000 7f2b82400640 1 --2- 172.21.15.96:0/830095213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 0x7f2b7c141a60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.955+0000 7f2b82400640 1 --2- 172.21.15.96:0/830095213 >> v2:172.21.15.155:3300/0 conn(0x7f2b7c0cf3e0 0x7f2b7c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.955+0000 7f2b82400640 1 --2- 172.21.15.96:0/830095213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 0x7f2b7c15cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.955+0000 7f2b82400640 1 -- 172.21.15.96:0/830095213 >> 172.21.15.96:0/830095213 conn(0x7f2b7c0b18b0 msgr2=0x7f2b7c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.955+0000 7f2b82400640 1 -- 172.21.15.96:0/830095213 shutdown_connections 2024-04-24T23:58:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.955+0000 7f2b82400640 1 -- 172.21.15.96:0/830095213 wait complete. 2024-04-24T23:58:17.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.956+0000 7f2b82400640 1 Processor -- start 2024-04-24T23:58:17.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.957+0000 7f2b82400640 1 -- start start 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.957+0000 7f2b82400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b7c0cf3e0 0x7f2b7c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.957+0000 7f2b82400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 0x7f2b7c13e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.957+0000 7f2b82400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 0x7f2b7c1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.957+0000 7f2b82400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0cf9e0 con 0x7f2b7c1415d0 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.957+0000 7f2b82400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0cf860 con 0x7f2b7c0cf3e0 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.957+0000 7f2b82400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c15fa20 con 0x7f2b7c13ef60 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 0x7f2b7c1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 0x7f2b7c1574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35522/0 (socket says 172.21.15.96:35522) 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81a00640 1 -- 172.21.15.96:0/2299894511 learned_addr learned my addr 172.21.15.96:0/2299894511 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81000640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b7c0cf3e0 0x7f2b7c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b7be00640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 0x7f2b7c13e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81a00640 1 -- 172.21.15.96:0/2299894511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 msgr2=0x7f2b7c13e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81a00640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 0x7f2b7c13e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81a00640 1 -- 172.21.15.96:0/2299894511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b7c0cf3e0 msgr2=0x7f2b7c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81a00640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b7c0cf3e0 0x7f2b7c158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81a00640 1 -- 172.21.15.96:0/2299894511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c157f80 con 0x7f2b7c1415d0 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.958+0000 7f2b81a00640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 0x7f2b7c1574e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b74034040 tx=0x7f2b74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.959+0000 7f2b78c00640 1 -- 172.21.15.96:0/2299894511 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74036050 con 0x7f2b7c1415d0 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.959+0000 7f2b78c00640 1 -- 172.21.15.96:0/2299894511 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74042070 con 0x7f2b7c1415d0 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.959+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7c158270 con 0x7f2b7c1415d0 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.959+0000 7f2b78c00640 1 -- 172.21.15.96:0/2299894511 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74009510 con 0x7f2b7c1415d0 2024-04-24T23:58:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.959+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7c158ab0 con 0x7f2b7c1415d0 2024-04-24T23:58:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.960+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b7c0755d0 con 0x7f2b7c1415d0 2024-04-24T23:58:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.961+0000 7f2b78c00640 1 -- 172.21.15.96:0/2299894511 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b74007bf0 con 0x7f2b7c1415d0 2024-04-24T23:58:17.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.962+0000 7f2b78c00640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2b5c06be30 0x7f2b5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:17.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.962+0000 7f2b78c00640 1 -- 172.21.15.96:0/2299894511 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b740abd00 con 0x7f2b7c1415d0 2024-04-24T23:58:17.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.962+0000 7f2b81000640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2b5c06be30 0x7f2b5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:17.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.963+0000 7f2b81000640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2b5c06be30 0x7f2b5c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b70006fd0 tx=0x7f2b70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:17.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:17.966+0000 7f2b78c00640 1 -- 172.21.15.96:0/2299894511 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2b7c158270 con 0x7f2b7c1415d0 2024-04-24T23:58:18.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.166+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2b7c06e6d0 con 0x7f2b7c1415d0 2024-04-24T23:58:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.167+0000 7f2b78c00640 1 -- 172.21.15.96:0/2299894511 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f2b7407a610 con 0x7f2b7c1415d0 2024-04-24T23:58:18.167 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:18.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2b5c06be30 msgr2=0x7f2b5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2b5c06be30 0x7f2b5c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b70006fd0 tx=0x7f2b70008040 comp rx=0 tx=0).stop 2024-04-24T23:58:18.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 msgr2=0x7f2b7c1574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 0x7f2b7c1574e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b74034040 tx=0x7f2b74004a40 comp rx=0 tx=0).stop 2024-04-24T23:58:18.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 shutdown_connections 2024-04-24T23:58:18.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2b5c06be30 0x7f2b5c06e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b7c1415d0 0x7f2b7c1574e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b7c13ef60 0x7f2b7c13e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 --2- 172.21.15.96:0/2299894511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b7c0cf3e0 0x7f2b7c158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 >> 172.21.15.96:0/2299894511 conn(0x7f2b7c0b18b0 msgr2=0x7f2b7c152cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:18.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 shutdown_connections 2024-04-24T23:58:18.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.169+0000 7f2b82400640 1 -- 172.21.15.96:0/2299894511 wait complete. 2024-04-24T23:58:18.188 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:18.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.391+0000 7f48f5200640 1 Processor -- start 2024-04-24T23:58:18.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.392+0000 7f48f5200640 1 -- start start 2024-04-24T23:58:18.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.393+0000 7f48f5200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f01415d0 0x7f48f0141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.393+0000 7f48f5200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f00ce620 con 0x7f48f013ef60 2024-04-24T23:58:18.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.393+0000 7f48f5200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f00ce900 con 0x7f48f015cfe0 2024-04-24T23:58:18.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.393+0000 7f48f5200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f48f00cebe0 con 0x7f48f01415d0 2024-04-24T23:58:18.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48ef400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f48f013ef60 0x7f48f00cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45856/0 (socket says 172.21.15.96:45856) 2024-04-24T23:58:18.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48ef400640 1 -- 172.21.15.96:0/3920959110 learned_addr learned my addr 172.21.15.96:0/3920959110 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2888513544 0 0) 0x7f48f00ce620 con 0x7f48f013ef60 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d4003520 con 0x7f48f013ef60 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48efe00640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f01415d0 0x7f48f0141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2038458798 0 0) 0x7f48d4003520 con 0x7f48f013ef60 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f01415d0 msgr2=0x7f48f0141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48eea00640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f01415d0 0x7f48f0141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 >> v1:172.21.15.155:6789/0 conn(0x7f48f015cfe0 legacy=0x7f48f00cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f00ce240 con 0x7f48f013ef60 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.394+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f48e0001670 con 0x7f48f013ef60 2024-04-24T23:58:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 >> v1:172.21.15.96:6789/0 conn(0x7f48f013ef60 legacy=0x7f48f00cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48eea00640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d40039e0 0x7f48d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48eea00640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f01415d0 0x7f48d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48eea00640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48d4004d40 0x7f48d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f48f00cebe0 con 0x7f48d4004d40 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f48d400bb50 con 0x7f48d40039e0 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f48d400bd20 con 0x7f48f01415d0 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48efe00640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48d4004d40 0x7f48d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48ef400640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d40039e0 0x7f48d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48efe00640 1 -- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f01415d0 msgr2=0x7f48d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48efe00640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f01415d0 0x7f48d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48efe00640 1 -- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d40039e0 msgr2=0x7f48d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48efe00640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d40039e0 0x7f48d4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48efe00640 1 -- 172.21.15.96:0/3920959110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d4003520 con 0x7f48d4004d40 2024-04-24T23:58:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.395+0000 7f48ef400640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d40039e0 0x7f48d4003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.396+0000 7f48efe00640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48d4004d40 0x7f48d40051c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007390 tx=0x7f48d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779fa62a462f8abc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.396+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8009be0 con 0x7f48d4004d40 2024-04-24T23:58:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.397+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e802e640 con 0x7f48d4004d40 2024-04-24T23:58:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.397+0000 7f48eea00640 1 -- 172.21.15.96:0/3920959110 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e802ea10 con 0x7f48d4004d40 2024-04-24T23:58:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.397+0000 7f48f5200640 1 -- 172.21.15.96:0/3920959110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48d4004d40 msgr2=0x7f48d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.397+0000 7f48f5200640 1 --2- 172.21.15.96:0/3920959110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48d4004d40 0x7f48d40051c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007390 tx=0x7f48d4005830 comp rx=0 tx=0).stop 2024-04-24T23:58:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.397+0000 7f48efe00640 1 -- 172.21.15.96:0/3920959110 reap_dead start 2024-04-24T23:58:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.397+0000 7f48f5200640 1 -- 172.21.15.96:0/3920959110 shutdown_connections 2024-04-24T23:58:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.397+0000 7f48f5200640 1 -- 172.21.15.96:0/3920959110 >> 172.21.15.96:0/3920959110 conn(0x7f48f00b18b0 msgr2=0x7f48f00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:18.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.397+0000 7f48f5200640 1 -- 172.21.15.96:0/3920959110 shutdown_connections 2024-04-24T23:58:18.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.397+0000 7f48f5200640 1 -- 172.21.15.96:0/3920959110 wait complete. 2024-04-24T23:58:18.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.399+0000 7f48f5200640 1 Processor -- start 2024-04-24T23:58:18.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.399+0000 7f48f5200640 1 -- start start 2024-04-24T23:58:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.400+0000 7f48f5200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d4004d40 0x7f48f00b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.400+0000 7f48f5200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f00b2ee0 0x7f48f0156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.400+0000 7f48f5200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0157030 0x7f48f01304a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.400+0000 7f48f5200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0141eb0 con 0x7f48f00b2ee0 2024-04-24T23:58:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.400+0000 7f48f5200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0141d30 con 0x7f48d4004d40 2024-04-24T23:58:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.400+0000 7f48f5200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f48f006da30 con 0x7f48f0157030 2024-04-24T23:58:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.400+0000 7f48e6a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f00b2ee0 0x7f48f0156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.400+0000 7f48e6a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f00b2ee0 0x7f48f0156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35548/0 (socket says 172.21.15.96:35548) 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.400+0000 7f48e6a00640 1 -- 172.21.15.96:0/105804744 learned_addr learned my addr 172.21.15.96:0/105804744 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48ef400640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d4004d40 0x7f48f00b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48e6a00640 1 -- 172.21.15.96:0/105804744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0157030 msgr2=0x7f48f01304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48e6a00640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0157030 0x7f48f01304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48e6a00640 1 -- 172.21.15.96:0/105804744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d4004d40 msgr2=0x7f48f00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48e6a00640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d4004d40 0x7f48f00b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48e6a00640 1 -- 172.21.15.96:0/105804744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f00b3360 con 0x7f48f00b2ee0 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48ef400640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d4004d40 0x7f48f00b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48e6a00640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f00b2ee0 0x7f48f0156af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c450 tx=0x7f48d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48e7e00640 1 -- 172.21.15.96:0/105804744 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8017070 con 0x7f48f00b2ee0 2024-04-24T23:58:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48e7e00640 1 -- 172.21.15.96:0/105804744 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d80052d0 con 0x7f48f00b2ee0 2024-04-24T23:58:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48e7e00640 1 -- 172.21.15.96:0/105804744 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8003830 con 0x7f48f00b2ee0 2024-04-24T23:58:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.401+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f00b3640 con 0x7f48f00b2ee0 2024-04-24T23:58:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.402+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f00b3c00 con 0x7f48f00b2ee0 2024-04-24T23:58:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.403+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f0157450 con 0x7f48f00b2ee0 2024-04-24T23:58:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.404+0000 7f48e7e00640 1 -- 172.21.15.96:0/105804744 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48d801a070 con 0x7f48f00b2ee0 2024-04-24T23:58:18.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.405+0000 7f48e7e00640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f48cc06be60 0x7f48cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.405+0000 7f48e7e00640 1 -- 172.21.15.96:0/105804744 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f48d808a2b0 con 0x7f48f00b2ee0 2024-04-24T23:58:18.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.405+0000 7f48ef400640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f48cc06be60 0x7f48cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.406+0000 7f48ef400640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f48cc06be60 0x7f48cc06e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001eb0 tx=0x7f48e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:18.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.410+0000 7f48e7e00640 1 -- 172.21.15.96:0/105804744 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f48d8058b30 con 0x7f48f00b2ee0 2024-04-24T23:58:18.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.608+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48f006e6d0 con 0x7f48f00b2ee0 2024-04-24T23:58:18.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.609+0000 7f48e7e00640 1 -- 172.21.15.96:0/105804744 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f48d8058430 con 0x7f48f00b2ee0 2024-04-24T23:58:18.609 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:18.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f48cc06be60 msgr2=0x7f48cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f48cc06be60 0x7f48cc06e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001eb0 tx=0x7f48e0009040 comp rx=0 tx=0).stop 2024-04-24T23:58:18.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f00b2ee0 msgr2=0x7f48f0156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f00b2ee0 0x7f48f0156af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c450 tx=0x7f48d800c910 comp rx=0 tx=0).stop 2024-04-24T23:58:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 shutdown_connections 2024-04-24T23:58:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f0157030 0x7f48f01304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f48cc06be60 0x7f48cc06e320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f00b2ee0 0x7f48f0156af0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 --2- 172.21.15.96:0/105804744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d4004d40 0x7f48f00b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 >> 172.21.15.96:0/105804744 conn(0x7f48f00b18b0 msgr2=0x7f48f015bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 shutdown_connections 2024-04-24T23:58:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.612+0000 7f48f5200640 1 -- 172.21.15.96:0/105804744 wait complete. 2024-04-24T23:58:18.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:58:18.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.817+0000 7fbd9aa00640 1 Processor -- start 2024-04-24T23:58:18.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.818+0000 7fbd9aa00640 1 -- start start 2024-04-24T23:58:18.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.819+0000 7fbd9aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9415f6b0 0x7fbd940ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.819+0000 7fbd9aa00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd940b4ec0 0x7fbd940cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.819+0000 7fbd9aa00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9415fa90 con 0x7fbd940ccc20 2024-04-24T23:58:18.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.819+0000 7fbd9aa00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbd940b4a30 con 0x7fbd940b4ec0 2024-04-24T23:58:18.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.819+0000 7fbd9aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbd940b3e20 con 0x7fbd9415f6b0 2024-04-24T23:58:18.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.820+0000 7fbd99600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9415f6b0 0x7fbd940ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.820+0000 7fbd98c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd940b4ec0 0x7fbd940cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.820+0000 7fbd99600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9415f6b0 0x7fbd940ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:35692/0 (socket says 172.21.15.96:35692) 2024-04-24T23:58:18.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.820+0000 7fbd99600640 1 -- 172.21.15.96:0/1695774007 learned_addr learned my addr 172.21.15.96:0/1695774007 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:18.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.821+0000 7fbd99600640 1 -- 172.21.15.96:0/1695774007 >> v2:172.21.15.155:3300/0 conn(0x7fbd940b4ec0 msgr2=0x7fbd940cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:18.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.821+0000 7fbd99600640 1 --2- 172.21.15.96:0/1695774007 >> v2:172.21.15.155:3300/0 conn(0x7fbd940b4ec0 0x7fbd940cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.821+0000 7fbd99600640 1 -- 172.21.15.96:0/1695774007 >> v1:172.21.15.155:6789/0 conn(0x7fbd940ccc20 legacy=0x7fbd9415fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.821+0000 7fbd99600640 1 -- 172.21.15.96:0/1695774007 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd940b4100 con 0x7fbd9415f6b0 2024-04-24T23:58:18.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.822+0000 7fbd99600640 1 --2- 172.21.15.96:0/1695774007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9415f6b0 0x7fbd940ce5e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009870 tx=0x7fbd8402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b942c86cb9f588f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd93e00640 1 -- 172.21.15.96:0/1695774007 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84037070 con 0x7fbd9415f6b0 2024-04-24T23:58:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd93e00640 1 -- 172.21.15.96:0/1695774007 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd84032440 con 0x7fbd9415f6b0 2024-04-24T23:58:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd93e00640 1 -- 172.21.15.96:0/1695774007 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84032810 con 0x7fbd9415f6b0 2024-04-24T23:58:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd9aa00640 1 -- 172.21.15.96:0/1695774007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9415f6b0 msgr2=0x7fbd940ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd9aa00640 1 --2- 172.21.15.96:0/1695774007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9415f6b0 0x7fbd940ce5e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009870 tx=0x7fbd8402a250 comp rx=0 tx=0).stop 2024-04-24T23:58:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd9aa00640 1 -- 172.21.15.96:0/1695774007 shutdown_connections 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd9aa00640 1 --2- 172.21.15.96:0/1695774007 >> v2:172.21.15.155:3300/0 conn(0x7fbd940b4ec0 0x7fbd940cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd9aa00640 1 --2- 172.21.15.96:0/1695774007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd9415f6b0 0x7fbd940ce5e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd9aa00640 1 -- 172.21.15.96:0/1695774007 >> 172.21.15.96:0/1695774007 conn(0x7fbd940b1f10 msgr2=0x7fbd940cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.823+0000 7fbd9aa00640 1 -- 172.21.15.96:0/1695774007 shutdown_connections 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.824+0000 7fbd9aa00640 1 -- 172.21.15.96:0/1695774007 wait complete. 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.825+0000 7fbd9aa00640 1 Processor -- start 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.825+0000 7fbd9aa00640 1 -- start start 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.826+0000 7fbd9aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd940b4ec0 0x7fbd9415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.826+0000 7fbd9aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd940ccc20 0x7fbd9414fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.826+0000 7fbd9aa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9415f6b0 0x7fbd9414c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.826+0000 7fbd9aa00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbd940ceb20 con 0x7fbd9415f6b0 2024-04-24T23:58:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.826+0000 7fbd9aa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbd940b46c0 con 0x7fbd940ccc20 2024-04-24T23:58:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.826+0000 7fbd9aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbd940cf1c0 con 0x7fbd940b4ec0 2024-04-24T23:58:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd9a000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9415f6b0 0x7fbd9414c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd9a000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9415f6b0 0x7fbd9414c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35554/0 (socket says 172.21.15.96:35554) 2024-04-24T23:58:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd9a000640 1 -- 172.21.15.96:0/801321305 learned_addr learned my addr 172.21.15.96:0/801321305 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd98c00640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd940ccc20 0x7fbd9414fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd99600640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd940b4ec0 0x7fbd9415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd9a000640 1 -- 172.21.15.96:0/801321305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd940b4ec0 msgr2=0x7fbd9415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd9a000640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd940b4ec0 0x7fbd9415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd9a000640 1 -- 172.21.15.96:0/801321305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd940ccc20 msgr2=0x7fbd9414fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd9a000640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd940ccc20 0x7fbd9414fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd9a000640 1 -- 172.21.15.96:0/801321305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9415d790 con 0x7fbd9415f6b0 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.827+0000 7fbd99600640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd940b4ec0 0x7fbd9415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.828+0000 7fbd9a000640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9415f6b0 0x7fbd9414c720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c001eb0 tx=0x7fbd8c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.828+0000 7fbd91600640 1 -- 172.21.15.96:0/801321305 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c017070 con 0x7fbd9415f6b0 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.828+0000 7fbd91600640 1 -- 172.21.15.96:0/801321305 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c0052d0 con 0x7fbd9415f6b0 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.828+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9415da70 con 0x7fbd9415f6b0 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.828+0000 7fbd91600640 1 -- 172.21.15.96:0/801321305 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c003810 con 0x7fbd9415f6b0 2024-04-24T23:58:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.828+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9415e030 con 0x7fbd9415f6b0 2024-04-24T23:58:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.829+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd9415e520 con 0x7fbd9415f6b0 2024-04-24T23:58:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.830+0000 7fbd91600640 1 -- 172.21.15.96:0/801321305 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd8c01a070 con 0x7fbd9415f6b0 2024-04-24T23:58:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.831+0000 7fbd91600640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd7406be60 0x7fbd7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.831+0000 7fbd91600640 1 -- 172.21.15.96:0/801321305 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbd8c08a170 con 0x7fbd9415f6b0 2024-04-24T23:58:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.832+0000 7fbd99600640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd7406be60 0x7fbd7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.832+0000 7fbd99600640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd7406be60 0x7fbd7406e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbd84034000 tx=0x7fbd8402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:18.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:18.836+0000 7fbd91600640 1 -- 172.21.15.96:0/801321305 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbd8c0584d0 con 0x7fbd9415f6b0 2024-04-24T23:58:19.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.071+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd94067e40 con 0x7fbd9415f6b0 2024-04-24T23:58:19.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.072+0000 7fbd91600640 1 -- 172.21.15.96:0/801321305 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5178 (secure 0 0 0) 0x7fbd8c05c7d0 con 0x7fbd9415f6b0 2024-04-24T23:58:19.072 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:19.072 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1694444006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1694444006},{"type":"v1","addr":"172.21.15.96:6837","nonce":1694444006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3646872561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6833","nonce":3646872561},{"type":"v1","addr":"172.21.15.155:6835","nonce":3646872561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/227257747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":227257747},{"type":"v1","addr":"172.21.15.96:6836","nonce":227257747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:58:05.205304+0000","modified":"2024-04-24T23:58:08.502172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6834/1986626476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1986626476},{"type":"v1","addr":"172.21.15.155:6834","nonce":1986626476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-24T23:58:19.072 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.074+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd7406be60 msgr2=0x7fbd7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.074+0000 7fbd9aa00640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd7406be60 0x7fbd7406e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbd84034000 tx=0x7fbd8402e000 comp rx=0 tx=0).stop 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.074+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9415f6b0 msgr2=0x7fbd9414c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.074+0000 7fbd9aa00640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9415f6b0 0x7fbd9414c720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c001eb0 tx=0x7fbd8c00c890 comp rx=0 tx=0).stop 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.074+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 shutdown_connections 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.075+0000 7fbd9aa00640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd7406be60 0x7fbd7406e320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.075+0000 7fbd9aa00640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9415f6b0 0x7fbd9414c720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.075+0000 7fbd9aa00640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd940ccc20 0x7fbd9414fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.075+0000 7fbd9aa00640 1 --2- 172.21.15.96:0/801321305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd940b4ec0 0x7fbd9415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.075+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 >> 172.21.15.96:0/801321305 conn(0x7fbd940b1f10 msgr2=0x7fbd940cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:19.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.075+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 shutdown_connections 2024-04-24T23:58:19.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.075+0000 7fbd9aa00640 1 -- 172.21.15.96:0/801321305 wait complete. 2024-04-24T23:58:19.093 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:19.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.283+0000 7f5887200640 1 Processor -- start 2024-04-24T23:58:19.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.284+0000 7f5887200640 1 -- start start 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.285+0000 7f5887200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 0x7f58880ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.285+0000 7f5887200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f58880ccdf0 0x7f5888070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.285+0000 7f5887200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f588815fa90 con 0x7f58880b4ec0 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.285+0000 7f5887200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f58880b4a30 con 0x7f58880ccdf0 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.285+0000 7f5887200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58880b3e20 con 0x7f588815f6b0 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.286+0000 7f5886800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f58880ccdf0 0x7f5888070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.286+0000 7f5886800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f58880ccdf0 0x7f5888070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35568/0 (socket says 172.21.15.96:35568) 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.286+0000 7f5886800640 1 -- 172.21.15.96:0/2864518245 learned_addr learned my addr 172.21.15.96:0/2864518245 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.286+0000 7f587fe00640 1 --1- 172.21.15.96:0/2864518245 >> v1:172.21.15.96:6789/0 conn(0x7f58880b4ec0 0x7f58880cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45872/0 (socket says 172.21.15.96:45872) 2024-04-24T23:58:19.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.286+0000 7f5885e00640 1 --2- 172.21.15.96:0/2864518245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 0x7f58880ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.286+0000 7f5886800640 1 -- 172.21.15.96:0/2864518245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 msgr2=0x7f58880ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:19.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.286+0000 7f5886800640 1 --2- 172.21.15.96:0/2864518245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 0x7f58880ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.286+0000 7f5886800640 1 -- 172.21.15.96:0/2864518245 >> v1:172.21.15.96:6789/0 conn(0x7f58880b4ec0 legacy=0x7f58880cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.286+0000 7f5886800640 1 -- 172.21.15.96:0/2864518245 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58880b4100 con 0x7f58880ccdf0 2024-04-24T23:58:19.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.287+0000 7f5886800640 1 --2- 172.21.15.96:0/2864518245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880ccdf0 0x7f5888070d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5880009e50 tx=0x7f588002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c774448ca6b31331 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:19.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5885400640 1 -- 172.21.15.96:0/2864518245 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880036070 con 0x7f58880ccdf0 2024-04-24T23:58:19.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5885400640 1 -- 172.21.15.96:0/2864518245 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5880031600 con 0x7f58880ccdf0 2024-04-24T23:58:19.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5885400640 1 -- 172.21.15.96:0/2864518245 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58800319d0 con 0x7f58880ccdf0 2024-04-24T23:58:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5887200640 1 -- 172.21.15.96:0/2864518245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880ccdf0 msgr2=0x7f5888070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5887200640 1 --2- 172.21.15.96:0/2864518245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880ccdf0 0x7f5888070d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5880009e50 tx=0x7f588002a710 comp rx=0 tx=0).stop 2024-04-24T23:58:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5887200640 1 -- 172.21.15.96:0/2864518245 shutdown_connections 2024-04-24T23:58:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5887200640 1 --2- 172.21.15.96:0/2864518245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880ccdf0 0x7f5888070d60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5887200640 1 --2- 172.21.15.96:0/2864518245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 0x7f58880ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5887200640 1 -- 172.21.15.96:0/2864518245 >> 172.21.15.96:0/2864518245 conn(0x7f58880b1f10 msgr2=0x7f58880cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5887200640 1 -- 172.21.15.96:0/2864518245 shutdown_connections 2024-04-24T23:58:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.288+0000 7f5887200640 1 -- 172.21.15.96:0/2864518245 wait complete. 2024-04-24T23:58:19.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.290+0000 7f5887200640 1 Processor -- start 2024-04-24T23:58:19.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.290+0000 7f5887200640 1 -- start start 2024-04-24T23:58:19.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.291+0000 7f5887200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880b4ec0 0x7f58880c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.291+0000 7f5887200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58880ccdf0 0x7f588809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.291+0000 7f5887200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 0x7f5888148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.291+0000 7f5887200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f58880ceb20 con 0x7f58880b4ec0 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.291+0000 7f5887200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f58880b46c0 con 0x7f58880ccdf0 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.291+0000 7f5887200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58880cf1c0 con 0x7f588815f6b0 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.291+0000 7f5885e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880b4ec0 0x7f58880c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.291+0000 7f5885e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880b4ec0 0x7f58880c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35582/0 (socket says 172.21.15.96:35582) 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.291+0000 7f5885e00640 1 -- 172.21.15.96:0/2485795806 learned_addr learned my addr 172.21.15.96:0/2485795806 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f5886800640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 0x7f5888148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f5885e00640 1 -- 172.21.15.96:0/2485795806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 msgr2=0x7f5888148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f5885e00640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 0x7f5888148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f5885e00640 1 -- 172.21.15.96:0/2485795806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58880ccdf0 msgr2=0x7f588809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f5885e00640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58880ccdf0 0x7f588809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f5885e00640 1 -- 172.21.15.96:0/2485795806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588809dad0 con 0x7f58880b4ec0 2024-04-24T23:58:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f5885e00640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880b4ec0 0x7f58880c8f60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f587800d5f0 tx=0x7f587800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f587e000640 1 -- 172.21.15.96:0/2485795806 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780125f0 con 0x7f58880b4ec0 2024-04-24T23:58:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f587e000640 1 -- 172.21.15.96:0/2485795806 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5878019070 con 0x7f58880b4ec0 2024-04-24T23:58:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f587e000640 1 -- 172.21.15.96:0/2485795806 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780129d0 con 0x7f58880b4ec0 2024-04-24T23:58:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.292+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588809d550 con 0x7f58880b4ec0 2024-04-24T23:58:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.293+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f588809d7f0 con 0x7f58880b4ec0 2024-04-24T23:58:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.294+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58880728d0 con 0x7f58880b4ec0 2024-04-24T23:58:19.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.295+0000 7f587e000640 1 -- 172.21.15.96:0/2485795806 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5878012b70 con 0x7f58880b4ec0 2024-04-24T23:58:19.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.296+0000 7f587e000640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f586406be30 0x7f586406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.296+0000 7f587e000640 1 -- 172.21.15.96:0/2485795806 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f587808b280 con 0x7f58880b4ec0 2024-04-24T23:58:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.296+0000 7f587fe00640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f586406be30 0x7f586406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.296+0000 7f587fe00640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f586406be30 0x7f586406e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5870000f60 tx=0x7f5870007a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:19.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.300+0000 7f587e000640 1 -- 172.21.15.96:0/2485795806 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f58880728d0 con 0x7f58880b4ec0 2024-04-24T23:58:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.499+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58880d07d0 con 0x7f58880b4ec0 2024-04-24T23:58:19.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.500+0000 7f587e000640 1 -- 172.21.15.96:0/2485795806 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7f5878059c20 con 0x7f58880b4ec0 2024-04-24T23:58:19.501 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:19.501 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:19.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f586406be30 msgr2=0x7f586406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f586406be30 0x7f586406e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5870000f60 tx=0x7f5870007a00 comp rx=0 tx=0).stop 2024-04-24T23:58:19.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880b4ec0 msgr2=0x7f58880c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880b4ec0 0x7f58880c8f60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f587800d5f0 tx=0x7f587800dab0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 shutdown_connections 2024-04-24T23:58:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588815f6b0 0x7f5888148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58880ccdf0 0x7f588809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f586406be30 0x7f586406e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 --2- 172.21.15.96:0/2485795806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58880b4ec0 0x7f58880c8f60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 >> 172.21.15.96:0/2485795806 conn(0x7f58880b1f10 msgr2=0x7f58880b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 shutdown_connections 2024-04-24T23:58:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.503+0000 7f5887200640 1 -- 172.21.15.96:0/2485795806 wait complete. 2024-04-24T23:58:19.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:19.523 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:19.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.720+0000 7fde6b200640 1 Processor -- start 2024-04-24T23:58:19.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.720+0000 7fde6b200640 1 -- start start 2024-04-24T23:58:19.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde6b200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fde641551c0 0x7fde6415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde6b200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fde640726d0 0x7fde64072b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde6b200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde6415f750 con 0x7fde6406edb0 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde6b200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fde6415f190 con 0x7fde640726d0 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde6b200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fde6415f470 con 0x7fde641551c0 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde69200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fde640726d0 0x7fde64072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde69200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fde640726d0 0x7fde64072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35588/0 (socket says 172.21.15.96:35588) 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde69200640 1 -- 172.21.15.96:0/561258011 learned_addr learned my addr 172.21.15.96:0/561258011 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde63e00640 1 --2- 172.21.15.96:0/561258011 >> v2:172.21.15.155:3300/0 conn(0x7fde641551c0 0x7fde6415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde69200640 1 -- 172.21.15.96:0/561258011 >> v2:172.21.15.155:3300/0 conn(0x7fde641551c0 msgr2=0x7fde6415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde69200640 1 --2- 172.21.15.96:0/561258011 >> v2:172.21.15.155:3300/0 conn(0x7fde641551c0 0x7fde6415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde69200640 1 -- 172.21.15.96:0/561258011 >> v1:172.21.15.155:6789/0 conn(0x7fde6406edb0 legacy=0x7fde640b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde69200640 1 -- 172.21.15.96:0/561258011 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde64071150 con 0x7fde640726d0 2024-04-24T23:58:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.722+0000 7fde63e00640 1 --2- 172.21.15.96:0/561258011 >> v2:172.21.15.155:3300/0 conn(0x7fde641551c0 0x7fde6415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:19.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.723+0000 7fde69200640 1 --2- 172.21.15.96:0/561258011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 0x7fde64072b60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde64070980 tx=0x7fde5c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7c89600c4f36f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.724+0000 7fde62a00640 1 -- 172.21.15.96:0/561258011 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c036070 con 0x7fde640726d0 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.724+0000 7fde62a00640 1 -- 172.21.15.96:0/561258011 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c031600 con 0x7fde640726d0 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.724+0000 7fde62a00640 1 -- 172.21.15.96:0/561258011 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0319d0 con 0x7fde640726d0 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.724+0000 7fde6b200640 1 -- 172.21.15.96:0/561258011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 msgr2=0x7fde64072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.724+0000 7fde6b200640 1 --2- 172.21.15.96:0/561258011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 0x7fde64072b60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde64070980 tx=0x7fde5c02a660 comp rx=0 tx=0).stop 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.725+0000 7fde6b200640 1 -- 172.21.15.96:0/561258011 shutdown_connections 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.725+0000 7fde6b200640 1 --2- 172.21.15.96:0/561258011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 0x7fde64072b60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.725+0000 7fde6b200640 1 --2- 172.21.15.96:0/561258011 >> v2:172.21.15.155:3300/0 conn(0x7fde641551c0 0x7fde6415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.725+0000 7fde6b200640 1 -- 172.21.15.96:0/561258011 >> 172.21.15.96:0/561258011 conn(0x7fde640b19c0 msgr2=0x7fde640b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.725+0000 7fde6b200640 1 -- 172.21.15.96:0/561258011 shutdown_connections 2024-04-24T23:58:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.725+0000 7fde6b200640 1 -- 172.21.15.96:0/561258011 wait complete. 2024-04-24T23:58:19.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.726+0000 7fde6b200640 1 Processor -- start 2024-04-24T23:58:19.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.726+0000 7fde6b200640 1 -- start start 2024-04-24T23:58:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.727+0000 7fde6b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6406edb0 0x7fde6409b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.727+0000 7fde6b200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 0x7fde6409b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.727+0000 7fde6b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde641551c0 0x7fde641e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.727+0000 7fde6b200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fde641555a0 con 0x7fde640726d0 2024-04-24T23:58:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.727+0000 7fde6b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde640b33d0 con 0x7fde6406edb0 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.727+0000 7fde6b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde6415ed30 con 0x7fde641551c0 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 0x7fde6409b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 0x7fde6409b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35600/0 (socket says 172.21.15.96:35600) 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63400640 1 -- 172.21.15.96:0/1508750230 learned_addr learned my addr 172.21.15.96:0/1508750230 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63e00640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6406edb0 0x7fde6409b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63400640 1 -- 172.21.15.96:0/1508750230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde641551c0 msgr2=0x7fde641e9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63400640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde641551c0 0x7fde641e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63400640 1 -- 172.21.15.96:0/1508750230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6406edb0 msgr2=0x7fde6409b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63400640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6406edb0 0x7fde6409b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63400640 1 -- 172.21.15.96:0/1508750230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6409b5f0 con 0x7fde640726d0 2024-04-24T23:58:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.728+0000 7fde63400640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 0x7fde6409b850 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00c410 tx=0x7fde4c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.729+0000 7fde5be00640 1 -- 172.21.15.96:0/1508750230 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c017070 con 0x7fde640726d0 2024-04-24T23:58:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.729+0000 7fde5be00640 1 -- 172.21.15.96:0/1508750230 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4c0035f0 con 0x7fde640726d0 2024-04-24T23:58:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.729+0000 7fde5be00640 1 -- 172.21.15.96:0/1508750230 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c003a20 con 0x7fde640726d0 2024-04-24T23:58:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.729+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde641e8ea0 con 0x7fde640726d0 2024-04-24T23:58:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.729+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde641e9460 con 0x7fde640726d0 2024-04-24T23:58:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.730+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde64069110 con 0x7fde640726d0 2024-04-24T23:58:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.731+0000 7fde5be00640 1 -- 172.21.15.96:0/1508750230 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde4c003bc0 con 0x7fde640726d0 2024-04-24T23:58:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.732+0000 7fde5be00640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fde4006be30 0x7fde4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.732+0000 7fde5be00640 1 -- 172.21.15.96:0/1508750230 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fde4c08a1a0 con 0x7fde640726d0 2024-04-24T23:58:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.732+0000 7fde63e00640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fde4006be30 0x7fde4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.733+0000 7fde63e00640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fde4006be30 0x7fde4006e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde5400a950 tx=0x7fde54008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.736+0000 7fde5be00640 1 -- 172.21.15.96:0/1508750230 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fde4c058b40 con 0x7fde640726d0 2024-04-24T23:58:19.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.927+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fde640b4e00 con 0x7fde640726d0 2024-04-24T23:58:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.928+0000 7fde5be00640 1 -- 172.21.15.96:0/1508750230 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fde4c0010c0 con 0x7fde640726d0 2024-04-24T23:58:19.928 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fde4006be30 msgr2=0x7fde4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fde4006be30 0x7fde4006e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde5400a950 tx=0x7fde54008040 comp rx=0 tx=0).stop 2024-04-24T23:58:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 msgr2=0x7fde6409b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 0x7fde6409b850 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00c410 tx=0x7fde4c00c8d0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 shutdown_connections 2024-04-24T23:58:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde641551c0 0x7fde641e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fde4006be30 0x7fde4006e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde640726d0 0x7fde6409b850 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 --2- 172.21.15.96:0/1508750230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6406edb0 0x7fde6409b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 >> 172.21.15.96:0/1508750230 conn(0x7fde640b19c0 msgr2=0x7fde64074210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 shutdown_connections 2024-04-24T23:58:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:19.931+0000 7fde6b200640 1 -- 172.21.15.96:0/1508750230 wait complete. 2024-04-24T23:58:19.950 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:20.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.144+0000 7f3129e00640 1 Processor -- start 2024-04-24T23:58:20.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.144+0000 7f3129e00640 1 -- start start 2024-04-24T23:58:20.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3129e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f31240b2cc0 0x7f3124071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3129e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 0x7f312406d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3129e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31240b3150 con 0x7f312406d420 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3129e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f31240b3430 con 0x7f31240b2cc0 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3129e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f31240b3710 con 0x7f3124071d80 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3122000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f31240b2cc0 0x7f3124071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3122000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f31240b2cc0 0x7f3124071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35606/0 (socket says 172.21.15.96:35606) 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3122000640 1 -- 172.21.15.96:0/4124420063 learned_addr learned my addr 172.21.15.96:0/4124420063 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3122000640 1 -- 172.21.15.96:0/4124420063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 msgr2=0x7f312406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3122000640 1 --2- 172.21.15.96:0/4124420063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 0x7f312406d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.146+0000 7f3122000640 1 -- 172.21.15.96:0/4124420063 >> v1:172.21.15.155:6789/0 conn(0x7f312406d420 legacy=0x7f31240aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.147+0000 7f3122000640 1 -- 172.21.15.96:0/4124420063 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31240b39f0 con 0x7f31240b2cc0 2024-04-24T23:58:20.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.147+0000 7f3122000640 1 --2- 172.21.15.96:0/4124420063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31240b2cc0 0x7f3124071840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f310c009870 tx=0x7f310c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75799824ae02aa71 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:20.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.148+0000 7f3121600640 1 -- 172.21.15.96:0/4124420063 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c037070 con 0x7f31240b2cc0 2024-04-24T23:58:20.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.148+0000 7f3121600640 1 -- 172.21.15.96:0/4124420063 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c032440 con 0x7f31240b2cc0 2024-04-24T23:58:20.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.148+0000 7f3121600640 1 -- 172.21.15.96:0/4124420063 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c032810 con 0x7f31240b2cc0 2024-04-24T23:58:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.148+0000 7f3129e00640 1 -- 172.21.15.96:0/4124420063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31240b2cc0 msgr2=0x7f3124071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.148+0000 7f3129e00640 1 --2- 172.21.15.96:0/4124420063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31240b2cc0 0x7f3124071840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f310c009870 tx=0x7f310c02a2a0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.149+0000 7f3129e00640 1 -- 172.21.15.96:0/4124420063 shutdown_connections 2024-04-24T23:58:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.149+0000 7f3129e00640 1 --2- 172.21.15.96:0/4124420063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 0x7f312406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.149+0000 7f3129e00640 1 --2- 172.21.15.96:0/4124420063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31240b2cc0 0x7f3124071840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.149+0000 7f3129e00640 1 -- 172.21.15.96:0/4124420063 >> 172.21.15.96:0/4124420063 conn(0x7f31240b19c0 msgr2=0x7f31240b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.149+0000 7f3129e00640 1 -- 172.21.15.96:0/4124420063 shutdown_connections 2024-04-24T23:58:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.149+0000 7f3129e00640 1 -- 172.21.15.96:0/4124420063 wait complete. 2024-04-24T23:58:20.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.150+0000 7f3129e00640 1 Processor -- start 2024-04-24T23:58:20.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.150+0000 7f3129e00640 1 -- start start 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.151+0000 7f3129e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f312406d420 0x7f312415d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.151+0000 7f3129e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 0x7f3124145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.151+0000 7f3129e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f312409bac0 0x7f312409bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.151+0000 7f3129e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f312406dd40 con 0x7f312409bac0 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.151+0000 7f3129e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f312415aa20 con 0x7f312406d420 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.151+0000 7f3129e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f312406dec0 con 0x7f3124071d80 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3123400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f312409bac0 0x7f312409bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3123400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f312409bac0 0x7f312409bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35612/0 (socket says 172.21.15.96:35612) 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3123400640 1 -- 172.21.15.96:0/1129429652 learned_addr learned my addr 172.21.15.96:0/1129429652 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3122000640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 0x7f3124145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3122a00640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f312406d420 0x7f312415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3123400640 1 -- 172.21.15.96:0/1129429652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 msgr2=0x7f3124145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3123400640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 0x7f3124145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3123400640 1 -- 172.21.15.96:0/1129429652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f312406d420 msgr2=0x7f312415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3123400640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f312406d420 0x7f312415d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3123400640 1 -- 172.21.15.96:0/1129429652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312415aba0 con 0x7f312409bac0 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3122000640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 0x7f3124145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.152+0000 7f3123400640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f312409bac0 0x7f312409bf40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f311c00b9e0 tx=0x7f311c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.153+0000 7f311b400640 1 -- 172.21.15.96:0/1129429652 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c019070 con 0x7f312409bac0 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.153+0000 7f311b400640 1 -- 172.21.15.96:0/1129429652 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f311c00cb40 con 0x7f312409bac0 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.153+0000 7f311b400640 1 -- 172.21.15.96:0/1129429652 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c014440 con 0x7f312409bac0 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.153+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31240ca200 con 0x7f312409bac0 2024-04-24T23:58:20.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.153+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3124158650 con 0x7f312409bac0 2024-04-24T23:58:20.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.154+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3124069110 con 0x7f312409bac0 2024-04-24T23:58:20.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.155+0000 7f311b400640 1 -- 172.21.15.96:0/1129429652 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f311c01c070 con 0x7f312409bac0 2024-04-24T23:58:20.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.156+0000 7f311b400640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f310006be30 0x7f310006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.156+0000 7f311b400640 1 -- 172.21.15.96:0/1129429652 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f311c08aba0 con 0x7f312409bac0 2024-04-24T23:58:20.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.156+0000 7f3122a00640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f310006be30 0x7f310006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.156+0000 7f3122a00640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f310006be30 0x7f310006e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3114007fd0 tx=0x7f3114009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:20.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.160+0000 7f311b400640 1 -- 172.21.15.96:0/1129429652 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f312415aba0 con 0x7f312409bac0 2024-04-24T23:58:20.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.357+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f31240afc40 con 0x7f312409bac0 2024-04-24T23:58:20.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.358+0000 7f311b400640 1 -- 172.21.15.96:0/1129429652 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f311c059540 con 0x7f312409bac0 2024-04-24T23:58:20.358 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.360+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f310006be30 msgr2=0x7f310006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.360+0000 7f3129e00640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f310006be30 0x7f310006e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3114007fd0 tx=0x7f3114009040 comp rx=0 tx=0).stop 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.360+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f312409bac0 msgr2=0x7f312409bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.360+0000 7f3129e00640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f312409bac0 0x7f312409bf40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f311c00b9e0 tx=0x7f311c00bea0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.361+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 shutdown_connections 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.361+0000 7f3129e00640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f310006be30 0x7f310006e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.361+0000 7f3129e00640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f312409bac0 0x7f312409bf40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.361+0000 7f3129e00640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3124071d80 0x7f3124145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.361+0000 7f3129e00640 1 --2- 172.21.15.96:0/1129429652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f312406d420 0x7f312415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.361+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 >> 172.21.15.96:0/1129429652 conn(0x7f31240b19c0 msgr2=0x7f31240add80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:20.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.361+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 shutdown_connections 2024-04-24T23:58:20.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.361+0000 7f3129e00640 1 -- 172.21.15.96:0/1129429652 wait complete. 2024-04-24T23:58:20.377 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.571+0000 7f1225e00640 1 Processor -- start 2024-04-24T23:58:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.571+0000 7f1225e00640 1 -- start start 2024-04-24T23:58:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.573+0000 7f1225e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f122015b090 0x7f122009db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.573+0000 7f1225e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f122006ec40 0x7f12200add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.573+0000 7f1225e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12200ad820 con 0x7f12200b2cc0 2024-04-24T23:58:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.573+0000 7f1225e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f12200b3260 con 0x7f122006ec40 2024-04-24T23:58:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.573+0000 7f1225e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f12200b3540 con 0x7f122015b090 2024-04-24T23:58:20.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.573+0000 7f121f400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f122006ec40 0x7f12200add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.573+0000 7f121f400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f122006ec40 0x7f12200add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35628/0 (socket says 172.21.15.96:35628) 2024-04-24T23:58:20.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.573+0000 7f121f400640 1 -- 172.21.15.96:0/3172277055 learned_addr learned my addr 172.21.15.96:0/3172277055 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:20.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.574+0000 7f121ea00640 1 --2- 172.21.15.96:0/3172277055 >> v2:172.21.15.155:3300/0 conn(0x7f122015b090 0x7f122009db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.574+0000 7f121f400640 1 -- 172.21.15.96:0/3172277055 >> v2:172.21.15.155:3300/0 conn(0x7f122015b090 msgr2=0x7f122009db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:20.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.574+0000 7f121f400640 1 --2- 172.21.15.96:0/3172277055 >> v2:172.21.15.155:3300/0 conn(0x7f122015b090 0x7f122009db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.574+0000 7f121f400640 1 -- 172.21.15.96:0/3172277055 >> v1:172.21.15.155:6789/0 conn(0x7f12200b2cc0 legacy=0x7f122006e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:20.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.574+0000 7f121f400640 1 -- 172.21.15.96:0/3172277055 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12200b3820 con 0x7f122006ec40 2024-04-24T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.575+0000 7f121f400640 1 --2- 172.21.15.96:0/3172277055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122006ec40 0x7f12200add00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f12200709b0 tx=0x7f121802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaea20bbb675c98 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.575+0000 7f121e000640 1 -- 172.21.15.96:0/3172277055 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218036070 con 0x7f122006ec40 2024-04-24T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.575+0000 7f121e000640 1 -- 172.21.15.96:0/3172277055 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1218031600 con 0x7f122006ec40 2024-04-24T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.575+0000 7f121e000640 1 -- 172.21.15.96:0/3172277055 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12180319d0 con 0x7f122006ec40 2024-04-24T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.576+0000 7f1225e00640 1 -- 172.21.15.96:0/3172277055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122006ec40 msgr2=0x7f12200add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.576+0000 7f1225e00640 1 --2- 172.21.15.96:0/3172277055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122006ec40 0x7f12200add00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f12200709b0 tx=0x7f121802a6f0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.576+0000 7f1225e00640 1 -- 172.21.15.96:0/3172277055 shutdown_connections 2024-04-24T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.576+0000 7f1225e00640 1 --2- 172.21.15.96:0/3172277055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122006ec40 0x7f12200add00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.576+0000 7f1225e00640 1 --2- 172.21.15.96:0/3172277055 >> v2:172.21.15.155:3300/0 conn(0x7f122015b090 0x7f122009db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.576+0000 7f1225e00640 1 -- 172.21.15.96:0/3172277055 >> 172.21.15.96:0/3172277055 conn(0x7f12200b19c0 msgr2=0x7f12200b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:20.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.576+0000 7f1225e00640 1 -- 172.21.15.96:0/3172277055 shutdown_connections 2024-04-24T23:58:20.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.576+0000 7f1225e00640 1 -- 172.21.15.96:0/3172277055 wait complete. 2024-04-24T23:58:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.578+0000 7f1225e00640 1 Processor -- start 2024-04-24T23:58:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.578+0000 7f1225e00640 1 -- start start 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f1225e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f122006ec40 0x7f12201f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f1225e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12200b2cc0 0x7f122014b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f1225e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f122015b090 0x7f122009d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f1225e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f122015b470 con 0x7f12200b2cc0 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f1225e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12200b4f70 con 0x7f122006ec40 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f1225e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1220070e10 con 0x7f122015b090 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f1217e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12200b2cc0 0x7f122014b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f1217e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12200b2cc0 0x7f122014b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35638/0 (socket says 172.21.15.96:35638) 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f1217e00640 1 -- 172.21.15.96:0/1410277493 learned_addr learned my addr 172.21.15.96:0/1410277493 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f121ea00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f122006ec40 0x7f12201f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.579+0000 7f121f400640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f122015b090 0x7f122009d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1217e00640 1 -- 172.21.15.96:0/1410277493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f122015b090 msgr2=0x7f122009d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1217e00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f122015b090 0x7f122009d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1217e00640 1 -- 172.21.15.96:0/1410277493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f122006ec40 msgr2=0x7f12201f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1217e00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f122006ec40 0x7f12201f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1217e00640 1 -- 172.21.15.96:0/1410277493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122009c850 con 0x7f12200b2cc0 2024-04-24T23:58:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1217e00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12200b2cc0 0x7f122014b3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f120800c460 tx=0x7f120800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1217400640 1 -- 172.21.15.96:0/1410277493 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208016020 con 0x7f12200b2cc0 2024-04-24T23:58:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1217400640 1 -- 172.21.15.96:0/1410277493 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1208012870 con 0x7f12200b2cc0 2024-04-24T23:58:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122009cb30 con 0x7f12200b2cc0 2024-04-24T23:58:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1217400640 1 -- 172.21.15.96:0/1410277493 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208012c60 con 0x7f12200b2cc0 2024-04-24T23:58:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.580+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122009ce10 con 0x7f12200b2cc0 2024-04-24T23:58:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.582+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1220069110 con 0x7f12200b2cc0 2024-04-24T23:58:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.582+0000 7f1217400640 1 -- 172.21.15.96:0/1410277493 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1208019020 con 0x7f12200b2cc0 2024-04-24T23:58:20.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.583+0000 7f1217400640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f11fc06be30 0x7f11fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:20.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.583+0000 7f1217400640 1 -- 172.21.15.96:0/1410277493 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f120808aba0 con 0x7f12200b2cc0 2024-04-24T23:58:20.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.584+0000 7f121ea00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f11fc06be30 0x7f11fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:20.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.584+0000 7f121ea00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f11fc06be30 0x7f11fc06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1210006fd0 tx=0x7f1210008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:20.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.588+0000 7f1217400640 1 -- 172.21.15.96:0/1410277493 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1208020030 con 0x7f12200b2cc0 2024-04-24T23:58:20.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.788+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f122006d050 con 0x7f12200b2cc0 2024-04-24T23:58:20.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.789+0000 7f1217400640 1 -- 172.21.15.96:0/1410277493 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f1208059540 con 0x7f12200b2cc0 2024-04-24T23:58:20.790 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f11fc06be30 msgr2=0x7f11fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f11fc06be30 0x7f11fc06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1210006fd0 tx=0x7f1210008040 comp rx=0 tx=0).stop 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12200b2cc0 msgr2=0x7f122014b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12200b2cc0 0x7f122014b3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f120800c460 tx=0x7f120800c920 comp rx=0 tx=0).stop 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 shutdown_connections 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f122015b090 0x7f122009d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f11fc06be30 0x7f11fc06e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12200b2cc0 0x7f122014b3e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 --2- 172.21.15.96:0/1410277493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f122006ec40 0x7f12201f8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 >> 172.21.15.96:0/1410277493 conn(0x7f12200b19c0 msgr2=0x7f122006e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 shutdown_connections 2024-04-24T23:58:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:20.792+0000 7f1225e00640 1 -- 172.21.15.96:0/1410277493 wait complete. 2024-04-24T23:58:20.809 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:58:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.002+0000 7fb82b200640 1 Processor -- start 2024-04-24T23:58:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.002+0000 7fb82b200640 1 -- start start 2024-04-24T23:58:21.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb82b200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb82c0b4ec0 0x7fb82c0cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb82b200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb82c0ccc20 0x7fb82c070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb82b200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82c15fa90 con 0x7fb82c15f6b0 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb82b200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb82c0b4a30 con 0x7fb82c0b4ec0 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb82b200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb82c0b3e20 con 0x7fb82c0ccc20 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb829400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb82c0b4ec0 0x7fb82c0cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb829400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb82c0b4ec0 0x7fb82c0cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35642/0 (socket says 172.21.15.96:35642) 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb829400640 1 -- 172.21.15.96:0/3183233437 learned_addr learned my addr 172.21.15.96:0/3183233437 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb829e00640 1 --1- 172.21.15.96:0/3183233437 >> v1:172.21.15.96:6789/0 conn(0x7fb82c15f6b0 0x7fb82c0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45876/0 (socket says 172.21.15.96:45876) 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb829400640 1 -- 172.21.15.96:0/3183233437 >> v2:172.21.15.155:3300/0 conn(0x7fb82c0ccc20 msgr2=0x7fb82c070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb829400640 1 --2- 172.21.15.96:0/3183233437 >> v2:172.21.15.155:3300/0 conn(0x7fb82c0ccc20 0x7fb82c070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb829400640 1 -- 172.21.15.96:0/3183233437 >> v1:172.21.15.96:6789/0 conn(0x7fb82c15f6b0 legacy=0x7fb82c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.004+0000 7fb829400640 1 -- 172.21.15.96:0/3183233437 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c0b4100 con 0x7fb82c0b4ec0 2024-04-24T23:58:21.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.005+0000 7fb829400640 1 --2- 172.21.15.96:0/3183233437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c0b4ec0 0x7fb82c0cc6e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb82c06f1f0 tx=0x7fb81802a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3eb65a4d74866d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb828a00640 1 -- 172.21.15.96:0/3183233437 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818037070 con 0x7fb82c0b4ec0 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb828a00640 1 -- 172.21.15.96:0/3183233437 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb818032440 con 0x7fb82c0b4ec0 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb828a00640 1 -- 172.21.15.96:0/3183233437 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818032810 con 0x7fb82c0b4ec0 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb82b200640 1 -- 172.21.15.96:0/3183233437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c0b4ec0 msgr2=0x7fb82c0cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb82b200640 1 --2- 172.21.15.96:0/3183233437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c0b4ec0 0x7fb82c0cc6e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb82c06f1f0 tx=0x7fb81802a280 comp rx=0 tx=0).stop 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb82b200640 1 -- 172.21.15.96:0/3183233437 shutdown_connections 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb82b200640 1 --2- 172.21.15.96:0/3183233437 >> v2:172.21.15.155:3300/0 conn(0x7fb82c0ccc20 0x7fb82c070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb82b200640 1 --2- 172.21.15.96:0/3183233437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c0b4ec0 0x7fb82c0cc6e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb82b200640 1 -- 172.21.15.96:0/3183233437 >> 172.21.15.96:0/3183233437 conn(0x7fb82c0b1f10 msgr2=0x7fb82c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.006+0000 7fb82b200640 1 -- 172.21.15.96:0/3183233437 shutdown_connections 2024-04-24T23:58:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.007+0000 7fb82b200640 1 -- 172.21.15.96:0/3183233437 wait complete. 2024-04-24T23:58:21.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.008+0000 7fb82b200640 1 Processor -- start 2024-04-24T23:58:21.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.008+0000 7fb82b200640 1 -- start start 2024-04-24T23:58:21.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.009+0000 7fb82b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82c0b4ec0 0x7fb82c149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.009+0000 7fb82b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb82c0ccc20 0x7fb82c1e6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.009+0000 7fb82b200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c15f6b0 0x7fb82c0addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.009+0000 7fb82b200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c0cf1c0 con 0x7fb82c15f6b0 2024-04-24T23:58:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.009+0000 7fb82b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c0b46c0 con 0x7fb82c0b4ec0 2024-04-24T23:58:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.009+0000 7fb82b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c0b3a40 con 0x7fb82c0ccc20 2024-04-24T23:58:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.009+0000 7fb82a800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c15f6b0 0x7fb82c0addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb82a800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c15f6b0 0x7fb82c0addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35650/0 (socket says 172.21.15.96:35650) 2024-04-24T23:58:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb82a800640 1 -- 172.21.15.96:0/2593974485 learned_addr learned my addr 172.21.15.96:0/2593974485 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:21.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb829e00640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82c0b4ec0 0x7fb82c149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb829400640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb82c0ccc20 0x7fb82c1e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb82a800640 1 -- 172.21.15.96:0/2593974485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb82c0ccc20 msgr2=0x7fb82c1e6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb82a800640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb82c0ccc20 0x7fb82c1e6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb82a800640 1 -- 172.21.15.96:0/2593974485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82c0b4ec0 msgr2=0x7fb82c149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb82a800640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82c0b4ec0 0x7fb82c149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb82a800640 1 -- 172.21.15.96:0/2593974485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c1f2d80 con 0x7fb82c15f6b0 2024-04-24T23:58:21.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb82a800640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c15f6b0 0x7fb82c0addf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb82400b970 tx=0x7fb82400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:21.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb822000640 1 -- 172.21.15.96:0/2593974485 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824019070 con 0x7fb82c15f6b0 2024-04-24T23:58:21.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb822000640 1 -- 172.21.15.96:0/2593974485 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82400cb60 con 0x7fb82c15f6b0 2024-04-24T23:58:21.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb822000640 1 -- 172.21.15.96:0/2593974485 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824014440 con 0x7fb82c15f6b0 2024-04-24T23:58:21.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.010+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c1f3060 con 0x7fb82c15f6b0 2024-04-24T23:58:21.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.011+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c1f3620 con 0x7fb82c15f6b0 2024-04-24T23:58:21.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.012+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82c067e40 con 0x7fb82c15f6b0 2024-04-24T23:58:21.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.013+0000 7fb822000640 1 -- 172.21.15.96:0/2593974485 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb82401c070 con 0x7fb82c15f6b0 2024-04-24T23:58:21.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.013+0000 7fb822000640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb80c06be60 0x7fb80c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.014+0000 7fb822000640 1 -- 172.21.15.96:0/2593974485 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb82408ab10 con 0x7fb82c15f6b0 2024-04-24T23:58:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.014+0000 7fb829e00640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb80c06be60 0x7fb80c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.014+0000 7fb829e00640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb80c06be60 0x7fb80c06e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb81c000f60 tx=0x7fb81c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:21.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.018+0000 7fb822000640 1 -- 172.21.15.96:0/2593974485 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb824059550 con 0x7fb82c15f6b0 2024-04-24T23:58:21.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.258+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb82c0d07d0 con 0x7fb82c15f6b0 2024-04-24T23:58:21.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.259+0000 7fb822000640 1 -- 172.21.15.96:0/2593974485 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5178 (secure 0 0 0) 0x7fb824058e50 con 0x7fb82c15f6b0 2024-04-24T23:58:21.259 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:21.259 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1694444006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1694444006},{"type":"v1","addr":"172.21.15.96:6837","nonce":1694444006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3646872561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6833","nonce":3646872561},{"type":"v1","addr":"172.21.15.155:6835","nonce":3646872561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/227257747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":227257747},{"type":"v1","addr":"172.21.15.96:6836","nonce":227257747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:58:05.205304+0000","modified":"2024-04-24T23:58:08.502172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6834/1986626476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1986626476},{"type":"v1","addr":"172.21.15.155:6834","nonce":1986626476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-24T23:58:21.259 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-04-24T23:58:21.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb80c06be60 msgr2=0x7fb80c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb80c06be60 0x7fb80c06e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb81c000f60 tx=0x7fb81c009040 comp rx=0 tx=0).stop 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c15f6b0 msgr2=0x7fb82c0addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c15f6b0 0x7fb82c0addf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb82400b970 tx=0x7fb82400be30 comp rx=0 tx=0).stop 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 shutdown_connections 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb80c06be60 0x7fb80c06e320 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb82c15f6b0 0x7fb82c0addf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb82c0ccc20 0x7fb82c1e6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 --2- 172.21.15.96:0/2593974485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82c0b4ec0 0x7fb82c149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.262+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 >> 172.21.15.96:0/2593974485 conn(0x7fb82c0b1f10 msgr2=0x7fb82c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.263+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 shutdown_connections 2024-04-24T23:58:21.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.263+0000 7fb82b200640 1 -- 172.21.15.96:0/2593974485 wait complete. 2024-04-24T23:58:21.281 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:21.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.459+0000 7fa4dc000640 1 Processor -- start 2024-04-24T23:58:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.460+0000 7fa4dc000640 1 -- start start 2024-04-24T23:58:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.461+0000 7fa4dc000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d4070df0 0x7fa4d415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.461+0000 7fa4dc000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4d40b2cc0 0x7fa4d40b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.461+0000 7fa4dc000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d40713d0 con 0x7fa4d415b220 2024-04-24T23:58:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.461+0000 7fa4dc000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d40aee00 con 0x7fa4d40b2cc0 2024-04-24T23:58:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.461+0000 7fa4dc000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d40ae4d0 con 0x7fa4d4070df0 2024-04-24T23:58:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.461+0000 7fa4d9600640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa4d415b220 0x7fa4d415ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45884/0 (socket says 172.21.15.96:45884) 2024-04-24T23:58:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.461+0000 7fa4d9600640 1 -- 172.21.15.96:0/2291177047 learned_addr learned my addr 172.21.15.96:0/2291177047 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:21.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3323054289 0 0) 0x7fa4d40713d0 con 0x7fa4d415b220 2024-04-24T23:58:21.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4bc005730 con 0x7fa4d415b220 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4da000640 1 --2- 172.21.15.96:0/2291177047 >> v2:172.21.15.155:3300/0 conn(0x7fa4d40b2cc0 0x7fa4d40b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d8c00640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d4070df0 0x7fa4d415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2008792879 0 0) 0x7fa4bc005730 con 0x7fa4d415b220 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d4070df0 msgr2=0x7fa4d415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d4070df0 0x7fa4d415f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 >> v2:172.21.15.155:3300/0 conn(0x7fa4d40b2cc0 msgr2=0x7fa4d40b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 --2- 172.21.15.96:0/2291177047 >> v2:172.21.15.155:3300/0 conn(0x7fa4d40b2cc0 0x7fa4d40b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d40ae7b0 con 0x7fa4d415b220 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fa4c8001670 con 0x7fa4d415b220 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 >> v1:172.21.15.96:6789/0 conn(0x7fa4d415b220 legacy=0x7fa4d415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d4070df0 0x7fa4bc005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4bc0061f0 0x7fa4bc006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4bc006f50 0x7fa4bc0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d40aee00 con 0x7fa4bc0061f0 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d40ae4d0 con 0x7fa4bc006f50 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa4bc00dcd0 con 0x7fa4d4070df0 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.462+0000 7fa4da000640 1 --2- 172.21.15.96:0/2291177047 >> v2:172.21.15.155:3300/0 conn(0x7fa4d40b2cc0 0x7fa4d40b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.463+0000 7fa4d8c00640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4bc0061f0 0x7fa4bc006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.463+0000 7fa4d9600640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d4070df0 0x7fa4bc005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.463+0000 7fa4d8c00640 1 -- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d4070df0 msgr2=0x7fa4bc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.463+0000 7fa4d8c00640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d4070df0 0x7fa4bc005bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.463+0000 7fa4da000640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4bc006f50 0x7fa4bc0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.463+0000 7fa4d8c00640 1 -- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4bc006f50 msgr2=0x7fa4bc0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.463+0000 7fa4d8c00640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4bc006f50 0x7fa4bc0073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.463+0000 7fa4d8c00640 1 -- 172.21.15.96:0/2291177047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d40ae7b0 con 0x7fa4bc0061f0 2024-04-24T23:58:21.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.464+0000 7fa4d8c00640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4bc0061f0 0x7fa4bc006a10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000ba30 tx=0x7fa4bc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6007e563cce44eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.464+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0030070 con 0x7fa4bc0061f0 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.464+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c002ade0 con 0x7fa4bc0061f0 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.464+0000 7fa4d3e00640 1 -- 172.21.15.96:0/2291177047 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000b600 con 0x7fa4bc0061f0 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.465+0000 7fa4dc000640 1 -- 172.21.15.96:0/2291177047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4bc0061f0 msgr2=0x7fa4bc006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.465+0000 7fa4dc000640 1 --2- 172.21.15.96:0/2291177047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4bc0061f0 0x7fa4bc006a10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000ba30 tx=0x7fa4bc007a40 comp rx=0 tx=0).stop 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.465+0000 7fa4da000640 1 -- 172.21.15.96:0/2291177047 reap_dead start 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.465+0000 7fa4dc000640 1 -- 172.21.15.96:0/2291177047 shutdown_connections 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.465+0000 7fa4dc000640 1 -- 172.21.15.96:0/2291177047 >> 172.21.15.96:0/2291177047 conn(0x7fa4d40b19c0 msgr2=0x7fa4d40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.465+0000 7fa4dc000640 1 -- 172.21.15.96:0/2291177047 shutdown_connections 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.465+0000 7fa4dc000640 1 -- 172.21.15.96:0/2291177047 wait complete. 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.467+0000 7fa4dc000640 1 Processor -- start 2024-04-24T23:58:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.467+0000 7fa4dc000640 1 -- start start 2024-04-24T23:58:21.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4dc000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4bc0061f0 0x7fa4d4155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4dc000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d4156460 0x7fa4d415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4dc000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4d414e650 0x7fa4d415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4dc000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d406ed10 con 0x7fa4d414e650 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4dc000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d406eb90 con 0x7fa4d4156460 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4dc000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d415f380 con 0x7fa4bc0061f0 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4da000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4d414e650 0x7fa4d415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4da000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4d414e650 0x7fa4d415d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35674/0 (socket says 172.21.15.96:35674) 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4da000640 1 -- 172.21.15.96:0/2632439744 learned_addr learned my addr 172.21.15.96:0/2632439744 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4d9600640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4bc0061f0 0x7fa4d4155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4d8c00640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d4156460 0x7fa4d415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4da000640 1 -- 172.21.15.96:0/2632439744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4bc0061f0 msgr2=0x7fa4d4155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4da000640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4bc0061f0 0x7fa4d4155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4da000640 1 -- 172.21.15.96:0/2632439744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d4156460 msgr2=0x7fa4d415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4da000640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d4156460 0x7fa4d415d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4da000640 1 -- 172.21.15.96:0/2632439744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d415c920 con 0x7fa4d414e650 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.468+0000 7fa4d8c00640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d4156460 0x7fa4d415d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.469+0000 7fa4da000640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4d414e650 0x7fa4d415d900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4d415fd10 tx=0x7fa4cc004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.469+0000 7fa4d1600640 1 -- 172.21.15.96:0/2632439744 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc019070 con 0x7fa4d414e650 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.469+0000 7fa4d1600640 1 -- 172.21.15.96:0/2632439744 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4cc007d80 con 0x7fa4d414e650 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.469+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d4157c10 con 0x7fa4d414e650 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.469+0000 7fa4d1600640 1 -- 172.21.15.96:0/2632439744 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc014640 con 0x7fa4d414e650 2024-04-24T23:58:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.469+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d415cbc0 con 0x7fa4d414e650 2024-04-24T23:58:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.470+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d4069110 con 0x7fa4d414e650 2024-04-24T23:58:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.471+0000 7fa4d1600640 1 -- 172.21.15.96:0/2632439744 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4cc01c070 con 0x7fa4d414e650 2024-04-24T23:58:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.472+0000 7fa4d1600640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa4b406be30 0x7fa4b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.472+0000 7fa4d1600640 1 -- 172.21.15.96:0/2632439744 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa4cc08a9f0 con 0x7fa4d414e650 2024-04-24T23:58:21.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.472+0000 7fa4d9600640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa4b406be30 0x7fa4b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.473+0000 7fa4d9600640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa4b406be30 0x7fa4b406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8001050 tx=0x7fa4c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:21.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.477+0000 7fa4d1600640 1 -- 172.21.15.96:0/2632439744 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa4cc059300 con 0x7fa4d414e650 2024-04-24T23:58:21.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.663+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4d406e610 con 0x7fa4d414e650 2024-04-24T23:58:21.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.666+0000 7fa4d1600640 1 -- 172.21.15.96:0/2632439744 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7fa4cc058c00 con 0x7fa4d414e650 2024-04-24T23:58:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:21.667 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:21.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa4b406be30 msgr2=0x7fa4b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa4b406be30 0x7fa4b406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8001050 tx=0x7fa4c8009040 comp rx=0 tx=0).stop 2024-04-24T23:58:21.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4d414e650 msgr2=0x7fa4d415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4d414e650 0x7fa4d415d900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4d415fd10 tx=0x7fa4cc004840 comp rx=0 tx=0).stop 2024-04-24T23:58:21.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 shutdown_connections 2024-04-24T23:58:21.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa4b406be30 0x7fa4b406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4d414e650 0x7fa4d415d900 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d4156460 0x7fa4d415d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 --2- 172.21.15.96:0/2632439744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4bc0061f0 0x7fa4d4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 >> 172.21.15.96:0/2632439744 conn(0x7fa4d40b19c0 msgr2=0x7fa4d40b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:21.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 shutdown_connections 2024-04-24T23:58:21.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.669+0000 7fa4dc000640 1 -- 172.21.15.96:0/2632439744 wait complete. 2024-04-24T23:58:21.687 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:58:21.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.877+0000 7f5a0f200640 1 Processor -- start 2024-04-24T23:58:21.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.877+0000 7f5a0f200640 1 -- start start 2024-04-24T23:58:21.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0f200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5a1015e480 0x7f5a100cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0f200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a100b2be0 0x7f5a10072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0f200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1006cc10 con 0x7f5a100cc6e0 2024-04-24T23:58:21.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0f200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f5a10073060 con 0x7f5a1015e480 2024-04-24T23:58:21.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0f200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1006cef0 con 0x7f5a100b2be0 2024-04-24T23:58:21.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0de00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5a1015e480 0x7f5a100cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0de00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5a1015e480 0x7f5a100cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35676/0 (socket says 172.21.15.96:35676) 2024-04-24T23:58:21.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0de00640 1 -- 172.21.15.96:0/3419982269 learned_addr learned my addr 172.21.15.96:0/3419982269 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:21.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0de00640 1 -- 172.21.15.96:0/3419982269 >> v2:172.21.15.155:3300/0 conn(0x7f5a100b2be0 msgr2=0x7f5a10072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0de00640 1 --2- 172.21.15.96:0/3419982269 >> v2:172.21.15.155:3300/0 conn(0x7f5a100b2be0 0x7f5a10072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0de00640 1 -- 172.21.15.96:0/3419982269 >> v1:172.21.15.96:6789/0 conn(0x7f5a100cc6e0 legacy=0x7f5a1006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.879+0000 7f5a0de00640 1 -- 172.21.15.96:0/3419982269 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1006d1d0 con 0x7f5a1015e480 2024-04-24T23:58:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.880+0000 7f5a0de00640 1 --2- 172.21.15.96:0/3419982269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a1015e480 0x7f5a100cf670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5a1006ed90 tx=0x7f59f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f75cc18ff7e7e35 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0ca00640 1 -- 172.21.15.96:0/3419982269 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8037070 con 0x7f5a1015e480 2024-04-24T23:58:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0ca00640 1 -- 172.21.15.96:0/3419982269 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8032440 con 0x7f5a1015e480 2024-04-24T23:58:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0ca00640 1 -- 172.21.15.96:0/3419982269 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8032810 con 0x7f5a1015e480 2024-04-24T23:58:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0f200640 1 -- 172.21.15.96:0/3419982269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a1015e480 msgr2=0x7f5a100cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0f200640 1 --2- 172.21.15.96:0/3419982269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a1015e480 0x7f5a100cf670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5a1006ed90 tx=0x7f59f802a1e0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0f200640 1 -- 172.21.15.96:0/3419982269 shutdown_connections 2024-04-24T23:58:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0f200640 1 --2- 172.21.15.96:0/3419982269 >> v2:172.21.15.155:3300/0 conn(0x7f5a100b2be0 0x7f5a10072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0f200640 1 --2- 172.21.15.96:0/3419982269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a1015e480 0x7f5a100cf670 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0f200640 1 -- 172.21.15.96:0/3419982269 >> 172.21.15.96:0/3419982269 conn(0x7f5a100b1f10 msgr2=0x7f5a100cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:21.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0f200640 1 -- 172.21.15.96:0/3419982269 shutdown_connections 2024-04-24T23:58:21.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.881+0000 7f5a0f200640 1 -- 172.21.15.96:0/3419982269 wait complete. 2024-04-24T23:58:21.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.883+0000 7f5a0f200640 1 Processor -- start 2024-04-24T23:58:21.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.883+0000 7f5a0f200640 1 -- start start 2024-04-24T23:58:21.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a100b2be0 0x7f5a10152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0f200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100cc6e0 0x7f5a100cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1015e480 0x7f5a10160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0f200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5a100ccb50 con 0x7f5a100cc6e0 2024-04-24T23:58:21.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a10072d50 con 0x7f5a100b2be0 2024-04-24T23:58:21.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a100cccd0 con 0x7f5a1015e480 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0d400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100cc6e0 0x7f5a100cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0d400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100cc6e0 0x7f5a100cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35684/0 (socket says 172.21.15.96:35684) 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0d400640 1 -- 172.21.15.96:0/4251606478 learned_addr learned my addr 172.21.15.96:0/4251606478 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.884+0000 7f5a0de00640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a100b2be0 0x7f5a10152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0e800640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1015e480 0x7f5a10160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0d400640 1 -- 172.21.15.96:0/4251606478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1015e480 msgr2=0x7f5a10160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0d400640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1015e480 0x7f5a10160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0d400640 1 -- 172.21.15.96:0/4251606478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a100b2be0 msgr2=0x7f5a10152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0d400640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a100b2be0 0x7f5a10152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0d400640 1 -- 172.21.15.96:0/4251606478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a100cac60 con 0x7f5a100cc6e0 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0e800640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1015e480 0x7f5a10160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0d400640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100cc6e0 0x7f5a100cb420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000b450 tx=0x7f5a0000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:21.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a06000640 1 -- 172.21.15.96:0/4251606478 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00015020 con 0x7f5a100cc6e0 2024-04-24T23:58:21.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a06000640 1 -- 172.21.15.96:0/4251606478 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00011830 con 0x7f5a100cc6e0 2024-04-24T23:58:21.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1015f4a0 con 0x7f5a100cc6e0 2024-04-24T23:58:21.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a06000640 1 -- 172.21.15.96:0/4251606478 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00011c20 con 0x7f5a100cc6e0 2024-04-24T23:58:21.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.885+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a100caf00 con 0x7f5a100cc6e0 2024-04-24T23:58:21.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.886+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a100756b0 con 0x7f5a100cc6e0 2024-04-24T23:58:21.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.887+0000 7f5a06000640 1 -- 172.21.15.96:0/4251606478 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a00018020 con 0x7f5a100cc6e0 2024-04-24T23:58:21.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.888+0000 7f5a06000640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f59ec06be30 0x7f59ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:21.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.889+0000 7f5a06000640 1 -- 172.21.15.96:0/4251606478 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5a0008adf0 con 0x7f5a100cc6e0 2024-04-24T23:58:21.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.889+0000 7f5a0de00640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f59ec06be30 0x7f59ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:21.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.889+0000 7f5a0de00640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f59ec06be30 0x7f59ec06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59f8034000 tx=0x7f59f802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:21.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:21.893+0000 7f5a06000640 1 -- 172.21.15.96:0/4251606478 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5a0001f020 con 0x7f5a100cc6e0 2024-04-24T23:58:22.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.115+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a10072760 con 0x7f5a100cc6e0 2024-04-24T23:58:22.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.116+0000 7f5a06000640 1 -- 172.21.15.96:0/4251606478 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5178 (secure 0 0 0) 0x7f5a000172c0 con 0x7f5a100cc6e0 2024-04-24T23:58:22.117 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:22.117 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1694444006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1694444006},{"type":"v1","addr":"172.21.15.96:6837","nonce":1694444006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3646872561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6833","nonce":3646872561},{"type":"v1","addr":"172.21.15.155:6835","nonce":3646872561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/227257747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":227257747},{"type":"v1","addr":"172.21.15.96:6836","nonce":227257747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:58:05.205304+0000","modified":"2024-04-24T23:58:08.502172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6834/1986626476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1986626476},{"type":"v1","addr":"172.21.15.155:6834","nonce":1986626476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-24T23:58:22.122 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-04-24T23:58:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f59ec06be30 msgr2=0x7f59ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f59ec06be30 0x7f59ec06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59f8034000 tx=0x7f59f802e000 comp rx=0 tx=0).stop 2024-04-24T23:58:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100cc6e0 msgr2=0x7f5a100cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100cc6e0 0x7f5a100cb420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000b450 tx=0x7f5a0000b910 comp rx=0 tx=0).stop 2024-04-24T23:58:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 shutdown_connections 2024-04-24T23:58:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1015e480 0x7f5a10160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f59ec06be30 0x7f59ec06e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100cc6e0 0x7f5a100cb420 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 --2- 172.21.15.96:0/4251606478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a100b2be0 0x7f5a10152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 >> 172.21.15.96:0/4251606478 conn(0x7f5a100b1f10 msgr2=0x7f5a100af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.119+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 shutdown_connections 2024-04-24T23:58:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.120+0000 7f5a0f200640 1 -- 172.21.15.96:0/4251606478 wait complete. 2024-04-24T23:58:22.541 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:58:05.205304+0000', 'modified': '2024-04-24T23:58:08.502172+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6834/1986626476', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6832', 'nonce': 1986626476}, {'type': 'v1', 'addr': '172.21.15.155:6834', 'nonce': 1986626476}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4284]} 2024-04-24T23:58:22.541 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:58:22.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-24T23:58:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.749+0000 7f2d72e00640 1 Processor -- start 2024-04-24T23:58:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.749+0000 7f2d72e00640 1 -- start start 2024-04-24T23:58:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d72e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2d6c15e280 0x7f2d6c06bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d72e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2d6c15e660 0x7f2d6c06ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d72e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d6c06c9b0 con 0x7f2d6c067200 2024-04-24T23:58:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d72e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2d6c06e990 con 0x7f2d6c15e660 2024-04-24T23:58:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d72e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2d6c06bc70 con 0x7f2d6c15e280 2024-04-24T23:58:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d6b400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2d6c15e660 0x7f2d6c06ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d70e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2d6c067200 0x7f2d6c0715e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45900/0 (socket says 172.21.15.96:45900) 2024-04-24T23:58:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d6b400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2d6c15e660 0x7f2d6c06ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35698/0 (socket says 172.21.15.96:35698) 2024-04-24T23:58:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d70e00640 1 -- 172.21.15.96:0/642034967 learned_addr learned my addr 172.21.15.96:0/642034967 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d6be00640 1 --2- 172.21.15.96:0/642034967 >> v2:172.21.15.155:3300/0 conn(0x7f2d6c15e280 0x7f2d6c06bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d6b400640 1 -- 172.21.15.96:0/642034967 >> v2:172.21.15.155:3300/0 conn(0x7f2d6c15e280 msgr2=0x7f2d6c06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d6b400640 1 --2- 172.21.15.96:0/642034967 >> v2:172.21.15.155:3300/0 conn(0x7f2d6c15e280 0x7f2d6c06bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d6b400640 1 -- 172.21.15.96:0/642034967 >> v1:172.21.15.96:6789/0 conn(0x7f2d6c067200 legacy=0x7f2d6c0715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d6b400640 1 -- 172.21.15.96:0/642034967 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c06e340 con 0x7f2d6c15e660 2024-04-24T23:58:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.751+0000 7f2d6aa00640 1 -- 172.21.15.96:0/642034967 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195114618 0 0) 0x7f2d6c06c9b0 con 0x7f2d6c067200 2024-04-24T23:58:22.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.753+0000 7f2d6b400640 1 --2- 172.21.15.96:0/642034967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 0x7f2d6c06ee20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0b3230 tx=0x7f2d5802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685e115dce1590d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.753+0000 7f2d6aa00640 1 -- 172.21.15.96:0/642034967 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58037070 con 0x7f2d6c15e660 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.753+0000 7f2d6aa00640 1 -- 172.21.15.96:0/642034967 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d58032440 con 0x7f2d6c15e660 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.753+0000 7f2d6aa00640 1 -- 172.21.15.96:0/642034967 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58032810 con 0x7f2d6c15e660 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.753+0000 7f2d72e00640 1 -- 172.21.15.96:0/642034967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 msgr2=0x7f2d6c06ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.753+0000 7f2d72e00640 1 --2- 172.21.15.96:0/642034967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 0x7f2d6c06ee20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0b3230 tx=0x7f2d5802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.754+0000 7f2d72e00640 1 -- 172.21.15.96:0/642034967 shutdown_connections 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.754+0000 7f2d72e00640 1 --2- 172.21.15.96:0/642034967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 0x7f2d6c06ee20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.754+0000 7f2d72e00640 1 --2- 172.21.15.96:0/642034967 >> v2:172.21.15.155:3300/0 conn(0x7f2d6c15e280 0x7f2d6c06bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.754+0000 7f2d72e00640 1 -- 172.21.15.96:0/642034967 >> 172.21.15.96:0/642034967 conn(0x7f2d6c0d04f0 msgr2=0x7f2d6c0d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.754+0000 7f2d72e00640 1 -- 172.21.15.96:0/642034967 shutdown_connections 2024-04-24T23:58:22.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.754+0000 7f2d72e00640 1 -- 172.21.15.96:0/642034967 wait complete. 2024-04-24T23:58:22.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.755+0000 7f2d72e00640 1 Processor -- start 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.755+0000 7f2d72e00640 1 -- start start 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.756+0000 7f2d72e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d6c067200 0x7f2d6c1e74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.756+0000 7f2d72e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c15e280 0x7f2d6c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.756+0000 7f2d72e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 0x7f2d6c14c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.756+0000 7f2d72e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c06f360 con 0x7f2d6c15e660 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.756+0000 7f2d72e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c06c450 con 0x7f2d6c067200 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.756+0000 7f2d72e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c06f4e0 con 0x7f2d6c15e280 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d70e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 0x7f2d6c14c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d70e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 0x7f2d6c14c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35700/0 (socket says 172.21.15.96:35700) 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d70e00640 1 -- 172.21.15.96:0/596234529 learned_addr learned my addr 172.21.15.96:0/596234529 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d6be00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d6c067200 0x7f2d6c1e74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d70e00640 1 -- 172.21.15.96:0/596234529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c15e280 msgr2=0x7f2d6c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d70e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c15e280 0x7f2d6c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d70e00640 1 -- 172.21.15.96:0/596234529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d6c067200 msgr2=0x7f2d6c1e74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d70e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d6c067200 0x7f2d6c1e74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d70e00640 1 -- 172.21.15.96:0/596234529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c1e7db0 con 0x7f2d6c15e660 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d70e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 0x7f2d6c14c7f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c410 tx=0x7f2d6400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.757+0000 7f2d63e00640 1 -- 172.21.15.96:0/596234529 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640074e0 con 0x7f2d6c15e660 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.758+0000 7f2d63e00640 1 -- 172.21.15.96:0/596234529 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d640047e0 con 0x7f2d6c15e660 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.758+0000 7f2d72e00640 1 -- 172.21.15.96:0/596234529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c1e8090 con 0x7f2d6c15e660 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.758+0000 7f2d63e00640 1 -- 172.21.15.96:0/596234529 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64004bd0 con 0x7f2d6c15e660 2024-04-24T23:58:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.758+0000 7f2d72e00640 1 -- 172.21.15.96:0/596234529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c1e8650 con 0x7f2d6c15e660 2024-04-24T23:58:22.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.760+0000 7f2d63e00640 1 -- 172.21.15.96:0/596234529 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d64011070 con 0x7f2d6c15e660 2024-04-24T23:58:22.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.761+0000 7f2d63e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.761+0000 7f2d63e00640 1 -- 172.21.15.96:0/596234529 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d6408aad0 con 0x7f2d6c15e660 2024-04-24T23:58:22.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.761+0000 7f2d6be00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.761+0000 7f2d75c5b740 1 Processor -- start 2024-04-24T23:58:22.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.761+0000 7f2d6be00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009f30 tx=0x7f2d5c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:22.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.761+0000 7f2d75c5b740 1 -- start start 2024-04-24T23:58:22.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.762+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a0984510 0x55f3a09848f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.762+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a1db0 0x55f3a09a2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.762+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a095a1f0 0x55f3a09a0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.762+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55f3a0859ed0 con 0x55f3a09a1db0 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.762+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f3a08bcdf0 con 0x55f3a095a1f0 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.762+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f3a08658d0 con 0x55f3a0984510 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a1db0 0x55f3a09a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a1db0 0x55f3a09a2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35716/0 (socket says 172.21.15.96:35716) 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d6b400640 1 -- 172.21.15.96:0/580857642 learned_addr learned my addr 172.21.15.96:0/580857642 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d6b400640 1 -- 172.21.15.96:0/580857642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a0984510 msgr2=0x55f3a09848f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d6b400640 1 --2- 172.21.15.96:0/580857642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a0984510 0x55f3a09848f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d70e00640 1 --2- 172.21.15.96:0/580857642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a095a1f0 0x55f3a09a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d6b400640 1 -- 172.21.15.96:0/580857642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a095a1f0 msgr2=0x55f3a09a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d6b400640 1 --2- 172.21.15.96:0/580857642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a095a1f0 0x55f3a09a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d6b400640 1 -- 172.21.15.96:0/580857642 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3a05d12d0 con 0x55f3a09a1db0 2024-04-24T23:58:22.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.763+0000 7f2d6b400640 1 --2- 172.21.15.96:0/580857642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a1db0 0x55f3a09a2300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d58035040 tx=0x7f2d5802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23637d982407bd89 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:22.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d60c00640 1 -- 172.21.15.96:0/580857642 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58037050 con 0x55f3a09a1db0 2024-04-24T23:58:22.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d60c00640 1 -- 172.21.15.96:0/580857642 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d58043070 con 0x55f3a09a1db0 2024-04-24T23:58:22.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d60c00640 1 -- 172.21.15.96:0/580857642 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5803e8b0 con 0x55f3a09a1db0 2024-04-24T23:58:22.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d75c5b740 1 -- 172.21.15.96:0/580857642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a1db0 msgr2=0x55f3a09a2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/580857642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a1db0 0x55f3a09a2300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d58035040 tx=0x7f2d5802c070 comp rx=0 tx=0).stop 2024-04-24T23:58:22.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d75c5b740 1 -- 172.21.15.96:0/580857642 shutdown_connections 2024-04-24T23:58:22.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/580857642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a095a1f0 0x55f3a09a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/580857642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a1db0 0x55f3a09a2300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/580857642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a0984510 0x55f3a09848f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d75c5b740 1 -- 172.21.15.96:0/580857642 >> 172.21.15.96:0/580857642 conn(0x55f3a0956b20 msgr2=0x55f3a099f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d75c5b740 1 -- 172.21.15.96:0/580857642 shutdown_connections 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.764+0000 7f2d75c5b740 1 -- 172.21.15.96:0/580857642 wait complete. 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.765+0000 7f2d75c5b740 1 -- start start 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.765+0000 7f2d75c5b740 1 Processor -- start 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.766+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a0984510 0x55f3a09af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.766+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 0x55f3a0997250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.766+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.766+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55f3a0878d20 con 0x55f3a09a28a0 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.766+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f3a08b8db0 con 0x55f3a0984510 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.766+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f3a095af90 con 0x55f3a09a1db0 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.766+0000 7f2d75c5b740 10 client.0 _ll_register_callbacks cb 0x55f3a08b3f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.766+0000 7f2d70e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d70e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09a2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35722/0 (socket says 172.21.15.96:35722) 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d70e00640 1 -- 172.21.15.96:0/1000816068 learned_addr learned my addr 172.21.15.96:0/1000816068 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d6be00640 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a0984510 0x55f3a09af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d70e00640 1 -- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 msgr2=0x55f3a0997250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d70e00640 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 0x55f3a0997250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d70e00640 1 -- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a0984510 msgr2=0x55f3a09af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d70e00640 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a0984510 0x55f3a09af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d70e00640 1 -- 172.21.15.96:0/1000816068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3a069b6b0 con 0x55f3a09a28a0 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d70e00640 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09a2d20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d64000fb0 tx=0x7f2d64058ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7b08949d2bb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d55600640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-24T23:58:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d55600640 1 -- 172.21.15.96:0/1000816068 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64087060 con 0x55f3a09a28a0 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d55600640 1 -- 172.21.15.96:0/1000816068 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d64058130 con 0x55f3a09a28a0 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d75c5b740 1 -- 172.21.15.96:0/1000816068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d58043070 con 0x55f3a09a28a0 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.767+0000 7f2d55600640 1 -- 172.21.15.96:0/1000816068 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f2d6406e070 con 0x55f3a09a28a0 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d75c5b740 10 client.4662 fetch_fsmap learned FSMap version 7 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d75c5b740 1 -- 172.21.15.96:0/1000816068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55f3a09885d0 con 0x55f3a09a28a0 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d55600640 1 -- 172.21.15.96:0/1000816068 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d58043070 con 0x55f3a09a28a0 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d55600640 1 -- 172.21.15.96:0/1000816068 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7f2d6405f290 con 0x55f3a09a28a0 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d75c5b740 10 client.4662 fetch_fsmap finished waiting for FSMap version 7 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d75c5b740 10 client.4662 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d75c5b740 20 client.4662 populate_metadata read hostname 'smithi096' 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] conn(0x55f3a0986d80 0x55f3a09be280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d75c5b740 4 client.4662 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:58:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.768+0000 7f2d75c5b740 1 -- 172.21.15.96:0/1000816068 --> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3a08ca330 con 0x55f3a0986d80 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.769+0000 7f2d6be00640 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] conn(0x55f3a0986d80 0x55f3a09be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.770+0000 7f2d6be00640 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] conn(0x55f3a0986d80 0x55f3a09be280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4817fc021ce52f20 server_cookie=bba70855b78f3889 in_seq=0 out_seq=0 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.770+0000 7f2d55600640 10 client.4662 ms_handle_connect on v2:172.21.15.155:6832/1986626476 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d55600640 1 -- 172.21.15.96:0/1000816068 <== mds.0 v2:172.21.15.155:6832/1986626476 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f3a08ca330 con 0x55f3a0986d80 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d55600640 10 client.4662 handle_command_reply: tid=0 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 client.4662 shutdown 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 -- 172.21.15.96:0/1000816068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 msgr2=0x55f3a09a2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09a2d20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d64000fb0 tx=0x7f2d64058ce0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 -- 172.21.15.96:0/1000816068 shutdown_connections 2024-04-24T23:58:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] conn(0x55f3a0986d80 0x55f3a09be280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09a2d20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 0x55f3a0997250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d55600640 0 client.4662 ms_handle_reset on v2:172.21.15.155:6832/1986626476 2024-04-24T23:58:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/1000816068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a0984510 0x55f3a09af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 -- 172.21.15.96:0/1000816068 >> 172.21.15.96:0/1000816068 conn(0x55f3a095a1f0 msgr2=0x55f3a099e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 -- 172.21.15.96:0/1000816068 shutdown_connections 2024-04-24T23:58:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.772+0000 7f2d75c5b740 1 -- 172.21.15.96:0/1000816068 wait complete. 2024-04-24T23:58:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.773+0000 7f2d75c5b740 20 client.4662 trim_cache size 0 max 16384 2024-04-24T23:58:22.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.792+0000 7f2d75c5b740 1 Processor -- start 2024-04-24T23:58:22.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.792+0000 7f2d75c5b740 1 -- start start 2024-04-24T23:58:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.792+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a0984510 0x55f3a0983450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.792+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 0x55f3a095baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.792+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c200700 con 0x55f3a09a28a0 2024-04-24T23:58:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c160920 con 0x55f3a0984510 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c15fc80 con 0x55f3a09a1db0 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d70e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d70e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35728/0 (socket says 172.21.15.96:35728) 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d70e00640 1 -- 172.21.15.96:0/16955766 learned_addr learned my addr 172.21.15.96:0/16955766 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d70e00640 1 -- 172.21.15.96:0/16955766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 msgr2=0x55f3a095baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d70e00640 1 --2- 172.21.15.96:0/16955766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 0x55f3a095baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d70e00640 1 -- 172.21.15.96:0/16955766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a0984510 msgr2=0x55f3a0983450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d70e00640 1 --2- 172.21.15.96:0/16955766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a0984510 0x55f3a0983450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d70e00640 1 -- 172.21.15.96:0/16955766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3a09a3150 con 0x55f3a09a28a0 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.793+0000 7f2d70e00640 1 --2- 172.21.15.96:0/16955766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09582b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d64056f90 tx=0x7f2d6401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb1955548c3c3a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d57e00640 1 -- 172.21.15.96:0/16955766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6407b070 con 0x55f3a09a28a0 2024-04-24T23:58:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d57e00640 1 -- 172.21.15.96:0/16955766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d64058130 con 0x55f3a09a28a0 2024-04-24T23:58:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d57e00640 1 -- 172.21.15.96:0/16955766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64054a30 con 0x55f3a09a28a0 2024-04-24T23:58:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d75c5b740 1 -- 172.21.15.96:0/16955766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 msgr2=0x55f3a09582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/16955766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09582b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d64056f90 tx=0x7f2d6401e000 comp rx=0 tx=0).stop 2024-04-24T23:58:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d75c5b740 1 -- 172.21.15.96:0/16955766 shutdown_connections 2024-04-24T23:58:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/16955766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a09a28a0 0x55f3a09582b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/16955766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 0x55f3a095baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/16955766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a0984510 0x55f3a0983450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d75c5b740 1 -- 172.21.15.96:0/16955766 >> 172.21.15.96:0/16955766 conn(0x55f3a095a1f0 msgr2=0x55f3a095a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:22.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d75c5b740 1 -- 172.21.15.96:0/16955766 shutdown_connections 2024-04-24T23:58:22.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.794+0000 7f2d75c5b740 1 -- 172.21.15.96:0/16955766 wait complete. 2024-04-24T23:58:22.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.795+0000 7f2d75c5b740 1 -- start start 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.795+0000 7f2d75c5b740 1 Processor -- start 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a0984510 0x55f3a0997cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 0x55f3a0a1bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d75c5b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a09a28a0 0x55f3a0a1c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55f3a09b3970 con 0x55f3a0984510 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1602d0 con 0x55f3a09a28a0 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d75c5b740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f3a09afe30 con 0x55f3a09a1db0 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d75c5b740 10 client.0 _ll_register_callbacks cb 0x7f2d64058b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d6be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a0984510 0x55f3a0997cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d6be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a0984510 0x55f3a0997cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35734/0 (socket says 172.21.15.96:35734) 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.796+0000 7f2d6be00640 1 -- 172.21.15.96:0/3168484073 learned_addr learned my addr 172.21.15.96:0/3168484073 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d6be00640 1 -- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 msgr2=0x55f3a0a1bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d6be00640 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 0x55f3a0a1bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d6be00640 1 -- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a09a28a0 msgr2=0x55f3a0a1c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d6be00640 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a09a28a0 0x55f3a0a1c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d6be00640 1 -- 172.21.15.96:0/3168484073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3a0998230 con 0x55f3a0984510 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d6be00640 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a0984510 0x55f3a0997cf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c016850 tx=0x7f2d5c016c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82d4dcdabec55c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d55600640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d55600640 1 -- 172.21.15.96:0/3168484073 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c022c60 con 0x55f3a0984510 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d55600640 1 -- 172.21.15.96:0/3168484073 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d5c022e00 con 0x55f3a0984510 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d75c5b740 1 -- 172.21.15.96:0/3168484073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d64058130 con 0x55f3a0984510 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d55600640 1 -- 172.21.15.96:0/3168484073 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f2d5c035050 con 0x55f3a0984510 2024-04-24T23:58:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.797+0000 7f2d75c5b740 10 client.4668 fetch_fsmap learned FSMap version 7 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.798+0000 7f2d75c5b740 1 -- 172.21.15.96:0/3168484073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55f3a09c22a0 con 0x55f3a0984510 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.798+0000 7f2d55600640 1 -- 172.21.15.96:0/3168484073 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d64058130 con 0x55f3a0984510 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.798+0000 7f2d55600640 1 -- 172.21.15.96:0/3168484073 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7f2d5c038020 con 0x55f3a0984510 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.798+0000 7f2d75c5b740 10 client.4668 fetch_fsmap finished waiting for FSMap version 7 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.798+0000 7f2d75c5b740 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.798+0000 7f2d75c5b740 20 client.4668 populate_metadata read hostname 'smithi096' 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.798+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] conn(0x55f3a0994cb0 0x55f3a0995090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.798+0000 7f2d75c5b740 4 client.4668 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.798+0000 7f2d75c5b740 1 -- 172.21.15.96:0/3168484073 --> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] -- command(tid 0: {"prefix": "status"}) -- 0x55f3a0999dc0 con 0x55f3a0994cb0 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.799+0000 7f2d6b400640 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] conn(0x55f3a0994cb0 0x55f3a0995090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.799+0000 7f2d6b400640 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] conn(0x55f3a0994cb0 0x55f3a0995090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dad4a8e493e93081 server_cookie=a26f243dd3b1fb9 in_seq=0 out_seq=0 2024-04-24T23:58:22.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.799+0000 7f2d55600640 10 client.4668 ms_handle_connect on v2:172.21.15.155:6832/1986626476 2024-04-24T23:58:22.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d55600640 1 -- 172.21.15.96:0/3168484073 <== mds.0 v2:172.21.15.155:6832/1986626476 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55f3a0999dc0 con 0x55f3a0994cb0 2024-04-24T23:58:22.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d55600640 10 client.4668 handle_command_reply: tid=0 2024-04-24T23:58:22.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 client.4668 shutdown 2024-04-24T23:58:22.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 -- 172.21.15.96:0/3168484073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a0984510 msgr2=0x55f3a0997cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a0984510 0x55f3a0997cf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c016850 tx=0x7f2d5c016c50 comp rx=0 tx=0).stop 2024-04-24T23:58:22.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 -- 172.21.15.96:0/3168484073 shutdown_connections 2024-04-24T23:58:22.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:6832/1986626476,v1:172.21.15.155:6834/1986626476] conn(0x55f3a0994cb0 0x55f3a0995090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3a09a28a0 0x55f3a0a1c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f3a09a1db0 0x55f3a0a1bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d55600640 0 client.4668 ms_handle_reset on v2:172.21.15.155:6832/1986626476 2024-04-24T23:58:22.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 --2- 172.21.15.96:0/3168484073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55f3a0984510 0x55f3a0997cf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 -- 172.21.15.96:0/3168484073 >> 172.21.15.96:0/3168484073 conn(0x55f3a095a1f0 msgr2=0x55f3a09597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:22.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 -- 172.21.15.96:0/3168484073 shutdown_connections 2024-04-24T23:58:22.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.800+0000 7f2d75c5b740 1 -- 172.21.15.96:0/3168484073 wait complete. 2024-04-24T23:58:22.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d75c5b740 20 client.4668 trim_cache size 0 max 16384 2024-04-24T23:58:22.806 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:58:22.806 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "c95ce1e9-7a69-4f8e-a964-bd4778092d3c", 2024-04-24T23:58:22.806 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-04-24T23:58:22.806 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4284, 2024-04-24T23:58:22.806 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-04-24T23:58:22.807 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-04-24T23:58:22.807 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-04-24T23:58:22.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 17.046310895000001, 2024-04-24T23:58:22.807 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 7, 2024-04-24T23:58:22.807 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 20, 2024-04-24T23:58:22.807 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 20, 2024-04-24T23:58:22.807 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 22.296837769 2024-04-24T23:58:22.807 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:58:22.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 -- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2d4c06be30 msgr2=0x7f2d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009f30 tx=0x7f2d5c00b040 comp rx=0 tx=0).stop 2024-04-24T23:58:22.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 -- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 msgr2=0x7f2d6c14c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:22.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 0x7f2d6c14c7f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c410 tx=0x7f2d6400c8d0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 -- 172.21.15.96:0/596234529 shutdown_connections 2024-04-24T23:58:22.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2d4c06be30 0x7f2d4c06e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c15e660 0x7f2d6c14c7f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c15e280 0x7f2d6c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 --2- 172.21.15.96:0/596234529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d6c067200 0x7f2d6c1e74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:22.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 -- 172.21.15.96:0/596234529 >> 172.21.15.96:0/596234529 conn(0x7f2d6c0d04f0 msgr2=0x7f2d6c0b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:22.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 -- 172.21.15.96:0/596234529 shutdown_connections 2024-04-24T23:58:22.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:22.801+0000 7f2d72e00640 1 -- 172.21.15.96:0/596234529 wait complete. 2024-04-24T23:58:22.820 INFO:teuthology.run_tasks:Running task sequential... 2024-04-24T23:58:22.829 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-24T23:58:22.829 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-24T23:58:22.830 INFO:teuthology.task.print:Enabling mgr modules 2024-04-24T23:58:22.830 INFO:teuthology.run_tasks:Running task kclient... 2024-04-24T23:58:22.893 INFO:tasks.kclient:Mounting kernel clients... 2024-04-24T23:58:22.893 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-24T23:58:22.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:22.893 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-24T23:58:22.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:22.949 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-04-24T23:58:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:Cannot find device "ceph-brx" 2024-04-24T23:58:23.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:58:23.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:23.038 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-24T23:58:23.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:23.088 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-04-24T23:58:23.172 INFO:teuthology.orchestra.run.smithi096.stderr:Cannot find device "ceph-brx" 2024-04-24T23:58:23.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:58:23.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:23.176 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-24T23:58:23.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:23.235 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-04-24T23:58:23.317 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-04-24T23:58:23.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:58:23.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:23.320 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-24T23:58:23.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:23.374 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-04-24T23:58:23.456 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-04-24T23:58:23.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:58:23.459 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-24T23:58:23.459 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:58:23.459 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:58:23.460 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:58:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.655+0000 7ff39a200640 1 Processor -- start 2024-04-24T23:58:23.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.655+0000 7ff39a200640 1 -- start start 2024-04-24T23:58:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff39a200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3940ccdf0 0x7ff3941670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff39a200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39415fa90 con 0x7ff39415f6b0 2024-04-24T23:58:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff39a200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3940b3e20 con 0x7ff3940b4ec0 2024-04-24T23:58:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff39a200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff3940b4a30 con 0x7ff3940ccdf0 2024-04-24T23:58:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff398e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff39415f6b0 0x7ff3940ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45902/0 (socket says 172.21.15.96:45902) 2024-04-24T23:58:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff398e00640 1 -- 172.21.15.96:0/616589101 learned_addr learned my addr 172.21.15.96:0/616589101 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff399800640 1 --2- 172.21.15.96:0/616589101 >> v2:172.21.15.96:3300/0 conn(0x7ff3940ccdf0 0x7ff3941670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff393e00640 1 -- 172.21.15.96:0/616589101 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715667816 0 0) 0x7ff39415fa90 con 0x7ff39415f6b0 2024-04-24T23:58:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff393e00640 1 -- 172.21.15.96:0/616589101 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff378003520 con 0x7ff39415f6b0 2024-04-24T23:58:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff399800640 1 -- 172.21.15.96:0/616589101 >> v1:172.21.15.155:6789/0 conn(0x7ff3940b4ec0 legacy=0x7ff3940cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff399800640 1 -- 172.21.15.96:0/616589101 >> v1:172.21.15.96:6789/0 conn(0x7ff39415f6b0 legacy=0x7ff3940ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.657+0000 7ff399800640 1 -- 172.21.15.96:0/616589101 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3940b4100 con 0x7ff3940ccdf0 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.659+0000 7ff399800640 1 --2- 172.21.15.96:0/616589101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940ccdf0 0x7ff3941670b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f43c98fb9bf6289 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.659+0000 7ff393e00640 1 -- 172.21.15.96:0/616589101 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c007740 con 0x7ff3940ccdf0 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.659+0000 7ff393e00640 1 -- 172.21.15.96:0/616589101 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c0078e0 con 0x7ff3940ccdf0 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.659+0000 7ff393e00640 1 -- 172.21.15.96:0/616589101 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c007cb0 con 0x7ff3940ccdf0 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.659+0000 7ff39a200640 1 -- 172.21.15.96:0/616589101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940ccdf0 msgr2=0x7ff3941670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.659+0000 7ff39a200640 1 --2- 172.21.15.96:0/616589101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940ccdf0 0x7ff3941670b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c02a6f0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.659+0000 7ff39a200640 1 -- 172.21.15.96:0/616589101 shutdown_connections 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.659+0000 7ff39a200640 1 --2- 172.21.15.96:0/616589101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940ccdf0 0x7ff3941670b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.659+0000 7ff39a200640 1 -- 172.21.15.96:0/616589101 >> 172.21.15.96:0/616589101 conn(0x7ff3940b1f10 msgr2=0x7ff3940cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.660+0000 7ff39a200640 1 -- 172.21.15.96:0/616589101 shutdown_connections 2024-04-24T23:58:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.660+0000 7ff39a200640 1 -- 172.21.15.96:0/616589101 wait complete. 2024-04-24T23:58:23.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.661+0000 7ff39a200640 1 Processor -- start 2024-04-24T23:58:23.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.661+0000 7ff39a200640 1 -- start start 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.662+0000 7ff39a200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940b4ec0 0x7ff39409ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.662+0000 7ff39a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3940ccdf0 0x7ff394156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.662+0000 7ff39a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39415f6b0 0x7ff394156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.662+0000 7ff39a200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940cf1c0 con 0x7ff3940b4ec0 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.662+0000 7ff39a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940b46c0 con 0x7ff39415f6b0 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.662+0000 7ff39a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3940b3a40 con 0x7ff3940ccdf0 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.662+0000 7ff398e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940b4ec0 0x7ff39409ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff398e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940b4ec0 0x7ff39409ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35742/0 (socket says 172.21.15.96:35742) 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff398e00640 1 -- 172.21.15.96:0/3238472881 learned_addr learned my addr 172.21.15.96:0/3238472881 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff398e00640 1 -- 172.21.15.96:0/3238472881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3940ccdf0 msgr2=0x7ff394156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff398e00640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3940ccdf0 0x7ff394156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff399800640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39415f6b0 0x7ff394156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff398e00640 1 -- 172.21.15.96:0/3238472881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39415f6b0 msgr2=0x7ff394156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff398e00640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39415f6b0 0x7ff394156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff398e00640 1 -- 172.21.15.96:0/3238472881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3941f6750 con 0x7ff3940b4ec0 2024-04-24T23:58:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff398e00640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940b4ec0 0x7ff39409ce60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c410 tx=0x7ff38400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.663+0000 7ff391600640 1 -- 172.21.15.96:0/3238472881 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384017070 con 0x7ff3940b4ec0 2024-04-24T23:58:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.664+0000 7ff391600640 1 -- 172.21.15.96:0/3238472881 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff384005ce0 con 0x7ff3940b4ec0 2024-04-24T23:58:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.664+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff394154200 con 0x7ff3940b4ec0 2024-04-24T23:58:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.664+0000 7ff391600640 1 -- 172.21.15.96:0/3238472881 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3840072f0 con 0x7ff3940b4ec0 2024-04-24T23:58:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.664+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3941547c0 con 0x7ff3940b4ec0 2024-04-24T23:58:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.665+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff394067e40 con 0x7ff3940b4ec0 2024-04-24T23:58:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.666+0000 7ff391600640 1 -- 172.21.15.96:0/3238472881 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff38401a070 con 0x7ff3940b4ec0 2024-04-24T23:58:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.667+0000 7ff391600640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff37006be30 0x7ff37006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.667+0000 7ff391600640 1 -- 172.21.15.96:0/3238472881 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff38408a210 con 0x7ff3940b4ec0 2024-04-24T23:58:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.667+0000 7ff38be00640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff37006be30 0x7ff37006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:23.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.668+0000 7ff38be00640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff37006be30 0x7ff37006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff37c000f60 tx=0x7ff37c0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:23.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.671+0000 7ff391600640 1 -- 172.21.15.96:0/3238472881 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff384058d10 con 0x7ff3940b4ec0 2024-04-24T23:58:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.907+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff394153f20 con 0x7ff3940b4ec0 2024-04-24T23:58:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.908+0000 7ff391600640 1 -- 172.21.15.96:0/3238472881 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7ff384058610 con 0x7ff3940b4ec0 2024-04-24T23:58:23.908 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:58:23.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff37006be30 msgr2=0x7ff37006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:23.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff37006be30 0x7ff37006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff37c000f60 tx=0x7ff37c0079d0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940b4ec0 msgr2=0x7ff39409ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940b4ec0 0x7ff39409ce60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c410 tx=0x7ff38400c8d0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 shutdown_connections 2024-04-24T23:58:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39415f6b0 0x7ff394156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3940ccdf0 0x7ff394156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff37006be30 0x7ff37006e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 --2- 172.21.15.96:0/3238472881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3940b4ec0 0x7ff39409ce60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 >> 172.21.15.96:0/3238472881 conn(0x7ff3940b1f10 msgr2=0x7ff3940cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 shutdown_connections 2024-04-24T23:58:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:23.910+0000 7ff39a200640 1 -- 172.21.15.96:0/3238472881 wait complete. 2024-04-24T23:58:23.928 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:58:23.928 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:58:23.928 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-04-24T23:58:23.928 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:58:23.928 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:58:23.928 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:58:23.928 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:58:23.928 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:58:23.929 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:58:23.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:23.929 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-04-24T23:58:23.976 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-04-24T23:58:23.978 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:23.978 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:58:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:58:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42581sec preferred_lft 42581sec 2024-04-24T23:58:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-04-24T23:58:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:23.979 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:58:23.979 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:23.979 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:58:23.979 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:58:23.980 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2024-04-24T23:58:23.980 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2024-04-24T23:58:23.980 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:58:23.980 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:58:24.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:24.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:24.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:24.437 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:58:24.503 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-04-24T23:58:24.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:24.507 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-04-24T23:58:24.567 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-04-24T23:58:24.567 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:58:24.567 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:58:24.567 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:58:24.567 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:58:24.567 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:24.567 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:58:24.568 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:58:24.568 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:58:24.568 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:58:24.568 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:58:24.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:25.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:25.301 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-24T23:58:25.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:25.346 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2024-04-24T23:58:25.435 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:25.435 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:58:25.435 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:58:25.435 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-24T23:58:25.435 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:58:25.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:25.652 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-24T23:58:25.652 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:25.652 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:58:25.653 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-24T23:58:25.653 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:58:25.653 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-24T23:58:25.653 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-24T23:58:25.653 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-24T23:58:25.653 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:58:25.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:25.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:25.924 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:25.924 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:58:25.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2024-04-24T23:58:25.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:58:25.924 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:58:26.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:26.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:26.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:58:26.119 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:58:26.160 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:58:26.160 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:58:26.160 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:58:26.249 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-24T23:58:26.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:26.249 DEBUG:teuthology.orchestra.run.smithi096:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-24T23:58:26.366 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-24T23:58:26.366 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-24T23:58:26.366 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-04-24T23:58:26.913 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:58:26.921 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:58:27.075 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-24T23:58:27.076 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-24T23:58:27.076 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-04-24T23:58:27.076 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:58:27.076 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:58:27.112 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-24T23:58:27.112 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-24T23:58:27.113 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-04-24T23:58:27.113 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:58:27.113 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:58:27.113 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790" 2024-04-24T23:58:27.113 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2024-04-24T23:58:27.113 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c95ce1e9-7a69-4f8e-a964-bd4778092d3c" will pass to kernel 2024-04-24T23:58:27.118 INFO:teuthology.orchestra.run.smithi096.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:58:27.118 INFO:teuthology.orchestra.run.smithi096.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:58:27.118 INFO:teuthology.orchestra.run.smithi096.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:58:27.118 INFO:teuthology.orchestra.run.smithi096.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:58:27.118 INFO:teuthology.orchestra.run.smithi096.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:58:27.122 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:58:27.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:27.123 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:58:27.252 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:27.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:27.402 INFO:teuthology.orchestra.run.smithi096.stdout:client4388 2024-04-24T23:58:27.402 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:58:27.402 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:27.459 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:27.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:27.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:27.603 INFO:teuthology.orchestra.run.smithi096.stdout:client4388 2024-04-24T23:58:27.603 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:27.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:27.744 INFO:teuthology.orchestra.run.smithi096.stdout:client4388 2024-04-24T23:58:27.744 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c95ce1e9-7a69-4f8e-a964-bd4778092d3c.client4388/status') 2024-04-24T23:58:27.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:27.890 INFO:teuthology.orchestra.run.smithi096.stdout:instance: client.4388 (3)172.21.15.96:0/2371413380 2024-04-24T23:58:27.890 INFO:teuthology.orchestra.run.smithi096.stdout:blocklisted: false 2024-04-24T23:58:27.890 INFO:teuthology.orchestra.run.smithi096.stderr:0+1 records in 2024-04-24T23:58:27.890 INFO:teuthology.orchestra.run.smithi096.stderr:0+1 records out 2024-04-24T23:58:27.891 INFO:teuthology.orchestra.run.smithi096.stderr:70 bytes copied, 8.2215e-05 s, 851 kB/s 2024-04-24T23:58:27.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:27.903 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-24T23:58:27.903 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:58:27.903 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-24T23:58:27.903 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:58:28.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.104+0000 7ffb0d200640 1 Processor -- start 2024-04-24T23:58:28.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.104+0000 7ffb0d200640 1 -- start start 2024-04-24T23:58:28.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.106+0000 7ffb0d200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ffb0815f6b0 0x7ffb080ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:28.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.106+0000 7ffb0d200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0815fa90 con 0x7ffb080b4ec0 2024-04-24T23:58:28.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.106+0000 7ffb0d200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb080b3e20 con 0x7ffb080ccdf0 2024-04-24T23:58:28.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.106+0000 7ffb0d200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ffb080b4a30 con 0x7ffb0815f6b0 2024-04-24T23:58:28.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.106+0000 7ffb07400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ffb0815f6b0 0x7ffb080ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.106+0000 7ffb07400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ffb0815f6b0 0x7ffb080ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60968/0 (socket says 172.21.15.96:60968) 2024-04-24T23:58:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.106+0000 7ffb07400640 1 -- 172.21.15.96:0/755974439 learned_addr learned my addr 172.21.15.96:0/755974439 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.107+0000 7ffb07400640 1 -- 172.21.15.96:0/755974439 >> v1:172.21.15.155:6789/0 conn(0x7ffb080ccdf0 legacy=0x7ffb08070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.107+0000 7ffb07400640 1 -- 172.21.15.96:0/755974439 >> v1:172.21.15.96:6789/0 conn(0x7ffb080b4ec0 legacy=0x7ffb080cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.107+0000 7ffb07400640 1 -- 172.21.15.96:0/755974439 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb080b4100 con 0x7ffb0815f6b0 2024-04-24T23:58:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.108+0000 7ffb07400640 1 --2- 172.21.15.96:0/755974439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb0815f6b0 0x7ffb080ce5e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009870 tx=0x7ffaf802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d4b80c47ae63e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.108+0000 7ffb06000640 1 -- 172.21.15.96:0/755974439 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8037070 con 0x7ffb0815f6b0 2024-04-24T23:58:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.108+0000 7ffb06000640 1 -- 172.21.15.96:0/755974439 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf8032440 con 0x7ffb0815f6b0 2024-04-24T23:58:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.108+0000 7ffb06000640 1 -- 172.21.15.96:0/755974439 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8032810 con 0x7ffb0815f6b0 2024-04-24T23:58:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.109+0000 7ffb0d200640 1 -- 172.21.15.96:0/755974439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb0815f6b0 msgr2=0x7ffb080ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.109+0000 7ffb0d200640 1 --2- 172.21.15.96:0/755974439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb0815f6b0 0x7ffb080ce5e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009870 tx=0x7ffaf802a2a0 comp rx=0 tx=0).stop 2024-04-24T23:58:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.109+0000 7ffb0d200640 1 -- 172.21.15.96:0/755974439 shutdown_connections 2024-04-24T23:58:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.109+0000 7ffb0d200640 1 --2- 172.21.15.96:0/755974439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb0815f6b0 0x7ffb080ce5e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.109+0000 7ffb0d200640 1 -- 172.21.15.96:0/755974439 >> 172.21.15.96:0/755974439 conn(0x7ffb080b1f10 msgr2=0x7ffb080cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.109+0000 7ffb0d200640 1 -- 172.21.15.96:0/755974439 shutdown_connections 2024-04-24T23:58:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.109+0000 7ffb0d200640 1 -- 172.21.15.96:0/755974439 wait complete. 2024-04-24T23:58:28.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.111+0000 7ffb0d200640 1 Processor -- start 2024-04-24T23:58:28.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.111+0000 7ffb0d200640 1 -- start start 2024-04-24T23:58:28.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.112+0000 7ffb0d200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb080b4ec0 0x7ffb0814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:28.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.112+0000 7ffb0d200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb080ccdf0 0x7ffb0814f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:28.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.112+0000 7ffb0d200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb0815f6b0 0x7ffb0809bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:28.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.112+0000 7ffb0d200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ffb080ceb20 con 0x7ffb080ccdf0 2024-04-24T23:58:28.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.112+0000 7ffb0d200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb080b46c0 con 0x7ffb0815f6b0 2024-04-24T23:58:28.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.112+0000 7ffb0d200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffb080cf1c0 con 0x7ffb080b4ec0 2024-04-24T23:58:28.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.112+0000 7ffb06a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb080ccdf0 0x7ffb0814f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.112+0000 7ffb06a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb080ccdf0 0x7ffb0814f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60970/0 (socket says 172.21.15.96:60970) 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.112+0000 7ffb06a00640 1 -- 172.21.15.96:0/4237693870 learned_addr learned my addr 172.21.15.96:0/4237693870 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffb07400640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb080b4ec0 0x7ffb0814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffb07e00640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb0815f6b0 0x7ffb0809bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffb06a00640 1 -- 172.21.15.96:0/4237693870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb080b4ec0 msgr2=0x7ffb0814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffb06a00640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb080b4ec0 0x7ffb0814c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffb06a00640 1 -- 172.21.15.96:0/4237693870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb0815f6b0 msgr2=0x7ffb0809bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffb06a00640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb0815f6b0 0x7ffb0809bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffb06a00640 1 -- 172.21.15.96:0/4237693870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0809d4e0 con 0x7ffb080ccdf0 2024-04-24T23:58:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffb06a00640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb080ccdf0 0x7ffb0814f560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c440 tx=0x7ffaf4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:28.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffaff400640 1 -- 172.21.15.96:0/4237693870 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40052d0 con 0x7ffb080ccdf0 2024-04-24T23:58:28.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffaff400640 1 -- 172.21.15.96:0/4237693870 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf4005470 con 0x7ffb080ccdf0 2024-04-24T23:58:28.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffaff400640 1 -- 172.21.15.96:0/4237693870 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4007260 con 0x7ffb080ccdf0 2024-04-24T23:58:28.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.113+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0809c440 con 0x7ffb080ccdf0 2024-04-24T23:58:28.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.114+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb0809ca00 con 0x7ffb080ccdf0 2024-04-24T23:58:28.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.115+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb08067e40 con 0x7ffb080ccdf0 2024-04-24T23:58:28.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.116+0000 7ffaff400640 1 -- 172.21.15.96:0/4237693870 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffaf4007400 con 0x7ffb080ccdf0 2024-04-24T23:58:28.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.116+0000 7ffaff400640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ffae806be30 0x7ffae806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:28.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.117+0000 7ffaff400640 1 -- 172.21.15.96:0/4237693870 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffaf408a390 con 0x7ffb080ccdf0 2024-04-24T23:58:28.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.117+0000 7ffb07400640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ffae806be30 0x7ffae806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:28.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.117+0000 7ffb07400640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ffae806be30 0x7ffae806e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8034000 tx=0x7ffaf802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:28.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.121+0000 7ffaff400640 1 -- 172.21.15.96:0/4237693870 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffaf4058d30 con 0x7ffb080ccdf0 2024-04-24T23:58:28.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.360+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffb080cd7b0 con 0x7ffb080ccdf0 2024-04-24T23:58:28.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.360+0000 7ffaff400640 1 -- 172.21.15.96:0/4237693870 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7ffaf4058630 con 0x7ffb080ccdf0 2024-04-24T23:58:28.361 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:58:28.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ffae806be30 msgr2=0x7ffae806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:28.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ffae806be30 0x7ffae806e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8034000 tx=0x7ffaf802e000 comp rx=0 tx=0).stop 2024-04-24T23:58:28.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb080ccdf0 msgr2=0x7ffb0814f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:28.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb080ccdf0 0x7ffb0814f560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c440 tx=0x7ffaf4001e70 comp rx=0 tx=0).stop 2024-04-24T23:58:28.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 shutdown_connections 2024-04-24T23:58:28.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb0815f6b0 0x7ffb0809bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:28.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ffae806be30 0x7ffae806e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:28.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb080ccdf0 0x7ffb0814f560 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:28.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 --2- 172.21.15.96:0/4237693870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb080b4ec0 0x7ffb0814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:28.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 >> 172.21.15.96:0/4237693870 conn(0x7ffb080b1f10 msgr2=0x7ffb080b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:28.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 shutdown_connections 2024-04-24T23:58:28.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28.363+0000 7ffb0d200640 1 -- 172.21.15.96:0/4237693870 wait complete. 2024-04-24T23:58:28.383 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:58:28.383 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:58:28.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-04-24T23:58:28.383 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-24T23:58:28.383 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-24T23:58:28.383 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:58:28.383 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:58:28.383 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:58:28.383 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-24T23:58:28.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:28.384 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-04-24T23:58:28.431 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:58:28.431 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:58:28.431 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:58:28.431 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:28.431 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-04-24T23:58:28.431 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:28.431 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:28.431 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:28.431 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42577sec preferred_lft 42577sec 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 52:7e:61:df:15:52 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:58:28.433 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:28.433 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::5cd1:b8ff:fe39:23b3/64 scope link 2024-04-24T23:58:28.433 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:28.433 INFO:teuthology.orchestra.run.smithi096.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:58:28.433 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 52:7e:61:df:15:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:58:28.433 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::507e:61ff:fedf:1552/64 scope link 2024-04-24T23:58:28.433 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:28.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:28.433 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:58:28.507 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-04-24T23:58:28.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:28.511 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-04-24T23:58:28.562 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-04-24T23:58:28.562 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:58:28.562 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:58:28.562 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:58:28.563 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:58:28.563 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:28.563 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:58:28.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:58:28.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:58:28.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:58:28.563 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:58:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:28.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:28.773 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-24T23:58:28.825 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:58:28.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:28.825 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2024-04-24T23:58:28.872 INFO:teuthology.orchestra.run.smithi096.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-24T23:58:28.873 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:28.873 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:58:28.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:58:28.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-24T23:58:28.873 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:58:28.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:29.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:29.050 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-24T23:58:29.132 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:58:29.132 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:58:29.132 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:58:29.132 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:29.132 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-04-24T23:58:29.132 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:29.132 INFO:teuthology.orchestra.run.smithi096.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:58:29.132 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether ba:29:8a:a9:cb:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-24T23:58:29.133 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-24T23:58:29.133 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:29.133 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::b829:8aff:fea9:cb47/64 scope link 2024-04-24T23:58:29.133 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:29.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:29.136 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-24T23:58:29.217 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:58:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:58:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:58:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-04-24T23:58:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:29.217 INFO:teuthology.orchestra.run.smithi096.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:58:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether ba:29:8a:a9:cb:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-24T23:58:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-24T23:58:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::b829:8aff:fea9:cb47/64 scope link 2024-04-24T23:58:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:29.221 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-24T23:58:29.221 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:29.221 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:58:29.221 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-24T23:58:29.221 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-24T23:58:29.221 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-24T23:58:29.221 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-24T23:58:29.221 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-24T23:58:29.221 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:58:29.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:29.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:29.499 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:29.499 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:58:29.499 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.1 up 2024-04-24T23:58:29.499 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.1 master ceph-brx 2024-04-24T23:58:29.499 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:58:29.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:29.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:29.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:58:29.700 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-24T23:58:29.747 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-24T23:58:29.747 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:58:29.747 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-24T23:58:29.796 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-24T23:58:29.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:29.797 DEBUG:teuthology.orchestra.run.smithi096:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-24T23:58:29.915 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-24T23:58:29.915 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-24T23:58:29.915 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-04-24T23:58:29.937 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-24T23:58:29.937 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-24T23:58:29.937 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-04-24T23:58:29.937 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:58:29.937 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:58:29.967 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-24T23:58:29.967 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-24T23:58:29.967 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-04-24T23:58:29.967 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:58:29.967 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:58:29.967 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790" 2024-04-24T23:58:29.967 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2024-04-24T23:58:29.967 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=c95ce1e9-7a69-4f8e-a964-bd4778092d3c" will pass to kernel 2024-04-24T23:58:29.972 INFO:teuthology.orchestra.run.smithi096.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-24T23:58:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:58:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:58:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:58:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:58:29.977 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:58:29.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:29.977 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-24T23:58:30.050 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:30.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:30.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:30.166 INFO:teuthology.orchestra.run.smithi096.stdout:client4510 2024-04-24T23:58:30.167 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:58:30.167 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:30.218 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:30.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:30.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:30.384 INFO:teuthology.orchestra.run.smithi096.stdout:client4510 2024-04-24T23:58:30.384 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:30.500 INFO:teuthology.orchestra.run.smithi096.stdout:client4510 2024-04-24T23:58:30.500 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c95ce1e9-7a69-4f8e-a964-bd4778092d3c.client4510/status') 2024-04-24T23:58:30.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:30.637 INFO:teuthology.orchestra.run.smithi096.stdout:instance: client.4510 (3)172.21.15.96:0/2699621886 2024-04-24T23:58:30.637 INFO:teuthology.orchestra.run.smithi096.stdout:blocklisted: false 2024-04-24T23:58:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:0+1 records in 2024-04-24T23:58:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:0+1 records out 2024-04-24T23:58:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:70 bytes copied, 8.0763e-05 s, 867 kB/s 2024-04-24T23:58:30.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:30.650 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-24T23:58:30.650 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:58:30.650 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-24T23:58:30.650 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:58:30.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.848+0000 7f001ae00640 1 Processor -- start 2024-04-24T23:58:30.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.848+0000 7f001ae00640 1 -- start start 2024-04-24T23:58:30.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.850+0000 7f001ae00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00141551c0 0x7f00140b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:30.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.850+0000 7f001ae00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00140b4590 0x7f00140b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:30.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.850+0000 7f001ae00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00140b3070 con 0x7f001415f450 2024-04-24T23:58:30.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.850+0000 7f001ae00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f00140b4f40 con 0x7f00140b4590 2024-04-24T23:58:30.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.850+0000 7f001ae00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f00140b3960 con 0x7f00141551c0 2024-04-24T23:58:30.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.851+0000 7f0018e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00140b4590 0x7f00140b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:30.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.851+0000 7f0018e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00140b4590 0x7f00140b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:39598/0 (socket says 172.21.15.96:39598) 2024-04-24T23:58:30.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.851+0000 7f0018e00640 1 -- 172.21.15.96:0/839284936 learned_addr learned my addr 172.21.15.96:0/839284936 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.851+0000 7f0013e00640 1 --2- 172.21.15.96:0/839284936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00141551c0 0x7f00140b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.851+0000 7f0018e00640 1 -- 172.21.15.96:0/839284936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00141551c0 msgr2=0x7f00140b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.851+0000 7f0018e00640 1 --2- 172.21.15.96:0/839284936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00141551c0 0x7f00140b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.851+0000 7f0018e00640 1 -- 172.21.15.96:0/839284936 >> v1:172.21.15.155:6789/0 conn(0x7f001415f450 legacy=0x7f0014070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.851+0000 7f0018e00640 1 -- 172.21.15.96:0/839284936 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00140b3310 con 0x7f00140b4590 2024-04-24T23:58:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.853+0000 7f0018e00640 1 --2- 172.21.15.96:0/839284936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 0x7f00140b4a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f000c009e50 tx=0x7f000c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b47912091f3c97e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:30.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.853+0000 7f0012a00640 1 -- 172.21.15.96:0/839284936 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c036070 con 0x7f00140b4590 2024-04-24T23:58:30.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.853+0000 7f0012a00640 1 -- 172.21.15.96:0/839284936 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c031600 con 0x7f00140b4590 2024-04-24T23:58:30.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.853+0000 7f0012a00640 1 -- 172.21.15.96:0/839284936 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0319d0 con 0x7f00140b4590 2024-04-24T23:58:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.854+0000 7f001ae00640 1 -- 172.21.15.96:0/839284936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 msgr2=0x7f00140b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.854+0000 7f001ae00640 1 --2- 172.21.15.96:0/839284936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 0x7f00140b4a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f000c009e50 tx=0x7f000c02a680 comp rx=0 tx=0).stop 2024-04-24T23:58:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.854+0000 7f001ae00640 1 -- 172.21.15.96:0/839284936 shutdown_connections 2024-04-24T23:58:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.854+0000 7f001ae00640 1 --2- 172.21.15.96:0/839284936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 0x7f00140b4a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.854+0000 7f001ae00640 1 --2- 172.21.15.96:0/839284936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00141551c0 0x7f00140b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.854+0000 7f001ae00640 1 -- 172.21.15.96:0/839284936 >> 172.21.15.96:0/839284936 conn(0x7f00140b19c0 msgr2=0x7f00140b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.854+0000 7f001ae00640 1 -- 172.21.15.96:0/839284936 shutdown_connections 2024-04-24T23:58:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.854+0000 7f001ae00640 1 -- 172.21.15.96:0/839284936 wait complete. 2024-04-24T23:58:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.856+0000 7f001ae00640 1 Processor -- start 2024-04-24T23:58:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.856+0000 7f001ae00640 1 -- start start 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.857+0000 7f001ae00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 0x7f0014149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f001ae00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00141551c0 0x7f0014151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f001ae00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f001415f450 0x7f00141521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f001ae00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f00141555a0 con 0x7f00141551c0 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f001ae00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0014071500 con 0x7f00140b4590 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f001ae00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0014155720 con 0x7f001415f450 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00141551c0 0x7f0014151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00141551c0 0x7f0014151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60984/0 (socket says 172.21.15.96:60984) 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013400640 1 -- 172.21.15.96:0/1555019805 learned_addr learned my addr 172.21.15.96:0/1555019805 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0018e00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f001415f450 0x7f00141521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013e00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 0x7f0014149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013400640 1 -- 172.21.15.96:0/1555019805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f001415f450 msgr2=0x7f00141521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013400640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f001415f450 0x7f00141521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013400640 1 -- 172.21.15.96:0/1555019805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 msgr2=0x7f0014149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013400640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 0x7f0014149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013400640 1 -- 172.21.15.96:0/1555019805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0014159a90 con 0x7f00141551c0 2024-04-24T23:58:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.858+0000 7f0013e00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 0x7f0014149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.859+0000 7f0013400640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00141551c0 0x7f0014151ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f000000c3f0 tx=0x7f000000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.859+0000 7f000be00640 1 -- 172.21.15.96:0/1555019805 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00000052d0 con 0x7f00141551c0 2024-04-24T23:58:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.859+0000 7f000be00640 1 -- 172.21.15.96:0/1555019805 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0000005490 con 0x7f00141551c0 2024-04-24T23:58:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.859+0000 7f000be00640 1 -- 172.21.15.96:0/1555019805 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000007260 con 0x7f00141551c0 2024-04-24T23:58:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.859+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0014159d70 con 0x7f00141551c0 2024-04-24T23:58:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.859+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001415a330 con 0x7f00141551c0 2024-04-24T23:58:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.860+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0014069110 con 0x7f00141551c0 2024-04-24T23:58:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.861+0000 7f000be00640 1 -- 172.21.15.96:0/1555019805 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0000007400 con 0x7f00141551c0 2024-04-24T23:58:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.862+0000 7f000be00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efff406be30 0x7efff406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.862+0000 7f000be00640 1 -- 172.21.15.96:0/1555019805 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f000008a340 con 0x7f00141551c0 2024-04-24T23:58:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.862+0000 7f0013e00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efff406be30 0x7efff406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:30.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.863+0000 7f0013e00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efff406be30 0x7efff406e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0004009ac0 tx=0x7f0004008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:30.867+0000 7f000be00640 1 -- 172.21.15.96:0/1555019805 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0000058ce0 con 0x7f00141551c0 2024-04-24T23:58:31.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.104+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f001406e8d0 con 0x7f00141551c0 2024-04-24T23:58:31.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.105+0000 7f000be00640 1 -- 172.21.15.96:0/1555019805 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f00000585e0 con 0x7f00141551c0 2024-04-24T23:58:31.105 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:58:31.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efff406be30 msgr2=0x7efff406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:31.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efff406be30 0x7efff406e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0004009ac0 tx=0x7f0004008040 comp rx=0 tx=0).stop 2024-04-24T23:58:31.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00141551c0 msgr2=0x7f0014151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:31.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00141551c0 0x7f0014151ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f000000c3f0 tx=0x7f000000c8b0 comp rx=0 tx=0).stop 2024-04-24T23:58:31.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 shutdown_connections 2024-04-24T23:58:31.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f001415f450 0x7f00141521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:31.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7efff406be30 0x7efff406e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:31.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00141551c0 0x7f0014151ca0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:31.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 --2- 172.21.15.96:0/1555019805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00140b4590 0x7f0014149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:31.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 >> 172.21.15.96:0/1555019805 conn(0x7f00140b19c0 msgr2=0x7f00140b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:31.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 shutdown_connections 2024-04-24T23:58:31.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:31.108+0000 7f001ae00640 1 -- 172.21.15.96:0/1555019805 wait complete. 2024-04-24T23:58:31.126 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:58:31.126 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:58:31.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-04-24T23:58:31.126 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-24T23:58:31.126 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-24T23:58:31.126 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:58:31.126 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:58:31.126 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:58:31.126 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-24T23:58:31.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:31.127 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-04-24T23:58:31.187 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:58:31.187 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:58:31.187 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:58:31.187 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:31.187 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42591sec preferred_lft 42591sec 2024-04-24T23:58:31.188 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-04-24T23:58:31.189 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:31.189 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:58:31.190 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:31.190 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:58:31.190 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:58:31.190 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2024-04-24T23:58:31.190 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2024-04-24T23:58:31.190 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:58:31.190 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:58:31.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:31.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:31.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:31.670 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:58:31.733 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-24T23:58:31.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:31.736 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-04-24T23:58:31.805 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-04-24T23:58:31.805 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:58:31.805 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:58:31.805 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:58:31.805 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:58:31.805 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:31.805 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:58:31.805 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:58:31.805 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:58:31.805 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:58:31.806 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:58:31.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:32.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:32.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:32.549 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-24T23:58:32.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:32.590 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-04-24T23:58:32.676 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:32.676 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:58:32.677 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:58:32.677 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-24T23:58:32.677 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:58:32.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:32.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:32.889 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-24T23:58:32.889 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:32.890 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:58:32.890 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-24T23:58:32.890 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:58:32.890 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-24T23:58:32.890 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-24T23:58:32.890 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-24T23:58:32.890 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:58:32.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:33.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:33.156 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:33.156 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:58:33.156 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-04-24T23:58:33.156 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:58:33.156 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:58:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:33.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:33.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:58:33.346 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-24T23:58:33.390 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-24T23:58:33.391 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:58:33.391 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-24T23:58:33.484 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-24T23:58:33.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:33.484 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-24T23:58:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-24T23:58:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-24T23:58:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2024-04-24T23:58:34.339 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-24T23:58:34.339 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-24T23:58:34.339 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2024-04-24T23:58:34.340 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:58:34.340 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:58:34.379 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-24T23:58:34.379 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-24T23:58:34.381 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2024-04-24T23:58:34.381 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:58:34.381 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:58:34.382 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790" 2024-04-24T23:58:34.382 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2024-04-24T23:58:34.382 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c95ce1e9-7a69-4f8e-a964-bd4778092d3c" will pass to kernel 2024-04-24T23:58:34.383 INFO:teuthology.orchestra.run.smithi155.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-24T23:58:34.384 INFO:teuthology.orchestra.run.smithi155.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:58:34.384 INFO:teuthology.orchestra.run.smithi155.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:58:34.384 INFO:teuthology.orchestra.run.smithi155.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:58:34.384 INFO:teuthology.orchestra.run.smithi155.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:58:34.389 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:58:34.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:34.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-24T23:58:34.470 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:34.593 INFO:teuthology.orchestra.run.smithi155.stdout:client4692 2024-04-24T23:58:34.593 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:58:34.594 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:34.645 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:34.762 INFO:teuthology.orchestra.run.smithi155.stdout:client4692 2024-04-24T23:58:34.762 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:34.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:34.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:34.890 INFO:teuthology.orchestra.run.smithi155.stdout:client4692 2024-04-24T23:58:34.890 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c95ce1e9-7a69-4f8e-a964-bd4778092d3c.client4692/status') 2024-04-24T23:58:34.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:35.026 INFO:teuthology.orchestra.run.smithi155.stdout:instance: client.4692 (3)172.21.15.155:0/2320488140 2024-04-24T23:58:35.026 INFO:teuthology.orchestra.run.smithi155.stdout:blocklisted: false 2024-04-24T23:58:35.026 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records in 2024-04-24T23:58:35.026 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records out 2024-04-24T23:58:35.026 INFO:teuthology.orchestra.run.smithi155.stderr:71 bytes copied, 9.688e-05 s, 733 kB/s 2024-04-24T23:58:35.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:35.039 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-24T23:58:35.039 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:58:35.039 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-24T23:58:35.040 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:58:35.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.251+0000 7fa7fac00640 1 Processor -- start 2024-04-24T23:58:35.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.251+0000 7fa7fac00640 1 -- start start 2024-04-24T23:58:35.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.253+0000 7fa7fac00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa7f415c230 0x7fa7f4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:35.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.253+0000 7fa7fac00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa7f40af120 0x7fa7f406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:35.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.253+0000 7fa7fac00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f4160b20 con 0x7fa7f40acda0 2024-04-24T23:58:35.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.253+0000 7fa7fac00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f415c610 con 0x7fa7f415c230 2024-04-24T23:58:35.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.253+0000 7fa7fac00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f40ad230 con 0x7fa7f40af120 2024-04-24T23:58:35.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.253+0000 7fa7f3e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa7f415c230 0x7fa7f4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:35.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.253+0000 7fa7eb400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa7f40acda0 0x7fa7f40aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:57716/0 (socket says 172.21.15.96:57716) 2024-04-24T23:58:35.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.254+0000 7fa7eb400640 1 -- 172.21.15.96:0/2103938878 learned_addr learned my addr 172.21.15.96:0/2103938878 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:35.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.254+0000 7fa7f8c00640 1 --2- 172.21.15.96:0/2103938878 >> v2:172.21.15.155:3300/0 conn(0x7fa7f40af120 0x7fa7f406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.254+0000 7fa7f3e00640 1 -- 172.21.15.96:0/2103938878 >> v2:172.21.15.155:3300/0 conn(0x7fa7f40af120 msgr2=0x7fa7f406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.254+0000 7fa7f3e00640 1 --2- 172.21.15.96:0/2103938878 >> v2:172.21.15.155:3300/0 conn(0x7fa7f40af120 0x7fa7f406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.254+0000 7fa7f3e00640 1 -- 172.21.15.96:0/2103938878 >> v1:172.21.15.96:6789/0 conn(0x7fa7f40acda0 legacy=0x7fa7f40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.254+0000 7fa7f3e00640 1 -- 172.21.15.96:0/2103938878 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f415fd60 con 0x7fa7f415c230 2024-04-24T23:58:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.255+0000 7fa7f3e00640 1 --2- 172.21.15.96:0/2103938878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f415c230 0x7fa7f4071800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4070d80 tx=0x7fa7e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73429d07679df924 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:35.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.255+0000 7fa7f3400640 1 -- 172.21.15.96:0/2103938878 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4037070 con 0x7fa7f415c230 2024-04-24T23:58:35.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.255+0000 7fa7f3400640 1 -- 172.21.15.96:0/2103938878 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e4032440 con 0x7fa7f415c230 2024-04-24T23:58:35.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.255+0000 7fa7f3400640 1 -- 172.21.15.96:0/2103938878 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4032810 con 0x7fa7f415c230 2024-04-24T23:58:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.256+0000 7fa7fac00640 1 -- 172.21.15.96:0/2103938878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f415c230 msgr2=0x7fa7f4071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.256+0000 7fa7fac00640 1 --2- 172.21.15.96:0/2103938878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f415c230 0x7fa7f4071800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4070d80 tx=0x7fa7e402a1a0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.256+0000 7fa7fac00640 1 -- 172.21.15.96:0/2103938878 shutdown_connections 2024-04-24T23:58:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.256+0000 7fa7fac00640 1 --2- 172.21.15.96:0/2103938878 >> v2:172.21.15.155:3300/0 conn(0x7fa7f40af120 0x7fa7f406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.256+0000 7fa7fac00640 1 --2- 172.21.15.96:0/2103938878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f415c230 0x7fa7f4071800 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.256+0000 7fa7fac00640 1 -- 172.21.15.96:0/2103938878 >> 172.21.15.96:0/2103938878 conn(0x7fa7f40b19c0 msgr2=0x7fa7f40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.256+0000 7fa7fac00640 1 -- 172.21.15.96:0/2103938878 shutdown_connections 2024-04-24T23:58:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.256+0000 7fa7fac00640 1 -- 172.21.15.96:0/2103938878 wait complete. 2024-04-24T23:58:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.258+0000 7fa7fac00640 1 Processor -- start 2024-04-24T23:58:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.258+0000 7fa7fac00640 1 -- start start 2024-04-24T23:58:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.259+0000 7fa7fac00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f40acda0 0x7fa7f41499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.259+0000 7fa7fac00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7f40af120 0x7fa7f415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.259+0000 7fa7fac00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f415c230 0x7fa7f41f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.259+0000 7fa7fac00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f4160600 con 0x7fa7f40acda0 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.259+0000 7fa7fac00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f4160320 con 0x7fa7f40af120 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.259+0000 7fa7fac00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f40ad4d0 con 0x7fa7f415c230 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.259+0000 7fa7f3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f40acda0 0x7fa7f41499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.259+0000 7fa7f3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f40acda0 0x7fa7f41499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32772/0 (socket says 172.21.15.96:32772) 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.259+0000 7fa7f3e00640 1 -- 172.21.15.96:0/978751915 learned_addr learned my addr 172.21.15.96:0/978751915 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7f3e00640 1 -- 172.21.15.96:0/978751915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f415c230 msgr2=0x7fa7f41f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7f3e00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f415c230 0x7fa7f41f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7f3e00640 1 -- 172.21.15.96:0/978751915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7f40af120 msgr2=0x7fa7f415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7f3e00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7f40af120 0x7fa7f415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7f3e00640 1 -- 172.21.15.96:0/978751915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f409bd20 con 0x7fa7f40acda0 2024-04-24T23:58:35.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7f3e00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f40acda0 0x7fa7f41499a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009890 tx=0x7fa7e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:35.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7f0c00640 1 -- 172.21.15.96:0/978751915 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4037040 con 0x7fa7f40acda0 2024-04-24T23:58:35.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7f0c00640 1 -- 172.21.15.96:0/978751915 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e4042070 con 0x7fa7f40acda0 2024-04-24T23:58:35.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7f0c00640 1 -- 172.21.15.96:0/978751915 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4030bd0 con 0x7fa7f40acda0 2024-04-24T23:58:35.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f409c000 con 0x7fa7f40acda0 2024-04-24T23:58:35.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.260+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f409c5c0 con 0x7fa7f40acda0 2024-04-24T23:58:35.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.262+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f4069110 con 0x7fa7f40acda0 2024-04-24T23:58:35.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.263+0000 7fa7f0c00640 1 -- 172.21.15.96:0/978751915 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7e4047460 con 0x7fa7f40acda0 2024-04-24T23:58:35.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.263+0000 7fa7f0c00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa7d006be30 0x7fa7d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:35.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.264+0000 7fa7f0c00640 1 -- 172.21.15.96:0/978751915 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa7e40aba40 con 0x7fa7f40acda0 2024-04-24T23:58:35.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.264+0000 7fa7eb400640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa7d006be30 0x7fa7d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:35.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.264+0000 7fa7eb400640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa7d006be30 0x7fa7d006e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc000f60 tx=0x7fa7dc007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.268+0000 7fa7f0c00640 1 -- 172.21.15.96:0/978751915 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa7e4032e20 con 0x7fa7f40acda0 2024-04-24T23:58:35.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.507+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa7f40d0230 con 0x7fa7f40acda0 2024-04-24T23:58:35.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.508+0000 7fa7f0c00640 1 -- 172.21.15.96:0/978751915 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fa7e407a3e0 con 0x7fa7f40acda0 2024-04-24T23:58:35.508 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:58:35.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.510+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa7d006be30 msgr2=0x7fa7d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:35.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.510+0000 7fa7fac00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa7d006be30 0x7fa7d006e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc000f60 tx=0x7fa7dc007a80 comp rx=0 tx=0).stop 2024-04-24T23:58:35.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f40acda0 msgr2=0x7fa7f41499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:35.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f40acda0 0x7fa7f41499a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009890 tx=0x7fa7e40046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 shutdown_connections 2024-04-24T23:58:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7f415c230 0x7fa7f41f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7f40af120 0x7fa7f415f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa7d006be30 0x7fa7d006e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 --2- 172.21.15.96:0/978751915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f40acda0 0x7fa7f41499a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 >> 172.21.15.96:0/978751915 conn(0x7fa7f40b19c0 msgr2=0x7fa7f40afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 shutdown_connections 2024-04-24T23:58:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:35.511+0000 7fa7fac00640 1 -- 172.21.15.96:0/978751915 wait complete. 2024-04-24T23:58:35.529 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:58:35.529 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:58:35.530 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-04-24T23:58:35.530 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-24T23:58:35.530 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-24T23:58:35.530 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:58:35.530 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:58:35.530 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:58:35.530 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-24T23:58:35.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:35.530 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-04-24T23:58:35.590 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:58:35.590 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:35.591 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42586sec preferred_lft 42586sec 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether ca:04:72:29:52:70 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::1888:7bff:fef8:7636/64 scope link 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether ca:04:72:29:52:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c804:72ff:fe29:5270/64 scope link 2024-04-24T23:58:35.592 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:35.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:35.594 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:58:35.677 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-24T23:58:35.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:35.681 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-04-24T23:58:35.733 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-04-24T23:58:35.733 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:58:35.733 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:58:35.733 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:58:35.733 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:58:35.734 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:35.734 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:58:35.734 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:58:35.734 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:58:35.734 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:58:35.734 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:58:35.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:35.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:35.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:35.939 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-24T23:58:35.982 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-24T23:58:35.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:35.983 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-04-24T23:58:36.079 INFO:teuthology.orchestra.run.smithi155.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-24T23:58:36.081 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:36.081 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:58:36.081 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-24T23:58:36.081 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-24T23:58:36.081 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:58:36.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:36.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:36.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:36.266 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-24T23:58:36.336 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:58:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:58:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:58:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:36.337 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-04-24T23:58:36.337 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:36.337 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:58:36.337 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 56:b4:c5:a2:c8:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-24T23:58:36.337 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-24T23:58:36.337 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:36.337 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::54b4:c5ff:fea2:c8d1/64 scope link 2024-04-24T23:58:36.337 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:36.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:36.339 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 56:b4:c5:a2:c8:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-24T23:58:36.418 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:36.419 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::54b4:c5ff:fea2:c8d1/64 scope link 2024-04-24T23:58:36.419 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:58:36.422 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-24T23:58:36.422 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:36.422 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:58:36.422 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-24T23:58:36.422 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-24T23:58:36.422 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-24T23:58:36.422 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-24T23:58:36.422 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-24T23:58:36.423 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:58:36.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:36.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:36.699 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:58:36.699 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:58:36.699 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.1 up 2024-04-24T23:58:36.699 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.1 master ceph-brx 2024-04-24T23:58:36.699 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:58:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:36.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:58:36.910 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-24T23:58:36.959 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-24T23:58:36.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:58:36.959 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-24T23:58:37.054 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-24T23:58:37.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:37.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-24T23:58:37.180 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-24T23:58:37.180 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-24T23:58:37.181 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2024-04-24T23:58:37.202 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-24T23:58:37.203 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-24T23:58:37.203 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2024-04-24T23:58:37.203 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:58:37.203 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:58:37.228 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-24T23:58:37.229 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-24T23:58:37.229 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2024-04-24T23:58:37.229 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:58:37.229 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:58:37.229 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790" 2024-04-24T23:58:37.229 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2024-04-24T23:58:37.229 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=c95ce1e9-7a69-4f8e-a964-bd4778092d3c" will pass to kernel 2024-04-24T23:58:37.235 INFO:teuthology.orchestra.run.smithi155.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-24T23:58:37.235 INFO:teuthology.orchestra.run.smithi155.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:58:37.236 INFO:teuthology.orchestra.run.smithi155.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:58:37.236 INFO:teuthology.orchestra.run.smithi155.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:58:37.236 INFO:teuthology.orchestra.run.smithi155.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:58:37.236 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:58:37.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:37.236 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-24T23:58:37.312 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:37.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:37.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:37.422 INFO:teuthology.orchestra.run.smithi155.stdout:client4519 2024-04-24T23:58:37.422 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:58:37.422 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:37.470 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:37.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:37.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:37.636 INFO:teuthology.orchestra.run.smithi155.stdout:client4519 2024-04-24T23:58:37.637 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:58:37.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:58:37.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:37.758 INFO:teuthology.orchestra.run.smithi155.stdout:client4519 2024-04-24T23:58:37.758 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c95ce1e9-7a69-4f8e-a964-bd4778092d3c.client4519/status') 2024-04-24T23:58:37.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:58:37.890 INFO:teuthology.orchestra.run.smithi155.stdout:instance: client.4519 (3)192.168.0.2:0/2371791722 2024-04-24T23:58:37.890 INFO:teuthology.orchestra.run.smithi155.stdout:blocklisted: false 2024-04-24T23:58:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records in 2024-04-24T23:58:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records out 2024-04-24T23:58:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:69 bytes copied, 9.0714e-05 s, 761 kB/s 2024-04-24T23:58:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:58:37.903 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-24T23:58:37.913 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-24T23:58:37.957 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:38.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.168+0000 7f13a5c00640 1 Processor -- start 2024-04-24T23:58:38.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.168+0000 7f13a5c00640 1 -- start start 2024-04-24T23:58:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f13a5c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13a015e480 0x7f13a00cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f13a5c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f13a00b2be0 0x7f13a0072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f13a5c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00cc6e0 0x7f13a00ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f13a5c00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f13a0073060 con 0x7f13a00b2be0 2024-04-24T23:58:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f13a5c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f13a006cc10 con 0x7f13a015e480 2024-04-24T23:58:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f13a5c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13a006cef0 con 0x7f13a00cc6e0 2024-04-24T23:58:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f139f400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f13a00b2be0 0x7f13a0072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f139f400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f13a00b2be0 0x7f13a0072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43622/0 (socket says 172.21.15.96:43622) 2024-04-24T23:58:38.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f139f400640 1 -- 172.21.15.96:0/1740707781 learned_addr learned my addr 172.21.15.96:0/1740707781 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f139fe00640 1 --2- 172.21.15.96:0/1740707781 >> v2:172.21.15.155:3300/0 conn(0x7f13a015e480 0x7f13a00cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f13a5200640 1 --2- 172.21.15.96:0/1740707781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00cc6e0 0x7f13a00ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.170+0000 7f139f400640 1 -- 172.21.15.96:0/1740707781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00cc6e0 msgr2=0x7f13a00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.171+0000 7f139f400640 1 --2- 172.21.15.96:0/1740707781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00cc6e0 0x7f13a00ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.171+0000 7f139f400640 1 -- 172.21.15.96:0/1740707781 >> v2:172.21.15.155:3300/0 conn(0x7f13a015e480 msgr2=0x7f13a00cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.171+0000 7f139f400640 1 --2- 172.21.15.96:0/1740707781 >> v2:172.21.15.155:3300/0 conn(0x7f13a015e480 0x7f13a00cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.171+0000 7f139f400640 1 -- 172.21.15.96:0/1740707781 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a006d1d0 con 0x7f13a00b2be0 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.171+0000 7f13a5200640 1 --2- 172.21.15.96:0/1740707781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00cc6e0 0x7f13a00ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.171+0000 7f139fe00640 1 --2- 172.21.15.96:0/1740707781 >> v2:172.21.15.155:3300/0 conn(0x7f13a015e480 0x7f13a00cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.172+0000 7f139f400640 1 --2- 172.21.15.96:0/1740707781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00b2be0 0x7f13a0072810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f13a006c1f0 tx=0x7f138c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876bc5444b1b281b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.172+0000 7f139ea00640 1 -- 172.21.15.96:0/1740707781 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c037070 con 0x7f13a00b2be0 2024-04-24T23:58:38.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.172+0000 7f139ea00640 1 -- 172.21.15.96:0/1740707781 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138c032440 con 0x7f13a00b2be0 2024-04-24T23:58:38.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.172+0000 7f139ea00640 1 -- 172.21.15.96:0/1740707781 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c032810 con 0x7f13a00b2be0 2024-04-24T23:58:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.173+0000 7f13a5c00640 1 -- 172.21.15.96:0/1740707781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00b2be0 msgr2=0x7f13a0072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.173+0000 7f13a5c00640 1 --2- 172.21.15.96:0/1740707781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00b2be0 0x7f13a0072810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f13a006c1f0 tx=0x7f138c02a140 comp rx=0 tx=0).stop 2024-04-24T23:58:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.173+0000 7f13a5c00640 1 -- 172.21.15.96:0/1740707781 shutdown_connections 2024-04-24T23:58:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.173+0000 7f13a5c00640 1 --2- 172.21.15.96:0/1740707781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00cc6e0 0x7f13a00ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.173+0000 7f13a5c00640 1 --2- 172.21.15.96:0/1740707781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00b2be0 0x7f13a0072810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.173+0000 7f13a5c00640 1 --2- 172.21.15.96:0/1740707781 >> v2:172.21.15.155:3300/0 conn(0x7f13a015e480 0x7f13a00cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.173+0000 7f13a5c00640 1 -- 172.21.15.96:0/1740707781 >> 172.21.15.96:0/1740707781 conn(0x7f13a00b1f10 msgr2=0x7f13a00cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.173+0000 7f13a5c00640 1 -- 172.21.15.96:0/1740707781 shutdown_connections 2024-04-24T23:58:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.173+0000 7f13a5c00640 1 -- 172.21.15.96:0/1740707781 wait complete. 2024-04-24T23:58:38.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.174+0000 7f13a5c00640 1 Processor -- start 2024-04-24T23:58:38.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.175+0000 7f13a5c00640 1 -- start start 2024-04-24T23:58:38.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.175+0000 7f13a5c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00b2be0 0x7f13a00cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.175+0000 7f13a5c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00cc6e0 0x7f13a015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f13a5c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a015e480 0x7f13a01603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f13a5c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f13a006d9d0 con 0x7f13a00cc6e0 2024-04-24T23:58:38.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f13a5c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13a0072d50 con 0x7f13a015e480 2024-04-24T23:58:38.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f13a5c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13a006db50 con 0x7f13a00b2be0 2024-04-24T23:58:38.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00cc6e0 0x7f13a015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00cc6e0 0x7f13a015feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43628/0 (socket says 172.21.15.96:43628) 2024-04-24T23:58:38.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139f400640 1 -- 172.21.15.96:0/3050863638 learned_addr learned my addr 172.21.15.96:0/3050863638 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:38.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f13a5200640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a015e480 0x7f13a01603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139fe00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00b2be0 0x7f13a00cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139f400640 1 -- 172.21.15.96:0/3050863638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00b2be0 msgr2=0x7f13a00cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139f400640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00b2be0 0x7f13a00cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139f400640 1 -- 172.21.15.96:0/3050863638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a015e480 msgr2=0x7f13a01603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139f400640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a015e480 0x7f13a01603f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139f400640 1 -- 172.21.15.96:0/3050863638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a00c9970 con 0x7f13a00cc6e0 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.176+0000 7f139fe00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00b2be0 0x7f13a00cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.177+0000 7f139f400640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00cc6e0 0x7f13a015feb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f138c02a180 tx=0x7f138c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.177+0000 7f1397e00640 1 -- 172.21.15.96:0/3050863638 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c037040 con 0x7f13a00cc6e0 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.177+0000 7f1397e00640 1 -- 172.21.15.96:0/3050863638 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138c042070 con 0x7f13a00cc6e0 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.177+0000 7f1397e00640 1 -- 172.21.15.96:0/3050863638 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c030bb0 con 0x7f13a00cc6e0 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.177+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a00c9c10 con 0x7f13a00cc6e0 2024-04-24T23:58:38.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.177+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a00ca1d0 con 0x7f13a00cc6e0 2024-04-24T23:58:38.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.179+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a00756b0 con 0x7f13a00cc6e0 2024-04-24T23:58:38.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.180+0000 7f1397e00640 1 -- 172.21.15.96:0/3050863638 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f138c047460 con 0x7f13a00cc6e0 2024-04-24T23:58:38.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.181+0000 7f1397e00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f138006be30 0x7f138006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.181+0000 7f1397e00640 1 -- 172.21.15.96:0/3050863638 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f138c0abb40 con 0x7f13a00cc6e0 2024-04-24T23:58:38.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.181+0000 7f139fe00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f138006be30 0x7f138006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.182+0000 7f139fe00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f138006be30 0x7f138006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1390006fd0 tx=0x7f1390008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:38.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.186+0000 7f1397e00640 1 -- 172.21.15.96:0/3050863638 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f138c045360 con 0x7f13a00cc6e0 2024-04-24T23:58:38.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.384+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13a0070e00 con 0x7f13a00cc6e0 2024-04-24T23:58:38.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.386+0000 7f1397e00640 1 -- 172.21.15.96:0/3050863638 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7f138c07a4e0 con 0x7f13a00cc6e0 2024-04-24T23:58:38.387 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:38.387 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:38.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f138006be30 msgr2=0x7f138006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f138006be30 0x7f138006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1390006fd0 tx=0x7f1390008040 comp rx=0 tx=0).stop 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00cc6e0 msgr2=0x7f13a015feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00cc6e0 0x7f13a015feb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f138c02a180 tx=0x7f138c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 shutdown_connections 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13a015e480 0x7f13a01603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f138006be30 0x7f138006e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13a00cc6e0 0x7f13a015feb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 --2- 172.21.15.96:0/3050863638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13a00b2be0 0x7f13a00cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 >> 172.21.15.96:0/3050863638 conn(0x7f13a00b1f10 msgr2=0x7f13a015db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 shutdown_connections 2024-04-24T23:58:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.389+0000 7f13a5c00640 1 -- 172.21.15.96:0/3050863638 wait complete. 2024-04-24T23:58:38.408 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:38.409 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:38.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.606+0000 7f2753800640 1 Processor -- start 2024-04-24T23:58:38.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.606+0000 7f2753800640 1 -- start start 2024-04-24T23:58:38.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.608+0000 7f2753800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f274c156620 0x7f274c15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.608+0000 7f2753800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f274c06d100 con 0x7f274c0ae8e0 2024-04-24T23:58:38.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.608+0000 7f2753800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f274c0acda0 con 0x7f274c06edf0 2024-04-24T23:58:38.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.608+0000 7f2753800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f274c0ad060 con 0x7f274c156620 2024-04-24T23:58:38.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.608+0000 7f2751800640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f274c0ae8e0 0x7f274c0aed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36552/0 (socket says 172.21.15.96:36552) 2024-04-24T23:58:38.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.608+0000 7f2751800640 1 -- 172.21.15.96:0/522797468 learned_addr learned my addr 172.21.15.96:0/522797468 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:38.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.608+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737214701 0 0) 0x7f274c06d100 con 0x7f274c0ae8e0 2024-04-24T23:58:38.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.608+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2730003520 con 0x7f274c0ae8e0 2024-04-24T23:58:38.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f2750e00640 1 --2- 172.21.15.96:0/522797468 >> v2:172.21.15.155:3300/0 conn(0x7f274c156620 0x7f274c15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4043387975 0 0) 0x7f2730003520 con 0x7f274c0ae8e0 2024-04-24T23:58:38.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 >> v2:172.21.15.155:3300/0 conn(0x7f274c156620 msgr2=0x7f274c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:38.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 --2- 172.21.15.96:0/522797468 >> v2:172.21.15.155:3300/0 conn(0x7f274c156620 0x7f274c15cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 >> v1:172.21.15.155:6789/0 conn(0x7f274c06edf0 legacy=0x7f274c06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c06d3a0 con 0x7f274c0ae8e0 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f27440019f0 con 0x7f274c0ae8e0 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 >> v1:172.21.15.96:6789/0 conn(0x7f274c0ae8e0 legacy=0x7f274c0aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300039b0 0x7f2730003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2730004800 0x7f2730004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27300053c0 0x7f273000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f274c0ad060 con 0x7f2730004800 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f273000c250 con 0x7f27300039b0 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f273000c450 con 0x7f27300053c0 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.609+0000 7f2743e00640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2730004800 0x7f2730004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.610+0000 7f2743e00640 1 -- 172.21.15.96:0/522797468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27300053c0 msgr2=0x7f273000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.610+0000 7f2743e00640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27300053c0 0x7f273000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.610+0000 7f2750e00640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300039b0 0x7f2730003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.610+0000 7f2743e00640 1 -- 172.21.15.96:0/522797468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300039b0 msgr2=0x7f2730003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:38.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.610+0000 7f2743e00640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300039b0 0x7f2730003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.610+0000 7f2751800640 1 -- 172.21.15.96:0/522797468 reap_dead start 2024-04-24T23:58:38.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.610+0000 7f2743e00640 1 -- 172.21.15.96:0/522797468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2730003520 con 0x7f2730004800 2024-04-24T23:58:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.611+0000 7f2743e00640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2730004800 0x7f2730004c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2734001750 tx=0x7f2730005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3973d456e124a461 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.611+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734001370 con 0x7f2730004800 2024-04-24T23:58:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.611+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27340052d0 con 0x7f2730004800 2024-04-24T23:58:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.611+0000 7f274be00640 1 -- 172.21.15.96:0/522797468 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273402abc0 con 0x7f2730004800 2024-04-24T23:58:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.612+0000 7f2753800640 1 -- 172.21.15.96:0/522797468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2730004800 msgr2=0x7f2730004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.612+0000 7f2753800640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2730004800 0x7f2730004c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2734001750 tx=0x7f2730005830 comp rx=0 tx=0).stop 2024-04-24T23:58:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.612+0000 7f2753800640 1 -- 172.21.15.96:0/522797468 shutdown_connections 2024-04-24T23:58:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.612+0000 7f2753800640 1 --2- 172.21.15.96:0/522797468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2730004800 0x7f2730004c80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.612+0000 7f2753800640 1 -- 172.21.15.96:0/522797468 >> 172.21.15.96:0/522797468 conn(0x7f274c0b19c0 msgr2=0x7f274c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:38.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.612+0000 7f2753800640 1 -- 172.21.15.96:0/522797468 shutdown_connections 2024-04-24T23:58:38.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.612+0000 7f2753800640 1 -- 172.21.15.96:0/522797468 wait complete. 2024-04-24T23:58:38.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.614+0000 7f2753800640 1 Processor -- start 2024-04-24T23:58:38.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.614+0000 7f2753800640 1 -- start start 2024-04-24T23:58:38.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2753800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2730004800 0x7f274c154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2753800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c140580 0x7f274c140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2753800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274c152d70 0x7f274c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2753800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f274c0ad4c0 con 0x7f274c140580 2024-04-24T23:58:38.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2753800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f274c0ad340 con 0x7f274c152d70 2024-04-24T23:58:38.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2753800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f274c15cf70 con 0x7f2730004800 2024-04-24T23:58:38.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2743e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c140580 0x7f274c140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2743e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c140580 0x7f274c140a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43642/0 (socket says 172.21.15.96:43642) 2024-04-24T23:58:38.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2743e00640 1 -- 172.21.15.96:0/1492145417 learned_addr learned my addr 172.21.15.96:0/1492145417 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:38.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2743e00640 1 -- 172.21.15.96:0/1492145417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2730004800 msgr2=0x7f274c154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2750e00640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2730004800 0x7f274c154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2743e00640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2730004800 0x7f274c154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2743e00640 1 -- 172.21.15.96:0/1492145417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274c152d70 msgr2=0x7f274c1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2751800640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274c152d70 0x7f274c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2743e00640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274c152d70 0x7f274c1531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.615+0000 7f2743e00640 1 -- 172.21.15.96:0/1492145417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c153b10 con 0x7f274c140580 2024-04-24T23:58:38.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.616+0000 7f2743e00640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c140580 0x7f274c140a00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f273402a570 tx=0x7f2734001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:38.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.616+0000 7f2749600640 1 -- 172.21.15.96:0/1492145417 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273403f030 con 0x7f274c140580 2024-04-24T23:58:38.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.616+0000 7f2749600640 1 -- 172.21.15.96:0/1492145417 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2734005480 con 0x7f274c140580 2024-04-24T23:58:38.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.616+0000 7f2749600640 1 -- 172.21.15.96:0/1492145417 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734037040 con 0x7f274c140580 2024-04-24T23:58:38.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.616+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274c1e59a0 con 0x7f274c140580 2024-04-24T23:58:38.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.616+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f274c1e5f60 con 0x7f274c140580 2024-04-24T23:58:38.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.617+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f274c069110 con 0x7f274c140580 2024-04-24T23:58:38.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.618+0000 7f2749600640 1 -- 172.21.15.96:0/1492145417 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2734042070 con 0x7f274c140580 2024-04-24T23:58:38.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.620+0000 7f2749600640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f272806be30 0x7f272806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:38.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.620+0000 7f2749600640 1 -- 172.21.15.96:0/1492145417 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f27340aa430 con 0x7f274c140580 2024-04-24T23:58:38.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.620+0000 7f2750e00640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f272806be30 0x7f272806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:38.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.621+0000 7f2750e00640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f272806be30 0x7f272806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f274c069890 tx=0x7f273c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:38.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.624+0000 7f2749600640 1 -- 172.21.15.96:0/1492145417 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2734031390 con 0x7f274c140580 2024-04-24T23:58:38.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.819+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f274c074f80 con 0x7f274c140580 2024-04-24T23:58:38.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.820+0000 7f2749600640 1 -- 172.21.15.96:0/1492145417 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f2734078cb0 con 0x7f274c140580 2024-04-24T23:58:38.821 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:38.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f272806be30 msgr2=0x7f272806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f272806be30 0x7f272806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f274c069890 tx=0x7f273c008040 comp rx=0 tx=0).stop 2024-04-24T23:58:38.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c140580 msgr2=0x7f274c140a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:38.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c140580 0x7f274c140a00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f273402a570 tx=0x7f2734001120 comp rx=0 tx=0).stop 2024-04-24T23:58:38.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 shutdown_connections 2024-04-24T23:58:38.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274c152d70 0x7f274c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f272806be30 0x7f272806e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c140580 0x7f274c140a00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 --2- 172.21.15.96:0/1492145417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2730004800 0x7f274c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:38.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 >> 172.21.15.96:0/1492145417 conn(0x7f274c0b19c0 msgr2=0x7f274c06e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:38.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 shutdown_connections 2024-04-24T23:58:38.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:38.823+0000 7f2753800640 1 -- 172.21.15.96:0/1492145417 wait complete. 2024-04-24T23:58:38.842 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:39.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.045+0000 7f33d3400640 1 Processor -- start 2024-04-24T23:58:39.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.046+0000 7f33d3400640 1 -- start start 2024-04-24T23:58:39.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.047+0000 7f33d3400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33cc06edf0 0x7f33cc15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.047+0000 7f33d3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0ae8e0 0x7f33cc0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.047+0000 7f33d3400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33cc06d100 con 0x7f33cc156620 2024-04-24T23:58:39.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.047+0000 7f33d3400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f33cc0acda0 con 0x7f33cc06edf0 2024-04-24T23:58:39.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.047+0000 7f33d3400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33cc0af2d0 con 0x7f33cc0ae8e0 2024-04-24T23:58:39.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.048+0000 7f33d1400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0ae8e0 0x7f33cc0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.048+0000 7f33d1400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0ae8e0 0x7f33cc0aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:58170/0 (socket says 172.21.15.96:58170) 2024-04-24T23:58:39.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.048+0000 7f33d1400640 1 -- 172.21.15.96:0/1580011055 learned_addr learned my addr 172.21.15.96:0/1580011055 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:39.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.048+0000 7f33cbe00640 1 --2- 172.21.15.96:0/1580011055 >> v2:172.21.15.155:3300/0 conn(0x7f33cc06edf0 0x7f33cc15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.049+0000 7f33d1400640 1 -- 172.21.15.96:0/1580011055 >> v2:172.21.15.155:3300/0 conn(0x7f33cc06edf0 msgr2=0x7f33cc15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:39.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.049+0000 7f33d1400640 1 --2- 172.21.15.96:0/1580011055 >> v2:172.21.15.155:3300/0 conn(0x7f33cc06edf0 0x7f33cc15cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.049+0000 7f33d1400640 1 -- 172.21.15.96:0/1580011055 >> v1:172.21.15.155:6789/0 conn(0x7f33cc156620 legacy=0x7f33cc06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.049+0000 7f33d1400640 1 -- 172.21.15.96:0/1580011055 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc0ad060 con 0x7f33cc0ae8e0 2024-04-24T23:58:39.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.050+0000 7f33d1400640 1 --2- 172.21.15.96:0/1580011055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0ae8e0 0x7f33cc0aed90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009e50 tx=0x7f33c402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca31a7905b1cc129 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:39.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.051+0000 7f33cb400640 1 -- 172.21.15.96:0/1580011055 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c4036070 con 0x7f33cc0ae8e0 2024-04-24T23:58:39.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.051+0000 7f33cb400640 1 -- 172.21.15.96:0/1580011055 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c4031600 con 0x7f33cc0ae8e0 2024-04-24T23:58:39.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.051+0000 7f33cb400640 1 -- 172.21.15.96:0/1580011055 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c40319d0 con 0x7f33cc0ae8e0 2024-04-24T23:58:39.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.051+0000 7f33d3400640 1 -- 172.21.15.96:0/1580011055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0ae8e0 msgr2=0x7f33cc0aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.051+0000 7f33d3400640 1 --2- 172.21.15.96:0/1580011055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0ae8e0 0x7f33cc0aed90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009e50 tx=0x7f33c402a680 comp rx=0 tx=0).stop 2024-04-24T23:58:39.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.051+0000 7f33d3400640 1 -- 172.21.15.96:0/1580011055 shutdown_connections 2024-04-24T23:58:39.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.051+0000 7f33d3400640 1 --2- 172.21.15.96:0/1580011055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0ae8e0 0x7f33cc0aed90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.051+0000 7f33d3400640 1 --2- 172.21.15.96:0/1580011055 >> v2:172.21.15.155:3300/0 conn(0x7f33cc06edf0 0x7f33cc15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.051+0000 7f33d3400640 1 -- 172.21.15.96:0/1580011055 >> 172.21.15.96:0/1580011055 conn(0x7f33cc0b19c0 msgr2=0x7f33cc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:39.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.052+0000 7f33d3400640 1 -- 172.21.15.96:0/1580011055 shutdown_connections 2024-04-24T23:58:39.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.052+0000 7f33d3400640 1 -- 172.21.15.96:0/1580011055 wait complete. 2024-04-24T23:58:39.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.053+0000 7f33d3400640 1 Processor -- start 2024-04-24T23:58:39.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.053+0000 7f33d3400640 1 -- start start 2024-04-24T23:58:39.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.054+0000 7f33d3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33cc06edf0 0x7f33cc14ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.054+0000 7f33d3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0ae8e0 0x7f33cc150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.054+0000 7f33d3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc156620 0x7f33cc15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.054+0000 7f33d3400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0ad340 con 0x7f33cc06edf0 2024-04-24T23:58:39.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.054+0000 7f33d3400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc06d680 con 0x7f33cc0ae8e0 2024-04-24T23:58:39.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.054+0000 7f33d3400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33cc0ad4c0 con 0x7f33cc156620 2024-04-24T23:58:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33d0a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33cc06edf0 0x7f33cc14ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33d0a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33cc06edf0 0x7f33cc14ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43658/0 (socket says 172.21.15.96:43658) 2024-04-24T23:58:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33d0a00640 1 -- 172.21.15.96:0/39027090 learned_addr learned my addr 172.21.15.96:0/39027090 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33d1400640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc156620 0x7f33cc15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33cbe00640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0ae8e0 0x7f33cc150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33d0a00640 1 -- 172.21.15.96:0/39027090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc156620 msgr2=0x7f33cc15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33d0a00640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc156620 0x7f33cc15e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33d0a00640 1 -- 172.21.15.96:0/39027090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0ae8e0 msgr2=0x7f33cc150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33d0a00640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0ae8e0 0x7f33cc150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33d0a00640 1 -- 172.21.15.96:0/39027090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc0b3a60 con 0x7f33cc06edf0 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.055+0000 7f33cbe00640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0ae8e0 0x7f33cc150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.056+0000 7f33d0a00640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33cc06edf0 0x7f33cc14ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33c000c400 tx=0x7f33c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.056+0000 7f33c8c00640 1 -- 172.21.15.96:0/39027090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c00052d0 con 0x7f33cc06edf0 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.056+0000 7f33c8c00640 1 -- 172.21.15.96:0/39027090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c0005490 con 0x7f33cc06edf0 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.056+0000 7f33c8c00640 1 -- 172.21.15.96:0/39027090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c0007260 con 0x7f33cc06edf0 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.056+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33cc157ee0 con 0x7f33cc06edf0 2024-04-24T23:58:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.056+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33cc14f130 con 0x7f33cc06edf0 2024-04-24T23:58:39.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.057+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33cc069110 con 0x7f33cc06edf0 2024-04-24T23:58:39.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.058+0000 7f33c8c00640 1 -- 172.21.15.96:0/39027090 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33c0007400 con 0x7f33cc06edf0 2024-04-24T23:58:39.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.059+0000 7f33c8c00640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f33ac06be30 0x7f33ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.059+0000 7f33c8c00640 1 -- 172.21.15.96:0/39027090 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f33c008a440 con 0x7f33cc06edf0 2024-04-24T23:58:39.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.059+0000 7f33cbe00640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f33ac06be30 0x7f33ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.060+0000 7f33cbe00640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f33ac06be30 0x7f33ac06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33cc1f7600 tx=0x7f33b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:39.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.063+0000 7f33c8c00640 1 -- 172.21.15.96:0/39027090 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f33c0058d50 con 0x7f33cc06edf0 2024-04-24T23:58:39.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.261+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f33cc160640 con 0x7f33cc06edf0 2024-04-24T23:58:39.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.261+0000 7f33c8c00640 1 -- 172.21.15.96:0/39027090 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f33c0058650 con 0x7f33cc06edf0 2024-04-24T23:58:39.262 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.264+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f33ac06be30 msgr2=0x7f33ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.264+0000 7f33d3400640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f33ac06be30 0x7f33ac06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33cc1f7600 tx=0x7f33b8008040 comp rx=0 tx=0).stop 2024-04-24T23:58:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.264+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33cc06edf0 msgr2=0x7f33cc14ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.264+0000 7f33d3400640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33cc06edf0 0x7f33cc14ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33c000c400 tx=0x7f33c000c8c0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.265+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 shutdown_connections 2024-04-24T23:58:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.265+0000 7f33d3400640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc156620 0x7f33cc15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.265+0000 7f33d3400640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0ae8e0 0x7f33cc150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.265+0000 7f33d3400640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f33ac06be30 0x7f33ac06e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.265+0000 7f33d3400640 1 --2- 172.21.15.96:0/39027090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33cc06edf0 0x7f33cc14ebf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.265+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 >> 172.21.15.96:0/39027090 conn(0x7f33cc0b19c0 msgr2=0x7f33cc15c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:39.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.265+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 shutdown_connections 2024-04-24T23:58:39.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.265+0000 7f33d3400640 1 -- 172.21.15.96:0/39027090 wait complete. 2024-04-24T23:58:39.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:39.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.483+0000 7fe44cc00640 1 Processor -- start 2024-04-24T23:58:39.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.483+0000 7fe44cc00640 1 -- start start 2024-04-24T23:58:39.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe44cc00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe44815e2f0 0x7fe4480d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe44cc00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe4480cf120 0x7fe4480b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe44cc00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4480d1900 con 0x7fe4480d4bc0 2024-04-24T23:58:39.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe44cc00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe4480cf890 con 0x7fe44815e2f0 2024-04-24T23:58:39.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe44cc00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe4480cfb70 con 0x7fe4480cf120 2024-04-24T23:58:39.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe447400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe44815e2f0 0x7fe4480d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe447400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe44815e2f0 0x7fe4480d4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43668/0 (socket says 172.21.15.96:43668) 2024-04-24T23:58:39.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe447400640 1 -- 172.21.15.96:0/1836083560 learned_addr learned my addr 172.21.15.96:0/1836083560 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:39.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe446a00640 1 --1- 172.21.15.96:0/1836083560 >> v1:172.21.15.96:6789/0 conn(0x7fe4480d4bc0 0x7fe4480cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36566/0 (socket says 172.21.15.96:36566) 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe447e00640 1 --2- 172.21.15.96:0/1836083560 >> v2:172.21.15.155:3300/0 conn(0x7fe4480cf120 0x7fe4480b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.485+0000 7fe447400640 1 -- 172.21.15.96:0/1836083560 >> v2:172.21.15.155:3300/0 conn(0x7fe4480cf120 msgr2=0x7fe4480b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.486+0000 7fe447400640 1 --2- 172.21.15.96:0/1836083560 >> v2:172.21.15.155:3300/0 conn(0x7fe4480cf120 0x7fe4480b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.486+0000 7fe446000640 1 -- 172.21.15.96:0/1836083560 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911990620 0 0) 0x7fe4480d1900 con 0x7fe4480d4bc0 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.486+0000 7fe447400640 1 -- 172.21.15.96:0/1836083560 >> v1:172.21.15.96:6789/0 conn(0x7fe4480d4bc0 legacy=0x7fe4480cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.486+0000 7fe447400640 1 -- 172.21.15.96:0/1836083560 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4480b3660 con 0x7fe44815e2f0 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.486+0000 7fe447e00640 1 --2- 172.21.15.96:0/1836083560 >> v2:172.21.15.155:3300/0 conn(0x7fe4480cf120 0x7fe4480b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe447400640 1 --2- 172.21.15.96:0/1836083560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 0x7fe4480d4680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe4480b5a10 tx=0x7fe43002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f3b0e0b7f60339 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe446000640 1 -- 172.21.15.96:0/1836083560 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe430037070 con 0x7fe44815e2f0 2024-04-24T23:58:39.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe446000640 1 -- 172.21.15.96:0/1836083560 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe430032440 con 0x7fe44815e2f0 2024-04-24T23:58:39.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe446000640 1 -- 172.21.15.96:0/1836083560 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe430032810 con 0x7fe44815e2f0 2024-04-24T23:58:39.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe44cc00640 1 -- 172.21.15.96:0/1836083560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 msgr2=0x7fe4480d4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe44cc00640 1 --2- 172.21.15.96:0/1836083560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 0x7fe4480d4680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe4480b5a10 tx=0x7fe43002a1e0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe44cc00640 1 -- 172.21.15.96:0/1836083560 shutdown_connections 2024-04-24T23:58:39.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe44cc00640 1 --2- 172.21.15.96:0/1836083560 >> v2:172.21.15.155:3300/0 conn(0x7fe4480cf120 0x7fe4480b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe44cc00640 1 --2- 172.21.15.96:0/1836083560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 0x7fe4480d4680 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe44cc00640 1 -- 172.21.15.96:0/1836083560 >> 172.21.15.96:0/1836083560 conn(0x7fe44809d260 msgr2=0x7fe4480d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:39.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.487+0000 7fe44cc00640 1 -- 172.21.15.96:0/1836083560 shutdown_connections 2024-04-24T23:58:39.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.488+0000 7fe44cc00640 1 -- 172.21.15.96:0/1836083560 wait complete. 2024-04-24T23:58:39.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.489+0000 7fe44cc00640 1 Processor -- start 2024-04-24T23:58:39.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.489+0000 7fe44cc00640 1 -- start start 2024-04-24T23:58:39.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.490+0000 7fe44cc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4480cf120 0x7fe4481509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.490+0000 7fe44cc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4480d4bc0 0x7fe4481f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.490+0000 7fe44cc00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 0x7fe44814cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.490+0000 7fe44cc00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe44815e6d0 con 0x7fe44815e2f0 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.490+0000 7fe44cc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe4480cf570 con 0x7fe4480d4bc0 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.490+0000 7fe44cc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe44815e850 con 0x7fe4480cf120 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.490+0000 7fe447e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 0x7fe44814cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe447e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 0x7fe44814cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43676/0 (socket says 172.21.15.96:43676) 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe447e00640 1 -- 172.21.15.96:0/804770357 learned_addr learned my addr 172.21.15.96:0/804770357 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe447e00640 1 -- 172.21.15.96:0/804770357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4480cf120 msgr2=0x7fe4481509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe446a00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4480d4bc0 0x7fe4481f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe447400640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4480cf120 0x7fe4481509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe447e00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4480cf120 0x7fe4481509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe447e00640 1 -- 172.21.15.96:0/804770357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4480d4bc0 msgr2=0x7fe4481f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe447e00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4480d4bc0 0x7fe4481f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe447e00640 1 -- 172.21.15.96:0/804770357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe448151240 con 0x7fe44815e2f0 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe446a00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4480d4bc0 0x7fe4481f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:39.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.491+0000 7fe447e00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 0x7fe44814cf70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe44000c7c0 tx=0x7fe44000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.492+0000 7fe43f400640 1 -- 172.21.15.96:0/804770357 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440015020 con 0x7fe44815e2f0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.492+0000 7fe43f400640 1 -- 172.21.15.96:0/804770357 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe440004230 con 0x7fe44815e2f0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.492+0000 7fe43f400640 1 -- 172.21.15.96:0/804770357 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440007620 con 0x7fe44815e2f0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.492+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4480c9cf0 con 0x7fe44815e2f0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.492+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4480ca2b0 con 0x7fe44815e2f0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.493+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe44814ac00 con 0x7fe44815e2f0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.494+0000 7fe43f400640 1 -- 172.21.15.96:0/804770357 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe440018020 con 0x7fe44815e2f0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.495+0000 7fe43f400640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe42406be30 0x7fe42406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.495+0000 7fe43f400640 1 -- 172.21.15.96:0/804770357 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe44008af50 con 0x7fe44815e2f0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.495+0000 7fe447400640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe42406be30 0x7fe42406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.495+0000 7fe447400640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe42406be30 0x7fe42406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe430034000 tx=0x7fe43002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:39.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.499+0000 7fe43f400640 1 -- 172.21.15.96:0/804770357 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe44814ac00 con 0x7fe44815e2f0 2024-04-24T23:58:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.679+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe4480755d0 con 0x7fe44815e2f0 2024-04-24T23:58:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.680+0000 7fe43f400640 1 -- 172.21.15.96:0/804770357 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe44001f020 con 0x7fe44815e2f0 2024-04-24T23:58:39.683 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:39.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe42406be30 msgr2=0x7fe42406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe42406be30 0x7fe42406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe430034000 tx=0x7fe43002e000 comp rx=0 tx=0).stop 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 msgr2=0x7fe44814cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 0x7fe44814cf70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe44000c7c0 tx=0x7fe44000cc80 comp rx=0 tx=0).stop 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 shutdown_connections 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe42406be30 0x7fe42406e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe44815e2f0 0x7fe44814cf70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4480d4bc0 0x7fe4481f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 --2- 172.21.15.96:0/804770357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4480cf120 0x7fe4481509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.682+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 >> 172.21.15.96:0/804770357 conn(0x7fe44809d260 msgr2=0x7fe44815d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.683+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 shutdown_connections 2024-04-24T23:58:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.683+0000 7fe44cc00640 1 -- 172.21.15.96:0/804770357 wait complete. 2024-04-24T23:58:39.701 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:39.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.900+0000 7f29e1800640 1 Processor -- start 2024-04-24T23:58:39.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.900+0000 7f29e1800640 1 -- start start 2024-04-24T23:58:39.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.902+0000 7f29e1800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f29dc15f450 0x7f29dc0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.902+0000 7f29e1800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc0b3070 con 0x7f29dc0b4590 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.902+0000 7f29e1800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc0b3310 con 0x7f29dc1551c0 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.902+0000 7f29e1800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc0b3960 con 0x7f29dc15f450 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.902+0000 7f29da000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f29dc15f450 0x7f29dc0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.902+0000 7f29da000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f29dc15f450 0x7f29dc0b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43680/0 (socket says 172.21.15.96:43680) 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.902+0000 7f29db400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f29dc0b4590 0x7f29dc0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36576/0 (socket says 172.21.15.96:36576) 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.902+0000 7f29da000640 1 -- 172.21.15.96:0/2321764942 learned_addr learned my addr 172.21.15.96:0/2321764942 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.903+0000 7f29da000640 1 -- 172.21.15.96:0/2321764942 >> v1:172.21.15.155:6789/0 conn(0x7f29dc1551c0 legacy=0x7f29dc070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.903+0000 7f29da000640 1 -- 172.21.15.96:0/2321764942 >> v1:172.21.15.96:6789/0 conn(0x7f29dc0b4590 legacy=0x7f29dc0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.903+0000 7f29da000640 1 -- 172.21.15.96:0/2321764942 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc0b35f0 con 0x7f29dc15f450 2024-04-24T23:58:39.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.903+0000 7f29d9600640 1 -- 172.21.15.96:0/2321764942 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150121860 0 0) 0x7f29dc0b3070 con 0x7f29dc0b4590 2024-04-24T23:58:39.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.904+0000 7f29da000640 1 --2- 172.21.15.96:0/2321764942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc15f450 0x7f29dc0b3df0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f29dc09e0f0 tx=0x7f29c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66831536b5fbb1d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:39.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.904+0000 7f29d9600640 1 -- 172.21.15.96:0/2321764942 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8037070 con 0x7f29dc15f450 2024-04-24T23:58:39.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.904+0000 7f29d9600640 1 -- 172.21.15.96:0/2321764942 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c8032440 con 0x7f29dc15f450 2024-04-24T23:58:39.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.904+0000 7f29d9600640 1 -- 172.21.15.96:0/2321764942 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8032810 con 0x7f29dc15f450 2024-04-24T23:58:39.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.904+0000 7f29e1800640 1 -- 172.21.15.96:0/2321764942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc15f450 msgr2=0x7f29dc0b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.904+0000 7f29e1800640 1 --2- 172.21.15.96:0/2321764942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc15f450 0x7f29dc0b3df0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f29dc09e0f0 tx=0x7f29c802a1e0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.905+0000 7f29e1800640 1 -- 172.21.15.96:0/2321764942 shutdown_connections 2024-04-24T23:58:39.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.905+0000 7f29e1800640 1 --2- 172.21.15.96:0/2321764942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc15f450 0x7f29dc0b3df0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.905+0000 7f29e1800640 1 -- 172.21.15.96:0/2321764942 >> 172.21.15.96:0/2321764942 conn(0x7f29dc0b19c0 msgr2=0x7f29dc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:39.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.905+0000 7f29e1800640 1 -- 172.21.15.96:0/2321764942 shutdown_connections 2024-04-24T23:58:39.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.905+0000 7f29e1800640 1 -- 172.21.15.96:0/2321764942 wait complete. 2024-04-24T23:58:39.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.906+0000 7f29e1800640 1 Processor -- start 2024-04-24T23:58:39.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.906+0000 7f29e1800640 1 -- start start 2024-04-24T23:58:39.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.907+0000 7f29e1800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29dc0b4590 0x7f29dc1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.907+0000 7f29e1800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc1551c0 0x7f29dc09d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.907+0000 7f29e1800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29dc15f450 0x7f29dc147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.907+0000 7f29e1800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc155720 con 0x7f29dc1551c0 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.907+0000 7f29e1800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1555a0 con 0x7f29dc15f450 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.907+0000 7f29e1800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc071840 con 0x7f29dc0b4590 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29da000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc1551c0 0x7f29dc09d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29da000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc1551c0 0x7f29dc09d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43684/0 (socket says 172.21.15.96:43684) 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29da000640 1 -- 172.21.15.96:0/1036307159 learned_addr learned my addr 172.21.15.96:0/1036307159 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29db400640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29dc15f450 0x7f29dc147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29da000640 1 -- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29dc0b4590 msgr2=0x7f29dc1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29daa00640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29dc0b4590 0x7f29dc1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29da000640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29dc0b4590 0x7f29dc1567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29da000640 1 -- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29dc15f450 msgr2=0x7f29dc147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:39.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29da000640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29dc15f450 0x7f29dc147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:39.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29da000640 1 -- 172.21.15.96:0/1036307159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc1451a0 con 0x7f29dc1551c0 2024-04-24T23:58:39.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29db400640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29dc15f450 0x7f29dc147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:39.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.908+0000 7f29daa00640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29dc0b4590 0x7f29dc1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:39.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.909+0000 7f29da000640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc1551c0 0x7f29dc09d080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29c8000c00 tx=0x7f29c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:39.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.909+0000 7f29d2a00640 1 -- 172.21.15.96:0/1036307159 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8041070 con 0x7f29dc1551c0 2024-04-24T23:58:39.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.909+0000 7f29d2a00640 1 -- 172.21.15.96:0/1036307159 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c803c870 con 0x7f29dc1551c0 2024-04-24T23:58:39.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.909+0000 7f29d2a00640 1 -- 172.21.15.96:0/1036307159 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8037040 con 0x7f29dc1551c0 2024-04-24T23:58:39.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.909+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc145480 con 0x7f29dc1551c0 2024-04-24T23:58:39.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.909+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc145a40 con 0x7f29dc1551c0 2024-04-24T23:58:39.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.910+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc069110 con 0x7f29dc1551c0 2024-04-24T23:58:39.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.911+0000 7f29d2a00640 1 -- 172.21.15.96:0/1036307159 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29c8044070 con 0x7f29dc1551c0 2024-04-24T23:58:39.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.912+0000 7f29d2a00640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29bc06be30 0x7f29bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:39.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.912+0000 7f29d2a00640 1 -- 172.21.15.96:0/1036307159 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f29c80abc60 con 0x7f29dc1551c0 2024-04-24T23:58:39.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.913+0000 7f29daa00640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29bc06be30 0x7f29bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:39.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.913+0000 7f29daa00640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29bc06be30 0x7f29bc06e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29cc004520 tx=0x7f29cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:39.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:39.917+0000 7f29d2a00640 1 -- 172.21.15.96:0/1036307159 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f29c807a720 con 0x7f29dc1551c0 2024-04-24T23:58:40.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.116+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29dc06e8d0 con 0x7f29dc1551c0 2024-04-24T23:58:40.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.119+0000 7f29d2a00640 1 -- 172.21.15.96:0/1036307159 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7f29c807a020 con 0x7f29dc1551c0 2024-04-24T23:58:40.119 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:40.119 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:40.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.121+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29bc06be30 msgr2=0x7f29bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.121+0000 7f29e1800640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29bc06be30 0x7f29bc06e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29cc004520 tx=0x7f29cc009040 comp rx=0 tx=0).stop 2024-04-24T23:58:40.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc1551c0 msgr2=0x7f29dc09d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc1551c0 0x7f29dc09d080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29c8000c00 tx=0x7f29c80046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 shutdown_connections 2024-04-24T23:58:40.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29dc15f450 0x7f29dc147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29bc06be30 0x7f29bc06e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29dc1551c0 0x7f29dc09d080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 --2- 172.21.15.96:0/1036307159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29dc0b4590 0x7f29dc1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 >> 172.21.15.96:0/1036307159 conn(0x7f29dc0b19c0 msgr2=0x7f29dc0b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:40.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 shutdown_connections 2024-04-24T23:58:40.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.122+0000 7f29e1800640 1 -- 172.21.15.96:0/1036307159 wait complete. 2024-04-24T23:58:40.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:40.142 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:40.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.347+0000 7f0207e00640 1 Processor -- start 2024-04-24T23:58:40.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.347+0000 7f0207e00640 1 -- start start 2024-04-24T23:58:40.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.349+0000 7f0207e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02001551c0 0x7f020015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.349+0000 7f0207e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 0x7f02000b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.349+0000 7f0207e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f020015f750 con 0x7f02000b3200 2024-04-24T23:58:40.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.349+0000 7f0207e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f020015f190 con 0x7f02001551c0 2024-04-24T23:58:40.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.349+0000 7f0207e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f020015f470 con 0x7f020006edb0 2024-04-24T23:58:40.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.349+0000 7f0205400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02001551c0 0x7f020015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.350+0000 7f0205400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02001551c0 0x7f020015e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43700/0 (socket says 172.21.15.96:43700) 2024-04-24T23:58:40.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.350+0000 7f0205400640 1 -- 172.21.15.96:0/1403447639 learned_addr learned my addr 172.21.15.96:0/1403447639 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:40.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.350+0000 7f0204a00640 1 --2- 172.21.15.96:0/1403447639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 0x7f02000b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.350+0000 7f0205400640 1 -- 172.21.15.96:0/1403447639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 msgr2=0x7f02000b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:40.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.350+0000 7f0205400640 1 --2- 172.21.15.96:0/1403447639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 0x7f02000b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.350+0000 7f0205400640 1 -- 172.21.15.96:0/1403447639 >> v1:172.21.15.96:6789/0 conn(0x7f02000b3200 legacy=0x7f02000726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.350+0000 7f0205400640 1 -- 172.21.15.96:0/1403447639 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0200071150 con 0x7f02001551c0 2024-04-24T23:58:40.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.350+0000 7f0204a00640 1 --2- 172.21.15.96:0/1403447639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 0x7f02000b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:40.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.351+0000 7f0205400640 1 --2- 172.21.15.96:0/1403447639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 0x7f020015e7f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009870 tx=0x7f01f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf6824a03f17de server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:40.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.351+0000 7f01ffe00640 1 -- 172.21.15.96:0/1403447639 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0037070 con 0x7f02001551c0 2024-04-24T23:58:40.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.351+0000 7f01ffe00640 1 -- 172.21.15.96:0/1403447639 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f0032440 con 0x7f02001551c0 2024-04-24T23:58:40.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.351+0000 7f01ffe00640 1 -- 172.21.15.96:0/1403447639 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0032810 con 0x7f02001551c0 2024-04-24T23:58:40.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.352+0000 7f0207e00640 1 -- 172.21.15.96:0/1403447639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 msgr2=0x7f020015e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.352+0000 7f0207e00640 1 --2- 172.21.15.96:0/1403447639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 0x7f020015e7f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009870 tx=0x7f01f002a1e0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.352+0000 7f0207e00640 1 -- 172.21.15.96:0/1403447639 shutdown_connections 2024-04-24T23:58:40.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.352+0000 7f0207e00640 1 --2- 172.21.15.96:0/1403447639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 0x7f02000b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.352+0000 7f0207e00640 1 --2- 172.21.15.96:0/1403447639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 0x7f020015e7f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.352+0000 7f0207e00640 1 -- 172.21.15.96:0/1403447639 >> 172.21.15.96:0/1403447639 conn(0x7f02000b19c0 msgr2=0x7f02000b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:40.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.352+0000 7f0207e00640 1 -- 172.21.15.96:0/1403447639 shutdown_connections 2024-04-24T23:58:40.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.352+0000 7f0207e00640 1 -- 172.21.15.96:0/1403447639 wait complete. 2024-04-24T23:58:40.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.354+0000 7f0207e00640 1 Processor -- start 2024-04-24T23:58:40.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.354+0000 7f0207e00640 1 -- start start 2024-04-24T23:58:40.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.355+0000 7f0207e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 0x7f0200150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.355+0000 7f0207e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02000b3200 0x7f020009b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.355+0000 7f0207e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 0x7f02000b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.355+0000 7f0207e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f020015ed30 con 0x7f02001551c0 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.355+0000 7f0207e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02001555a0 con 0x7f02000b3200 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.355+0000 7f0207e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f020015eeb0 con 0x7f020006edb0 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.355+0000 7f0205e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 0x7f02000b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.355+0000 7f0205e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 0x7f02000b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43714/0 (socket says 172.21.15.96:43714) 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.355+0000 7f0205e00640 1 -- 172.21.15.96:0/2017009071 learned_addr learned my addr 172.21.15.96:0/2017009071 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0205400640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 0x7f0200150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0204a00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02000b3200 0x7f020009b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0205e00640 1 -- 172.21.15.96:0/2017009071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 msgr2=0x7f0200150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0205e00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 0x7f0200150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0205e00640 1 -- 172.21.15.96:0/2017009071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02000b3200 msgr2=0x7f020009b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0205e00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02000b3200 0x7f020009b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0205e00640 1 -- 172.21.15.96:0/2017009071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0200150da0 con 0x7f02001551c0 2024-04-24T23:58:40.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0204a00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02000b3200 0x7f020009b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:40.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0205e00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 0x7f02000b1da0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c3c0 tx=0x7f01f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:40.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f01fd600640 1 -- 172.21.15.96:0/2017009071 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8017070 con 0x7f02001551c0 2024-04-24T23:58:40.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f01fd600640 1 -- 172.21.15.96:0/2017009071 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f80052d0 con 0x7f02001551c0 2024-04-24T23:58:40.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020009b670 con 0x7f02001551c0 2024-04-24T23:58:40.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.356+0000 7f01fd600640 1 -- 172.21.15.96:0/2017009071 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8003830 con 0x7f02001551c0 2024-04-24T23:58:40.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.357+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020009bbf0 con 0x7f02001551c0 2024-04-24T23:58:40.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.358+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0200069110 con 0x7f02001551c0 2024-04-24T23:58:40.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.359+0000 7f01fd600640 1 -- 172.21.15.96:0/2017009071 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01f801a070 con 0x7f02001551c0 2024-04-24T23:58:40.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.360+0000 7f01fd600640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f01e006be30 0x7f01e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.360+0000 7f01fd600640 1 -- 172.21.15.96:0/2017009071 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f01f808a0a0 con 0x7f02001551c0 2024-04-24T23:58:40.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.360+0000 7f0205400640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f01e006be30 0x7f01e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.361+0000 7f0205400640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f01e006be30 0x7f01e006e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01f0034000 tx=0x7f01f002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:40.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.364+0000 7f01fd600640 1 -- 172.21.15.96:0/2017009071 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0200150da0 con 0x7f02001551c0 2024-04-24T23:58:40.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.569+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f02000b4e00 con 0x7f02001551c0 2024-04-24T23:58:40.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.570+0000 7f01fd600640 1 -- 172.21.15.96:0/2017009071 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f01f8058ae0 con 0x7f02001551c0 2024-04-24T23:58:40.571 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.573+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f01e006be30 msgr2=0x7f01e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.573+0000 7f0207e00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f01e006be30 0x7f01e006e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01f0034000 tx=0x7f01f002e000 comp rx=0 tx=0).stop 2024-04-24T23:58:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.573+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 msgr2=0x7f02000b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.573+0000 7f0207e00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 0x7f02000b1da0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c3c0 tx=0x7f01f800c880 comp rx=0 tx=0).stop 2024-04-24T23:58:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.573+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 shutdown_connections 2024-04-24T23:58:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.574+0000 7f0207e00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f01e006be30 0x7f01e006e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.574+0000 7f0207e00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02001551c0 0x7f02000b1da0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.574+0000 7f0207e00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02000b3200 0x7f020009b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.574+0000 7f0207e00640 1 --2- 172.21.15.96:0/2017009071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020006edb0 0x7f0200150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.574+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 >> 172.21.15.96:0/2017009071 conn(0x7f02000b19c0 msgr2=0x7f0200072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.574+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 shutdown_connections 2024-04-24T23:58:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.574+0000 7f0207e00640 1 -- 172.21.15.96:0/2017009071 wait complete. 2024-04-24T23:58:40.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:40.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.795+0000 7f9b7a000640 1 Processor -- start 2024-04-24T23:58:40.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.795+0000 7f9b7a000640 1 -- start start 2024-04-24T23:58:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.797+0000 7f9b7a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415e130 0x7f9b740ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.797+0000 7f9b7a000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b740b42d0 0x7f9b7406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.797+0000 7f9b7a000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b74072830 con 0x7f9b740afbb0 2024-04-24T23:58:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.797+0000 7f9b7a000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7406def0 con 0x7f9b740b42d0 2024-04-24T23:58:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.797+0000 7f9b7a000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7406e4b0 con 0x7f9b7415e130 2024-04-24T23:58:40.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.797+0000 7f9b73e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9b740afbb0 0x7f9b740b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36588/0 (socket says 172.21.15.96:36588) 2024-04-24T23:58:40.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.797+0000 7f9b73e00640 1 -- 172.21.15.96:0/157090594 learned_addr learned my addr 172.21.15.96:0/157090594 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:40.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b78c00640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415e130 0x7f9b740ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b79600640 1 --2- 172.21.15.96:0/157090594 >> v2:172.21.15.155:3300/0 conn(0x7f9b740b42d0 0x7f9b7406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591047175 0 0) 0x7f9b74072830 con 0x7f9b740afbb0 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b58003520 con 0x7f9b740afbb0 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3560681575 0 0) 0x7f9b58003520 con 0x7f9b740afbb0 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415e130 msgr2=0x7f9b740ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415e130 0x7f9b740ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 >> v2:172.21.15.155:3300/0 conn(0x7f9b740b42d0 msgr2=0x7f9b7406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 --2- 172.21.15.96:0/157090594 >> v2:172.21.15.155:3300/0 conn(0x7f9b740b42d0 0x7f9b7406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b74072ad0 con 0x7f9b740afbb0 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f9b5c001690 con 0x7f9b740afbb0 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 >> v1:172.21.15.96:6789/0 conn(0x7f9b740afbb0 legacy=0x7f9b740b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415e130 0x7f9b580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b58003f30 0x7f9b58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7406def0 con 0x7f9b58004d40 2024-04-24T23:58:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7406e4b0 con 0x7f9b58003f30 2024-04-24T23:58:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.798+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b5800b9c0 con 0x7f9b7415e130 2024-04-24T23:58:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.799+0000 7f9b79600640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.799+0000 7f9b79600640 1 -- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415e130 msgr2=0x7f9b580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.799+0000 7f9b78c00640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415e130 0x7f9b580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.799+0000 7f9b79600640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415e130 0x7f9b580039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.799+0000 7f9b79600640 1 -- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b58003f30 msgr2=0x7f9b58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.799+0000 7f9b79600640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b58003f30 0x7f9b58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.799+0000 7f9b79600640 1 -- 172.21.15.96:0/157090594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b58003520 con 0x7f9b58004d40 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.800+0000 7f9b79600640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b580051c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009ac0 tx=0x7f9b58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998c66eebb447722 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.800+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c036070 con 0x7f9b58004d40 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.800+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b6c031400 con 0x7f9b58004d40 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.800+0000 7f9b73400640 1 -- 172.21.15.96:0/157090594 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c009690 con 0x7f9b58004d40 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.801+0000 7f9b7a000640 1 -- 172.21.15.96:0/157090594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 msgr2=0x7f9b580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.801+0000 7f9b7a000640 1 --2- 172.21.15.96:0/157090594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b580051c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009ac0 tx=0x7f9b58005830 comp rx=0 tx=0).stop 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.801+0000 7f9b79600640 1 -- 172.21.15.96:0/157090594 reap_dead start 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.801+0000 7f9b7a000640 1 -- 172.21.15.96:0/157090594 shutdown_connections 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.801+0000 7f9b7a000640 1 -- 172.21.15.96:0/157090594 >> 172.21.15.96:0/157090594 conn(0x7f9b740b28c0 msgr2=0x7f9b740b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:40.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.801+0000 7f9b7a000640 1 -- 172.21.15.96:0/157090594 shutdown_connections 2024-04-24T23:58:40.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.801+0000 7f9b7a000640 1 -- 172.21.15.96:0/157090594 wait complete. 2024-04-24T23:58:40.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.803+0000 7f9b7a000640 1 Processor -- start 2024-04-24T23:58:40.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.803+0000 7f9b7a000640 1 -- start start 2024-04-24T23:58:40.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.804+0000 7f9b7a000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b7406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.804+0000 7f9b7a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7415f0a0 0x7f9b74154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.804+0000 7f9b7a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415f520 0x7f9b74154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.804+0000 7f9b7a000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7415e510 con 0x7f9b58004d40 2024-04-24T23:58:40.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.804+0000 7f9b7a000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9b740b6040 con 0x7f9b7415f0a0 2024-04-24T23:58:40.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.804+0000 7f9b7a000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b740b02b0 con 0x7f9b7415f520 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.804+0000 7f9b78c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b7406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.804+0000 7f9b78c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b7406eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43726/0 (socket says 172.21.15.96:43726) 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.804+0000 7f9b78c00640 1 -- 172.21.15.96:0/2967754781 learned_addr learned my addr 172.21.15.96:0/2967754781 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b78c00640 1 -- 172.21.15.96:0/2967754781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415f520 msgr2=0x7f9b74154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b78c00640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415f520 0x7f9b74154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b78c00640 1 -- 172.21.15.96:0/2967754781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7415f0a0 msgr2=0x7f9b74154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b78c00640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7415f0a0 0x7f9b74154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b78c00640 1 -- 172.21.15.96:0/2967754781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b74160690 con 0x7f9b58004d40 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b78c00640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b7406eab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400f350 tx=0x7f9b6400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b70c00640 1 -- 172.21.15.96:0/2967754781 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6401c070 con 0x7f9b58004d40 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b70c00640 1 -- 172.21.15.96:0/2967754781 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b64017620 con 0x7f9b58004d40 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b70c00640 1 -- 172.21.15.96:0/2967754781 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b64017a10 con 0x7f9b58004d40 2024-04-24T23:58:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7415fa80 con 0x7f9b58004d40 2024-04-24T23:58:40.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.805+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b74160040 con 0x7f9b58004d40 2024-04-24T23:58:40.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.806+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b74072ee0 con 0x7f9b58004d40 2024-04-24T23:58:40.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.808+0000 7f9b70c00640 1 -- 172.21.15.96:0/2967754781 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b64005d10 con 0x7f9b58004d40 2024-04-24T23:58:40.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.808+0000 7f9b70c00640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9b5006be30 0x7f9b5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:40.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.809+0000 7f9b70c00640 1 -- 172.21.15.96:0/2967754781 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9b6408b4f0 con 0x7f9b58004d40 2024-04-24T23:58:40.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.809+0000 7f9b73e00640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9b5006be30 0x7f9b5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:40.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.809+0000 7f9b73e00640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9b5006be30 0x7f9b5006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c000f60 tx=0x7f9b5c0015c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:40.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:40.813+0000 7f9b70c00640 1 -- 172.21.15.96:0/2967754781 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9b74072ee0 con 0x7f9b58004d40 2024-04-24T23:58:41.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.011+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9b740755d0 con 0x7f9b58004d40 2024-04-24T23:58:41.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.012+0000 7f9b70c00640 1 -- 172.21.15.96:0/2967754781 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f9b74160690 con 0x7f9b58004d40 2024-04-24T23:58:41.013 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9b5006be30 msgr2=0x7f9b5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9b5006be30 0x7f9b5006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c000f60 tx=0x7f9b5c0015c0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 msgr2=0x7f9b7406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b7406eab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400f350 tx=0x7f9b6400f810 comp rx=0 tx=0).stop 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 shutdown_connections 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7415f520 0x7f9b74154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7415f0a0 0x7f9b74154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9b5006be30 0x7f9b5006e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 --2- 172.21.15.96:0/2967754781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b58004d40 0x7f9b7406eab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 >> 172.21.15.96:0/2967754781 conn(0x7f9b740b28c0 msgr2=0x7f9b740ad950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:41.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 shutdown_connections 2024-04-24T23:58:41.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.015+0000 7f9b7a000640 1 -- 172.21.15.96:0/2967754781 wait complete. 2024-04-24T23:58:41.035 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:41.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.237+0000 7f0d29e00640 1 Processor -- start 2024-04-24T23:58:41.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.237+0000 7f0d29e00640 1 -- start start 2024-04-24T23:58:41.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.239+0000 7f0d29e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d2406ec40 0x7f0d2409db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.239+0000 7f0d29e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d240ad820 con 0x7f0d240b2cc0 2024-04-24T23:58:41.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.239+0000 7f0d29e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d240b3260 con 0x7f0d2415b090 2024-04-24T23:58:41.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.239+0000 7f0d29e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0d240b3540 con 0x7f0d2406ec40 2024-04-24T23:58:41.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.239+0000 7f0d22000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d2406ec40 0x7f0d2409db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:41.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.239+0000 7f0d23400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0d240b2cc0 0x7f0d240add00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36604/0 (socket says 172.21.15.96:36604) 2024-04-24T23:58:41.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.239+0000 7f0d23400640 1 -- 172.21.15.96:0/2399941622 learned_addr learned my addr 172.21.15.96:0/2399941622 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:41.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.240+0000 7f0d22000640 1 -- 172.21.15.96:0/2399941622 >> v1:172.21.15.155:6789/0 conn(0x7f0d2415b090 legacy=0x7f0d2406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:41.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.240+0000 7f0d22000640 1 -- 172.21.15.96:0/2399941622 >> v1:172.21.15.96:6789/0 conn(0x7f0d240b2cc0 legacy=0x7f0d240add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.240+0000 7f0d22000640 1 -- 172.21.15.96:0/2399941622 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d240b3820 con 0x7f0d2406ec40 2024-04-24T23:58:41.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.240+0000 7f0d21600640 1 -- 172.21.15.96:0/2399941622 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375124174 0 0) 0x7f0d240ad820 con 0x7f0d240b2cc0 2024-04-24T23:58:41.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.241+0000 7f0d22000640 1 --2- 172.21.15.96:0/2399941622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d2406ec40 0x7f0d2409db30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0097a0 tx=0x7f0d0c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c16da7f9085d3c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:41.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.242+0000 7f0d21600640 1 -- 172.21.15.96:0/2399941622 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c037070 con 0x7f0d2406ec40 2024-04-24T23:58:41.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.242+0000 7f0d21600640 1 -- 172.21.15.96:0/2399941622 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c032440 con 0x7f0d2406ec40 2024-04-24T23:58:41.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.242+0000 7f0d21600640 1 -- 172.21.15.96:0/2399941622 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c032810 con 0x7f0d2406ec40 2024-04-24T23:58:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.242+0000 7f0d29e00640 1 -- 172.21.15.96:0/2399941622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d2406ec40 msgr2=0x7f0d2409db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.242+0000 7f0d29e00640 1 --2- 172.21.15.96:0/2399941622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d2406ec40 0x7f0d2409db30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0097a0 tx=0x7f0d0c02a230 comp rx=0 tx=0).stop 2024-04-24T23:58:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.242+0000 7f0d29e00640 1 -- 172.21.15.96:0/2399941622 shutdown_connections 2024-04-24T23:58:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.243+0000 7f0d29e00640 1 --2- 172.21.15.96:0/2399941622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d2406ec40 0x7f0d2409db30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.243+0000 7f0d29e00640 1 -- 172.21.15.96:0/2399941622 >> 172.21.15.96:0/2399941622 conn(0x7f0d240b19c0 msgr2=0x7f0d240b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.243+0000 7f0d29e00640 1 -- 172.21.15.96:0/2399941622 shutdown_connections 2024-04-24T23:58:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.243+0000 7f0d29e00640 1 -- 172.21.15.96:0/2399941622 wait complete. 2024-04-24T23:58:41.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.244+0000 7f0d29e00640 1 Processor -- start 2024-04-24T23:58:41.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.244+0000 7f0d29e00640 1 -- start start 2024-04-24T23:58:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.245+0000 7f0d29e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2406ec40 0x7f0d24151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.245+0000 7f0d29e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240b2cc0 0x7f0d24158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.245+0000 7f0d29e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2415b090 0x7f0d241557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.245+0000 7f0d29e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2415b470 con 0x7f0d240b2cc0 2024-04-24T23:58:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.245+0000 7f0d29e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d240b4f70 con 0x7f0d2415b090 2024-04-24T23:58:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.245+0000 7f0d29e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d24070e10 con 0x7f0d2406ec40 2024-04-24T23:58:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.246+0000 7f0d22000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240b2cc0 0x7f0d24158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.246+0000 7f0d22000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240b2cc0 0x7f0d24158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43744/0 (socket says 172.21.15.96:43744) 2024-04-24T23:58:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.246+0000 7f0d22000640 1 -- 172.21.15.96:0/2735388817 learned_addr learned my addr 172.21.15.96:0/2735388817 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.246+0000 7f0d22000640 1 -- 172.21.15.96:0/2735388817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2406ec40 msgr2=0x7f0d24151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.246+0000 7f0d22000640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2406ec40 0x7f0d24151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.246+0000 7f0d22000640 1 -- 172.21.15.96:0/2735388817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2415b090 msgr2=0x7f0d241557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.246+0000 7f0d22000640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2415b090 0x7f0d241557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.246+0000 7f0d22000640 1 -- 172.21.15.96:0/2735388817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2415bfd0 con 0x7f0d240b2cc0 2024-04-24T23:58:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.247+0000 7f0d22000640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240b2cc0 0x7f0d24158790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0098c0 tx=0x7f0d0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.247+0000 7f0d1b400640 1 -- 172.21.15.96:0/2735388817 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c037040 con 0x7f0d240b2cc0 2024-04-24T23:58:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.247+0000 7f0d1b400640 1 -- 172.21.15.96:0/2735388817 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c042070 con 0x7f0d240b2cc0 2024-04-24T23:58:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.247+0000 7f0d1b400640 1 -- 172.21.15.96:0/2735388817 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c030a70 con 0x7f0d240b2cc0 2024-04-24T23:58:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.247+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2415d2f0 con 0x7f0d240b2cc0 2024-04-24T23:58:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.247+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2415c530 con 0x7f0d240b2cc0 2024-04-24T23:58:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.249+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d24069110 con 0x7f0d240b2cc0 2024-04-24T23:58:41.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.250+0000 7f0d1b400640 1 -- 172.21.15.96:0/2735388817 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d0c030c10 con 0x7f0d240b2cc0 2024-04-24T23:58:41.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.250+0000 7f0d1b400640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0d0006beb0 0x7f0d0006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.251+0000 7f0d1b400640 1 -- 172.21.15.96:0/2735388817 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0d0c0ab780 con 0x7f0d240b2cc0 2024-04-24T23:58:41.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.251+0000 7f0d22a00640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0d0006beb0 0x7f0d0006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:41.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.252+0000 7f0d22a00640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0d0006beb0 0x7f0d0006e370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0d140012e0 tx=0x7f0d14007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:41.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.256+0000 7f0d1b400640 1 -- 172.21.15.96:0/2735388817 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0d2415bfd0 con 0x7f0d240b2cc0 2024-04-24T23:58:41.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.454+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0d2406cdd0 con 0x7f0d240b2cc0 2024-04-24T23:58:41.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.455+0000 7f0d1b400640 1 -- 172.21.15.96:0/2735388817 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f0d0c045360 con 0x7f0d240b2cc0 2024-04-24T23:58:41.455 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:41.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0d0006beb0 msgr2=0x7f0d0006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0d0006beb0 0x7f0d0006e370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0d140012e0 tx=0x7f0d14007d30 comp rx=0 tx=0).stop 2024-04-24T23:58:41.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240b2cc0 msgr2=0x7f0d24158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240b2cc0 0x7f0d24158790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0098c0 tx=0x7f0d0c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 shutdown_connections 2024-04-24T23:58:41.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2415b090 0x7f0d241557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f0d0006beb0 0x7f0d0006e370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240b2cc0 0x7f0d24158790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 --2- 172.21.15.96:0/2735388817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2406ec40 0x7f0d24151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 >> 172.21.15.96:0/2735388817 conn(0x7f0d240b19c0 msgr2=0x7f0d240723b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:41.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 shutdown_connections 2024-04-24T23:58:41.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.458+0000 7f0d29e00640 1 -- 172.21.15.96:0/2735388817 wait complete. 2024-04-24T23:58:41.478 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:41.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.676+0000 7f36d3a00640 1 Processor -- start 2024-04-24T23:58:41.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.676+0000 7f36d3a00640 1 -- start start 2024-04-24T23:58:41.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.678+0000 7f36d3a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36cc070df0 0x7f36cc15f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.678+0000 7f36d3a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36cc0713d0 con 0x7f36cc0b2cc0 2024-04-24T23:58:41.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.678+0000 7f36d3a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36cc0ae4d0 con 0x7f36cc15b220 2024-04-24T23:58:41.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.678+0000 7f36d3a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f36cc0aee00 con 0x7f36cc070df0 2024-04-24T23:58:41.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.678+0000 7f36cbe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36cc070df0 0x7f36cc15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:41.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.678+0000 7f36cbe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36cc070df0 0x7f36cc15f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43748/0 (socket says 172.21.15.96:43748) 2024-04-24T23:58:41.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.678+0000 7f36cbe00640 1 -- 172.21.15.96:0/505461806 learned_addr learned my addr 172.21.15.96:0/505461806 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:41.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.679+0000 7f36cbe00640 1 -- 172.21.15.96:0/505461806 >> v1:172.21.15.155:6789/0 conn(0x7f36cc15b220 legacy=0x7f36cc15ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:41.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.679+0000 7f36cbe00640 1 -- 172.21.15.96:0/505461806 >> v1:172.21.15.96:6789/0 conn(0x7f36cc0b2cc0 legacy=0x7f36cc0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.679+0000 7f36cbe00640 1 -- 172.21.15.96:0/505461806 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36cc0ae7b0 con 0x7f36cc070df0 2024-04-24T23:58:41.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.679+0000 7f36cb400640 1 -- 172.21.15.96:0/505461806 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788874211 0 0) 0x7f36cc0713d0 con 0x7f36cc0b2cc0 2024-04-24T23:58:41.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.680+0000 7f36cbe00640 1 --2- 172.21.15.96:0/505461806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 0x7f36cc15f380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009870 tx=0x7f36b802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407206767a4588cf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:41.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.680+0000 7f36cb400640 1 -- 172.21.15.96:0/505461806 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8037070 con 0x7f36cc070df0 2024-04-24T23:58:41.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.680+0000 7f36cb400640 1 -- 172.21.15.96:0/505461806 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b8032440 con 0x7f36cc070df0 2024-04-24T23:58:41.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.680+0000 7f36cb400640 1 -- 172.21.15.96:0/505461806 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8032810 con 0x7f36cc070df0 2024-04-24T23:58:41.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.681+0000 7f36d3a00640 1 -- 172.21.15.96:0/505461806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 msgr2=0x7f36cc15f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.681+0000 7f36d3a00640 1 --2- 172.21.15.96:0/505461806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 0x7f36cc15f380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009870 tx=0x7f36b802a2a0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.681+0000 7f36d3a00640 1 -- 172.21.15.96:0/505461806 shutdown_connections 2024-04-24T23:58:41.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.681+0000 7f36d3a00640 1 --2- 172.21.15.96:0/505461806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 0x7f36cc15f380 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.681+0000 7f36d3a00640 1 -- 172.21.15.96:0/505461806 >> 172.21.15.96:0/505461806 conn(0x7f36cc0b19c0 msgr2=0x7f36cc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:41.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.681+0000 7f36d3a00640 1 -- 172.21.15.96:0/505461806 shutdown_connections 2024-04-24T23:58:41.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.681+0000 7f36d3a00640 1 -- 172.21.15.96:0/505461806 wait complete. 2024-04-24T23:58:41.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.683+0000 7f36d3a00640 1 Processor -- start 2024-04-24T23:58:41.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.683+0000 7f36d3a00640 1 -- start start 2024-04-24T23:58:41.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.684+0000 7f36d3a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 0x7f36cc1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.684+0000 7f36d3a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0b2cc0 0x7f36cc1f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.684+0000 7f36d3a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc15b220 0x7f36cc09b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.684+0000 7f36d3a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc06ed10 con 0x7f36cc070df0 2024-04-24T23:58:41.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.684+0000 7f36d3a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc06eb90 con 0x7f36cc0b2cc0 2024-04-24T23:58:41.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.684+0000 7f36d3a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36cc15f8c0 con 0x7f36cc15b220 2024-04-24T23:58:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.684+0000 7f36d1000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 0x7f36cc1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.684+0000 7f36d1000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 0x7f36cc1558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43764/0 (socket says 172.21.15.96:43764) 2024-04-24T23:58:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.684+0000 7f36d1000640 1 -- 172.21.15.96:0/3150827920 learned_addr learned my addr 172.21.15.96:0/3150827920 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36d1000640 1 -- 172.21.15.96:0/3150827920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc15b220 msgr2=0x7f36cc09b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36d1a00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc15b220 0x7f36cc09b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36cbe00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0b2cc0 0x7f36cc1f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36d1000640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc15b220 0x7f36cc09b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36d1000640 1 -- 172.21.15.96:0/3150827920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0b2cc0 msgr2=0x7f36cc1f7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36d1000640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0b2cc0 0x7f36cc1f7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36d1000640 1 -- 172.21.15.96:0/3150827920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36cc1f85b0 con 0x7f36cc070df0 2024-04-24T23:58:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36d1000640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 0x7f36cc1558d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f36c000b3f0 tx=0x7f36c000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36c8c00640 1 -- 172.21.15.96:0/3150827920 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c0015020 con 0x7f36cc070df0 2024-04-24T23:58:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36c8c00640 1 -- 172.21.15.96:0/3150827920 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c0011830 con 0x7f36cc070df0 2024-04-24T23:58:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36cc1f8890 con 0x7f36cc070df0 2024-04-24T23:58:41.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36c8c00640 1 -- 172.21.15.96:0/3150827920 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c0011c20 con 0x7f36cc070df0 2024-04-24T23:58:41.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.685+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36cc09ae80 con 0x7f36cc070df0 2024-04-24T23:58:41.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.686+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36cc153960 con 0x7f36cc070df0 2024-04-24T23:58:41.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.687+0000 7f36c8c00640 1 -- 172.21.15.96:0/3150827920 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36c0018020 con 0x7f36cc070df0 2024-04-24T23:58:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.688+0000 7f36c8c00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f36ac06be60 0x7f36ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.689+0000 7f36c8c00640 1 -- 172.21.15.96:0/3150827920 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f36c008ab10 con 0x7f36cc070df0 2024-04-24T23:58:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.689+0000 7f36cbe00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f36ac06be60 0x7f36ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.689+0000 7f36cbe00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f36ac06be60 0x7f36ac06e320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f36b8034000 tx=0x7f36b802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:41.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.693+0000 7f36c8c00640 1 -- 172.21.15.96:0/3150827920 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f36cc153960 con 0x7f36cc070df0 2024-04-24T23:58:41.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.893+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36cc069110 con 0x7f36cc070df0 2024-04-24T23:58:41.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.895+0000 7f36c8c00640 1 -- 172.21.15.96:0/3150827920 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7f36c001f030 con 0x7f36cc070df0 2024-04-24T23:58:41.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:41.895 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:41.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f36ac06be60 msgr2=0x7f36ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f36ac06be60 0x7f36ac06e320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f36b8034000 tx=0x7f36b802e000 comp rx=0 tx=0).stop 2024-04-24T23:58:41.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 msgr2=0x7f36cc1558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:41.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 0x7f36cc1558d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f36c000b3f0 tx=0x7f36c000b8b0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 shutdown_connections 2024-04-24T23:58:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc15b220 0x7f36cc09b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0b2cc0 0x7f36cc1f7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f36ac06be60 0x7f36ac06e320 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 --2- 172.21.15.96:0/3150827920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36cc070df0 0x7f36cc1558d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.897+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 >> 172.21.15.96:0/3150827920 conn(0x7f36cc0b19c0 msgr2=0x7f36cc0713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.898+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 shutdown_connections 2024-04-24T23:58:41.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:41.898+0000 7f36d3a00640 1 -- 172.21.15.96:0/3150827920 wait complete. 2024-04-24T23:58:41.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:41.917 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:42.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.113+0000 7f8786600640 1 Processor -- start 2024-04-24T23:58:42.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.113+0000 7f8786600640 1 -- start start 2024-04-24T23:58:42.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.115+0000 7f8786600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f878006d800 0x7f878006dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.115+0000 7f8786600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87800b3150 con 0x7f878006d420 2024-04-24T23:58:42.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.115+0000 7f8786600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87800b3430 con 0x7f87800b2cc0 2024-04-24T23:58:42.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.115+0000 7f8786600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f87800b3710 con 0x7f878006d800 2024-04-24T23:58:42.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.115+0000 7f877f400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f878006d420 0x7f87800aceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36614/0 (socket says 172.21.15.96:36614) 2024-04-24T23:58:42.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.115+0000 7f877f400640 1 -- 172.21.15.96:0/1079983032 learned_addr learned my addr 172.21.15.96:0/1079983032 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:42.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589757812 0 0) 0x7f87800b3150 con 0x7f878006d420 2024-04-24T23:58:42.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8764003440 con 0x7f878006d420 2024-04-24T23:58:42.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877fe00640 1 --2- 172.21.15.96:0/1079983032 >> v2:172.21.15.155:3300/0 conn(0x7f878006d800 0x7f878006dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2953122688 0 0) 0x7f8764003440 con 0x7f878006d420 2024-04-24T23:58:42.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 >> v2:172.21.15.155:3300/0 conn(0x7f878006d800 msgr2=0x7f878006dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:42.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 --2- 172.21.15.96:0/1079983032 >> v2:172.21.15.155:3300/0 conn(0x7f878006d800 0x7f878006dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 >> v1:172.21.15.155:6789/0 conn(0x7f87800b2cc0 legacy=0x7f8780071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87800b39f0 con 0x7f878006d420 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f8770001670 con 0x7f878006d420 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 >> v1:172.21.15.96:6789/0 conn(0x7f878006d420 legacy=0x7f87800aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8764003aa0 0x7f8764003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8764008900 0x7f876400ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.116+0000 7f877ea00640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f876400b570 0x7f876400da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f87800b3710 con 0x7f8764003aa0 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f876400e310 con 0x7f876400b570 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f876400e510 con 0x7f8764008900 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877f400640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8764003aa0 0x7f8764003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877fe00640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f876400b570 0x7f876400da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f8776a00640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8764008900 0x7f876400ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877f400640 1 -- 172.21.15.96:0/1079983032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8764008900 msgr2=0x7f876400ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:42.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877f400640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8764008900 0x7f876400ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877f400640 1 -- 172.21.15.96:0/1079983032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f876400b570 msgr2=0x7f876400da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:42.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877f400640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f876400b570 0x7f876400da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877f400640 1 -- 172.21.15.96:0/1079983032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8764003440 con 0x7f8764003aa0 2024-04-24T23:58:42.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f877fe00640 1 -- 172.21.15.96:0/1079983032 reap_dead start 2024-04-24T23:58:42.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.117+0000 7f8776a00640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8764008900 0x7f876400ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:42.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.118+0000 7f877f400640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8764003aa0 0x7f8764003ec0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f877000c240 tx=0x7f8764003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a74a227f4b6a42 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770007cf0 con 0x7f8764003aa0 2024-04-24T23:58:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87700058d0 con 0x7f8764003aa0 2024-04-24T23:58:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f877ea00640 1 -- 172.21.15.96:0/1079983032 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770005d20 con 0x7f8764003aa0 2024-04-24T23:58:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f8786600640 1 -- 172.21.15.96:0/1079983032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8764003aa0 msgr2=0x7f8764003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f8786600640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8764003aa0 0x7f8764003ec0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f877000c240 tx=0x7f8764003730 comp rx=0 tx=0).stop 2024-04-24T23:58:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f8786600640 1 -- 172.21.15.96:0/1079983032 shutdown_connections 2024-04-24T23:58:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f8786600640 1 --2- 172.21.15.96:0/1079983032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8764003aa0 0x7f8764003ec0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f8786600640 1 -- 172.21.15.96:0/1079983032 >> 172.21.15.96:0/1079983032 conn(0x7f87800b19c0 msgr2=0x7f87800b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:42.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f8786600640 1 -- 172.21.15.96:0/1079983032 shutdown_connections 2024-04-24T23:58:42.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.119+0000 7f8786600640 1 -- 172.21.15.96:0/1079983032 wait complete. 2024-04-24T23:58:42.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.121+0000 7f8786600640 1 Processor -- start 2024-04-24T23:58:42.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.121+0000 7f8786600640 1 -- start start 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.122+0000 7f8786600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8764003aa0 0x7f878015d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.122+0000 7f8786600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878015d610 0x7f87800cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.122+0000 7f8786600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87800cce70 0x7f878015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.122+0000 7f8786600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f87800aceb0 con 0x7f87800cce70 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.122+0000 7f8786600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f878015aa20 con 0x7f8764003aa0 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.122+0000 7f8786600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f87800ad030 con 0x7f878015d610 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.122+0000 7f877fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87800cce70 0x7f878015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f877fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87800cce70 0x7f878015aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43788/0 (socket says 172.21.15.96:43788) 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f877fe00640 1 -- 172.21.15.96:0/900117321 learned_addr learned my addr 172.21.15.96:0/900117321 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f8776a00640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878015d610 0x7f87800cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f877f400640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8764003aa0 0x7f878015d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f877fe00640 1 -- 172.21.15.96:0/900117321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878015d610 msgr2=0x7f87800cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f877fe00640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878015d610 0x7f87800cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f877fe00640 1 -- 172.21.15.96:0/900117321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8764003aa0 msgr2=0x7f878015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f877fe00640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8764003aa0 0x7f878015d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f877fe00640 1 -- 172.21.15.96:0/900117321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87800ce0e0 con 0x7f87800cce70 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f8776a00640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878015d610 0x7f87800cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.123+0000 7f877fe00640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87800cce70 0x7f878015aba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8780072450 tx=0x7f8778009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.124+0000 7f8777e00640 1 -- 172.21.15.96:0/900117321 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778019070 con 0x7f87800cce70 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.124+0000 7f8777e00640 1 -- 172.21.15.96:0/900117321 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8778007d80 con 0x7f87800cce70 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.124+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87800ce3c0 con 0x7f87800cce70 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.124+0000 7f8777e00640 1 -- 172.21.15.96:0/900117321 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778014640 con 0x7f87800cce70 2024-04-24T23:58:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.124+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87800cd2f0 con 0x7f87800cce70 2024-04-24T23:58:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.125+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8780069110 con 0x7f87800cce70 2024-04-24T23:58:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.126+0000 7f8777e00640 1 -- 172.21.15.96:0/900117321 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f877801c070 con 0x7f87800cce70 2024-04-24T23:58:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.127+0000 7f8777e00640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f875c06be30 0x7f875c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.127+0000 7f8777e00640 1 -- 172.21.15.96:0/900117321 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f877808ab10 con 0x7f87800cce70 2024-04-24T23:58:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.127+0000 7f877f400640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f875c06be30 0x7f875c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.128+0000 7f877f400640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f875c06be30 0x7f875c06e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8770033000 tx=0x7f8770009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:42.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.132+0000 7f8777e00640 1 -- 172.21.15.96:0/900117321 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8778059420 con 0x7f87800cce70 2024-04-24T23:58:42.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.326+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f878015d9f0 con 0x7f87800cce70 2024-04-24T23:58:42.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.327+0000 7f8777e00640 1 -- 172.21.15.96:0/900117321 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f8778058d20 con 0x7f87800cce70 2024-04-24T23:58:42.328 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:42.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.329+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f875c06be30 msgr2=0x7f875c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.329+0000 7f8786600640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f875c06be30 0x7f875c06e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8770033000 tx=0x7f8770009030 comp rx=0 tx=0).stop 2024-04-24T23:58:42.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.329+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87800cce70 msgr2=0x7f878015aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.329+0000 7f8786600640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87800cce70 0x7f878015aba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8780072450 tx=0x7f8778009da0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.330+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 shutdown_connections 2024-04-24T23:58:42.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.330+0000 7f8786600640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f875c06be30 0x7f875c06e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.330+0000 7f8786600640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87800cce70 0x7f878015aba0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.330+0000 7f8786600640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878015d610 0x7f87800cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.330+0000 7f8786600640 1 --2- 172.21.15.96:0/900117321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8764003aa0 0x7f878015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.330+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 >> 172.21.15.96:0/900117321 conn(0x7f87800b19c0 msgr2=0x7f878014f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:42.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.330+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 shutdown_connections 2024-04-24T23:58:42.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.330+0000 7f8786600640 1 -- 172.21.15.96:0/900117321 wait complete. 2024-04-24T23:58:42.348 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.542+0000 7f2c71400640 1 Processor -- start 2024-04-24T23:58:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.542+0000 7f2c71400640 1 -- start start 2024-04-24T23:58:42.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.544+0000 7f2c71400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c1446c0 0x7f2c6c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.544+0000 7f2c71400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c6c15f160 0x7f2c6c070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.544+0000 7f2c71400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c0b36f0 con 0x7f2c6c0b4790 2024-04-24T23:58:42.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.544+0000 7f2c71400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2c6c0b4300 con 0x7f2c6c15f160 2024-04-24T23:58:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.544+0000 7f2c71400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c0b39d0 con 0x7f2c6c1446c0 2024-04-24T23:58:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.544+0000 7f2c70a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c6c15f160 0x7f2c6c070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.544+0000 7f2c70a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c6c15f160 0x7f2c6c070ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43796/0 (socket says 172.21.15.96:43796) 2024-04-24T23:58:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.544+0000 7f2c70a00640 1 -- 172.21.15.96:0/1686818163 learned_addr learned my addr 172.21.15.96:0/1686818163 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.545+0000 7f2c70a00640 1 -- 172.21.15.96:0/1686818163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c1446c0 msgr2=0x7f2c6c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.545+0000 7f2c6be00640 1 --2- 172.21.15.96:0/1686818163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c1446c0 0x7f2c6c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.545+0000 7f2c70a00640 1 --2- 172.21.15.96:0/1686818163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c1446c0 0x7f2c6c06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.545+0000 7f2c70a00640 1 -- 172.21.15.96:0/1686818163 >> v1:172.21.15.155:6789/0 conn(0x7f2c6c0b4790 legacy=0x7f2c6c15ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:42.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.545+0000 7f2c70a00640 1 -- 172.21.15.96:0/1686818163 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c0b3cb0 con 0x7f2c6c15f160 2024-04-24T23:58:42.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.546+0000 7f2c70a00640 1 --2- 172.21.15.96:0/1686818163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c15f160 0x7f2c6c070ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009870 tx=0x7f2c5c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb51f31f154682f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.546+0000 7f2c6aa00640 1 -- 172.21.15.96:0/1686818163 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c037070 con 0x7f2c6c15f160 2024-04-24T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.546+0000 7f2c6aa00640 1 -- 172.21.15.96:0/1686818163 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5c032440 con 0x7f2c6c15f160 2024-04-24T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.546+0000 7f2c6aa00640 1 -- 172.21.15.96:0/1686818163 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c032810 con 0x7f2c6c15f160 2024-04-24T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.547+0000 7f2c71400640 1 -- 172.21.15.96:0/1686818163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c15f160 msgr2=0x7f2c6c070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.547+0000 7f2c71400640 1 --2- 172.21.15.96:0/1686818163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c15f160 0x7f2c6c070ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009870 tx=0x7f2c5c02a180 comp rx=0 tx=0).stop 2024-04-24T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.547+0000 7f2c71400640 1 -- 172.21.15.96:0/1686818163 shutdown_connections 2024-04-24T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.547+0000 7f2c71400640 1 --2- 172.21.15.96:0/1686818163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c15f160 0x7f2c6c070ca0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.547+0000 7f2c71400640 1 --2- 172.21.15.96:0/1686818163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c1446c0 0x7f2c6c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.547+0000 7f2c71400640 1 -- 172.21.15.96:0/1686818163 >> 172.21.15.96:0/1686818163 conn(0x7f2c6c0b18b0 msgr2=0x7f2c6c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.547+0000 7f2c71400640 1 -- 172.21.15.96:0/1686818163 shutdown_connections 2024-04-24T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.547+0000 7f2c71400640 1 -- 172.21.15.96:0/1686818163 wait complete. 2024-04-24T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.549+0000 7f2c71400640 1 Processor -- start 2024-04-24T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.549+0000 7f2c71400640 1 -- start start 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.550+0000 7f2c71400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c0b4790 0x7f2c6c1e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.550+0000 7f2c71400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c1446c0 0x7f2c6c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c71400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c15f160 0x7f2c6c1e74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c71400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c15f7b0 con 0x7f2c6c0b4790 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c71400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c144aa0 con 0x7f2c6c1446c0 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c71400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c06e900 con 0x7f2c6c15f160 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c6be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c0b4790 0x7f2c6c1e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c6be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c0b4790 0x7f2c6c1e6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43802/0 (socket says 172.21.15.96:43802) 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c6be00640 1 -- 172.21.15.96:0/4256303700 learned_addr learned my addr 172.21.15.96:0/4256303700 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c6be00640 1 -- 172.21.15.96:0/4256303700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c15f160 msgr2=0x7f2c6c1e74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c6be00640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c15f160 0x7f2c6c1e74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c6be00640 1 -- 172.21.15.96:0/4256303700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c1446c0 msgr2=0x7f2c6c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c6be00640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c1446c0 0x7f2c6c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c6be00640 1 -- 172.21.15.96:0/4256303700 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c1e57d0 con 0x7f2c6c0b4790 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c6be00640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c0b4790 0x7f2c6c1e6870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400ce10 tx=0x7f2c6400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.551+0000 7f2c63e00640 1 -- 172.21.15.96:0/4256303700 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64003b90 con 0x7f2c6c0b4790 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.552+0000 7f2c63e00640 1 -- 172.21.15.96:0/4256303700 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c64003d30 con 0x7f2c6c0b4790 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.552+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c1e5ab0 con 0x7f2c6c0b4790 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.552+0000 7f2c63e00640 1 -- 172.21.15.96:0/4256303700 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64004240 con 0x7f2c6c0b4790 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.552+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c1e6070 con 0x7f2c6c0b4790 2024-04-24T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.553+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c0755d0 con 0x7f2c6c0b4790 2024-04-24T23:58:42.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.554+0000 7f2c63e00640 1 -- 172.21.15.96:0/4256303700 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c640043e0 con 0x7f2c6c0b4790 2024-04-24T23:58:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.555+0000 7f2c63e00640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2c4806be30 0x7f2c4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.555+0000 7f2c63e00640 1 -- 172.21.15.96:0/4256303700 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2c6408ba60 con 0x7f2c6c0b4790 2024-04-24T23:58:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.555+0000 7f2c6b400640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2c4806be30 0x7f2c4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.556+0000 7f2c6b400640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2c4806be30 0x7f2c4806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0cc0b0 tx=0x7f2c540079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:42.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.561+0000 7f2c63e00640 1 -- 172.21.15.96:0/4256303700 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2c6401d340 con 0x7f2c6c0b4790 2024-04-24T23:58:42.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.741+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2c6c06d4a0 con 0x7f2c6c0b4790 2024-04-24T23:58:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.742+0000 7f2c63e00640 1 -- 172.21.15.96:0/4256303700 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f2c6405a330 con 0x7f2c6c0b4790 2024-04-24T23:58:42.742 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2c4806be30 msgr2=0x7f2c4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2c4806be30 0x7f2c4806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0cc0b0 tx=0x7f2c540079b0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c0b4790 msgr2=0x7f2c6c1e6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c0b4790 0x7f2c6c1e6870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400ce10 tx=0x7f2c6400a660 comp rx=0 tx=0).stop 2024-04-24T23:58:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 shutdown_connections 2024-04-24T23:58:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c6c15f160 0x7f2c6c1e74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c1446c0 0x7f2c6c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2c4806be30 0x7f2c4806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 --2- 172.21.15.96:0/4256303700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c6c0b4790 0x7f2c6c1e6870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.744+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 >> 172.21.15.96:0/4256303700 conn(0x7f2c6c0b18b0 msgr2=0x7f2c6c0ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:42.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.745+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 shutdown_connections 2024-04-24T23:58:42.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.745+0000 7f2c71400640 1 -- 172.21.15.96:0/4256303700 wait complete. 2024-04-24T23:58:42.765 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:42.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.968+0000 7fe3e3e00640 1 Processor -- start 2024-04-24T23:58:42.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.968+0000 7fe3e3e00640 1 -- start start 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.969+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e415a5d0 0x7fe3e406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.969+0000 7fe3e3e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe3e40b3c30 0x7fe3e406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.970+0000 7fe3e3e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e40b40d0 con 0x7fe3e406e000 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.970+0000 7fe3e3e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e415a9b0 con 0x7fe3e40b3c30 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.970+0000 7fe3e3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e4070e40 con 0x7fe3e415a5d0 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.970+0000 7fe3e3400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe3e406e000 0x7fe3e415e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36620/0 (socket says 172.21.15.96:36620) 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.970+0000 7fe3e3400640 1 -- 172.21.15.96:0/1657131780 learned_addr learned my addr 172.21.15.96:0/1657131780 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.970+0000 7fe3e2a00640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e415a5d0 0x7fe3e406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.970+0000 7fe3da000640 1 --2- 172.21.15.96:0/1657131780 >> v2:172.21.15.155:3300/0 conn(0x7fe3e40b3c30 0x7fe3e406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672647869 0 0) 0x7fe3dc001490 con 0x7fe3e406e000 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3c8003520 con 0x7fe3e406e000 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 284015598 0 0) 0x7fe3c8003520 con 0x7fe3e406e000 2024-04-24T23:58:42.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e415a5d0 msgr2=0x7fe3e406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e415a5d0 0x7fe3e406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 >> v2:172.21.15.155:3300/0 conn(0x7fe3e40b3c30 msgr2=0x7fe3e406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 --2- 172.21.15.96:0/1657131780 >> v2:172.21.15.155:3300/0 conn(0x7fe3e40b3c30 0x7fe3e406d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e4071120 con 0x7fe3e406e000 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fe3dc001bc0 con 0x7fe3e406e000 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 >> v1:172.21.15.96:6789/0 conn(0x7fe3e406e000 legacy=0x7fe3e415e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c80039b0 0x7fe3c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e415a5d0 0x7fe3c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3c8004d40 0x7fe3c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e415a9b0 con 0x7fe3c8004d40 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e4070e40 con 0x7fe3c80039b0 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c800b9c0 con 0x7fe3e415a5d0 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.971+0000 7fe3e3400640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3c8004d40 0x7fe3c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.972+0000 7fe3da000640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e415a5d0 0x7fe3c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.972+0000 7fe3e2a00640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c80039b0 0x7fe3c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.972+0000 7fe3e3400640 1 -- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e415a5d0 msgr2=0x7fe3c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.972+0000 7fe3e3400640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e415a5d0 0x7fe3c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.972+0000 7fe3e3400640 1 -- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c80039b0 msgr2=0x7fe3c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.972+0000 7fe3e3400640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c80039b0 0x7fe3c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.972+0000 7fe3e3400640 1 -- 172.21.15.96:0/1657131780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c8003520 con 0x7fe3c8004d40 2024-04-24T23:58:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.972+0000 7fe3e2a00640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c80039b0 0x7fe3c8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.973+0000 7fe3e3400640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3c8004d40 0x7fe3c80051c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40cc3b0 tx=0x7fe3c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee192cedb57d1f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc00a690 con 0x7fe3c8004d40 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3dc02f070 con 0x7fe3c8004d40 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e2000640 1 -- 172.21.15.96:0/1657131780 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc034470 con 0x7fe3c8004d40 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e3e00640 1 -- 172.21.15.96:0/1657131780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3c8004d40 msgr2=0x7fe3c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e3e00640 1 --2- 172.21.15.96:0/1657131780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3c8004d40 0x7fe3c80051c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40cc3b0 tx=0x7fe3c8005830 comp rx=0 tx=0).stop 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e3400640 1 -- 172.21.15.96:0/1657131780 reap_dead start 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e3e00640 1 -- 172.21.15.96:0/1657131780 shutdown_connections 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e3e00640 1 -- 172.21.15.96:0/1657131780 >> 172.21.15.96:0/1657131780 conn(0x7fe3e40b18b0 msgr2=0x7fe3e40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e3e00640 1 -- 172.21.15.96:0/1657131780 shutdown_connections 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.974+0000 7fe3e3e00640 1 -- 172.21.15.96:0/1657131780 wait complete. 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.976+0000 7fe3e3e00640 1 Processor -- start 2024-04-24T23:58:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.976+0000 7fe3e3e00640 1 -- start start 2024-04-24T23:58:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.977+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c8004d40 0x7fe3e41442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.977+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3e412fdc0 0x7fe3e40ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.977+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e40ce9a0 0x7fe3e414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.977+0000 7fe3e3e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e4072d90 con 0x7fe3e412fdc0 2024-04-24T23:58:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.977+0000 7fe3e3e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e4072c10 con 0x7fe3c8004d40 2024-04-24T23:58:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.977+0000 7fe3e3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e4072f10 con 0x7fe3e40ce9a0 2024-04-24T23:58:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.977+0000 7fe3da000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3e412fdc0 0x7fe3e40ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.977+0000 7fe3da000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3e412fdc0 0x7fe3e40ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43818/0 (socket says 172.21.15.96:43818) 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.977+0000 7fe3da000640 1 -- 172.21.15.96:0/2844686894 learned_addr learned my addr 172.21.15.96:0/2844686894 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3da000640 1 -- 172.21.15.96:0/2844686894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e40ce9a0 msgr2=0x7fe3e414e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3da000640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e40ce9a0 0x7fe3e414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3da000640 1 -- 172.21.15.96:0/2844686894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c8004d40 msgr2=0x7fe3e41442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3da000640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c8004d40 0x7fe3e41442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3da000640 1 -- 172.21.15.96:0/2844686894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e414c250 con 0x7fe3e412fdc0 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3da000640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3e412fdc0 0x7fe3e40ce460 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc011700 tx=0x7fe3cc011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3db400640 1 -- 172.21.15.96:0/2844686894 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00f940 con 0x7fe3e412fdc0 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3db400640 1 -- 172.21.15.96:0/2844686894 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00fae0 con 0x7fe3e412fdc0 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e414c530 con 0x7fe3e412fdc0 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.978+0000 7fe3db400640 1 -- 172.21.15.96:0/2844686894 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00fe90 con 0x7fe3e412fdc0 2024-04-24T23:58:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.979+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e414caf0 con 0x7fe3e412fdc0 2024-04-24T23:58:42.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.980+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e40755d0 con 0x7fe3e412fdc0 2024-04-24T23:58:42.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.980+0000 7fe3db400640 1 -- 172.21.15.96:0/2844686894 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3cc015460 con 0x7fe3e412fdc0 2024-04-24T23:58:42.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.981+0000 7fe3db400640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe3c006bfd0 0x7fe3c006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:42.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.981+0000 7fe3db400640 1 -- 172.21.15.96:0/2844686894 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe3cc08b880 con 0x7fe3e412fdc0 2024-04-24T23:58:42.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.982+0000 7fe3e2a00640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe3c006bfd0 0x7fe3c006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:42.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.982+0000 7fe3e2a00640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe3c006bfd0 0x7fe3c006e490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009a00 tx=0x7fe3d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:42.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:42.986+0000 7fe3db400640 1 -- 172.21.15.96:0/2844686894 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe3cc019030 con 0x7fe3e412fdc0 2024-04-24T23:58:43.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.182+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe3e4144830 con 0x7fe3e412fdc0 2024-04-24T23:58:43.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.183+0000 7fe3db400640 1 -- 172.21.15.96:0/2844686894 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe3cc05a220 con 0x7fe3e412fdc0 2024-04-24T23:58:43.184 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:43.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe3c006bfd0 msgr2=0x7fe3c006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe3c006bfd0 0x7fe3c006e490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009a00 tx=0x7fe3d4008040 comp rx=0 tx=0).stop 2024-04-24T23:58:43.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3e412fdc0 msgr2=0x7fe3e40ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3e412fdc0 0x7fe3e40ce460 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc011700 tx=0x7fe3cc011bc0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 shutdown_connections 2024-04-24T23:58:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3e40ce9a0 0x7fe3e414e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe3c006bfd0 0x7fe3c006e490 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3e412fdc0 0x7fe3e40ce460 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 --2- 172.21.15.96:0/2844686894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c8004d40 0x7fe3e41442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 >> 172.21.15.96:0/2844686894 conn(0x7fe3e40b18b0 msgr2=0x7fe3e4152b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 shutdown_connections 2024-04-24T23:58:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.186+0000 7fe3e3e00640 1 -- 172.21.15.96:0/2844686894 wait complete. 2024-04-24T23:58:43.205 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:43.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.403+0000 7fbb99600640 1 Processor -- start 2024-04-24T23:58:43.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.403+0000 7fbb99600640 1 -- start start 2024-04-24T23:58:43.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.405+0000 7fbb99600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbb940ccdf0 0x7fbb941670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.405+0000 7fbb99600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb9415fa90 con 0x7fbb940b4ec0 2024-04-24T23:58:43.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.405+0000 7fbb99600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb940b3e20 con 0x7fbb9415f6b0 2024-04-24T23:58:43.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.405+0000 7fbb99600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fbb940b4a30 con 0x7fbb940ccdf0 2024-04-24T23:58:43.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.405+0000 7fbb98c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbb940ccdf0 0x7fbb941670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:43.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.405+0000 7fbb93400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbb940b4ec0 0x7fbb940cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36622/0 (socket says 172.21.15.96:36622) 2024-04-24T23:58:43.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.405+0000 7fbb93400640 1 -- 172.21.15.96:0/2926126495 learned_addr learned my addr 172.21.15.96:0/2926126495 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:43.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.405+0000 7fbb98c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbb940ccdf0 0x7fbb941670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43830/0 (socket says 172.21.15.96:43830) 2024-04-24T23:58:43.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.406+0000 7fbb98c00640 1 -- 172.21.15.96:0/2926126495 >> v1:172.21.15.155:6789/0 conn(0x7fbb9415f6b0 legacy=0x7fbb940ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.406+0000 7fbb98c00640 1 -- 172.21.15.96:0/2926126495 >> v1:172.21.15.96:6789/0 conn(0x7fbb940b4ec0 legacy=0x7fbb940cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.406+0000 7fbb92a00640 1 -- 172.21.15.96:0/2926126495 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638337598 0 0) 0x7fbb9415fa90 con 0x7fbb940b4ec0 2024-04-24T23:58:43.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.406+0000 7fbb98c00640 1 -- 172.21.15.96:0/2926126495 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb940b4100 con 0x7fbb940ccdf0 2024-04-24T23:58:43.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.407+0000 7fbb98c00640 1 --2- 172.21.15.96:0/2926126495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb940ccdf0 0x7fbb941670b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009d90 tx=0x7fbb8c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a02c01fed479c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:43.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.407+0000 7fbb92a00640 1 -- 172.21.15.96:0/2926126495 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c007740 con 0x7fbb940ccdf0 2024-04-24T23:58:43.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.407+0000 7fbb92a00640 1 -- 172.21.15.96:0/2926126495 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c0078e0 con 0x7fbb940ccdf0 2024-04-24T23:58:43.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.407+0000 7fbb92a00640 1 -- 172.21.15.96:0/2926126495 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c007cb0 con 0x7fbb940ccdf0 2024-04-24T23:58:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.408+0000 7fbb99600640 1 -- 172.21.15.96:0/2926126495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb940ccdf0 msgr2=0x7fbb941670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.408+0000 7fbb99600640 1 --2- 172.21.15.96:0/2926126495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb940ccdf0 0x7fbb941670b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009d90 tx=0x7fbb8c02a6f0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.408+0000 7fbb99600640 1 -- 172.21.15.96:0/2926126495 shutdown_connections 2024-04-24T23:58:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.408+0000 7fbb99600640 1 --2- 172.21.15.96:0/2926126495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb940ccdf0 0x7fbb941670b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.408+0000 7fbb99600640 1 -- 172.21.15.96:0/2926126495 >> 172.21.15.96:0/2926126495 conn(0x7fbb940b1f10 msgr2=0x7fbb940cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.408+0000 7fbb99600640 1 -- 172.21.15.96:0/2926126495 shutdown_connections 2024-04-24T23:58:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.408+0000 7fbb99600640 1 -- 172.21.15.96:0/2926126495 wait complete. 2024-04-24T23:58:43.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.409+0000 7fbb99600640 1 Processor -- start 2024-04-24T23:58:43.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.410+0000 7fbb99600640 1 -- start start 2024-04-24T23:58:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.410+0000 7fbb99600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb940b4ec0 0x7fbb9414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.410+0000 7fbb99600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb940ccdf0 0x7fbb9409c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.410+0000 7fbb99600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9415f6b0 0x7fbb9415bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.410+0000 7fbb99600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbb940cf1c0 con 0x7fbb9415f6b0 2024-04-24T23:58:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.410+0000 7fbb99600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb940b46c0 con 0x7fbb940ccdf0 2024-04-24T23:58:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.410+0000 7fbb99600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbb940b3a40 con 0x7fbb940b4ec0 2024-04-24T23:58:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.411+0000 7fbb98c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9415f6b0 0x7fbb9415bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.411+0000 7fbb98c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9415f6b0 0x7fbb9415bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43844/0 (socket says 172.21.15.96:43844) 2024-04-24T23:58:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.411+0000 7fbb98c00640 1 -- 172.21.15.96:0/4231905192 learned_addr learned my addr 172.21.15.96:0/4231905192 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.411+0000 7fbb93e00640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb940b4ec0 0x7fbb9414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.411+0000 7fbb98c00640 1 -- 172.21.15.96:0/4231905192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb940b4ec0 msgr2=0x7fbb9414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.411+0000 7fbb98c00640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb940b4ec0 0x7fbb9414d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.411+0000 7fbb98c00640 1 -- 172.21.15.96:0/4231905192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb940ccdf0 msgr2=0x7fbb9409c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.411+0000 7fbb98c00640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb940ccdf0 0x7fbb9409c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.411+0000 7fbb98c00640 1 -- 172.21.15.96:0/4231905192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb94152450 con 0x7fbb9415f6b0 2024-04-24T23:58:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.412+0000 7fbb98c00640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9415f6b0 0x7fbb9415bd40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009d90 tx=0x7fbb8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.412+0000 7fbb8be00640 1 -- 172.21.15.96:0/4231905192 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c040070 con 0x7fbb9415f6b0 2024-04-24T23:58:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.412+0000 7fbb8be00640 1 -- 172.21.15.96:0/4231905192 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c031c40 con 0x7fbb9415f6b0 2024-04-24T23:58:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.412+0000 7fbb8be00640 1 -- 172.21.15.96:0/4231905192 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c003990 con 0x7fbb9415f6b0 2024-04-24T23:58:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.412+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb94152730 con 0x7fbb9415f6b0 2024-04-24T23:58:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.412+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb94152cf0 con 0x7fbb9415f6b0 2024-04-24T23:58:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.413+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb940756b0 con 0x7fbb9415f6b0 2024-04-24T23:58:43.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.414+0000 7fbb8be00640 1 -- 172.21.15.96:0/4231905192 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb8c039040 con 0x7fbb9415f6b0 2024-04-24T23:58:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.415+0000 7fbb8be00640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbb7406be30 0x7fbb7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.415+0000 7fbb8be00640 1 -- 172.21.15.96:0/4231905192 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbb8c0ac190 con 0x7fbb9415f6b0 2024-04-24T23:58:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.415+0000 7fbb93e00640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbb7406be30 0x7fbb7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:43.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.416+0000 7fbb93e00640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbb7406be30 0x7fbb7406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbb9409db70 tx=0x7fbb84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:43.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.419+0000 7fbb8be00640 1 -- 172.21.15.96:0/4231905192 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbb8c07ab30 con 0x7fbb9415f6b0 2024-04-24T23:58:43.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.603+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb9415e270 con 0x7fbb9415f6b0 2024-04-24T23:58:43.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.606+0000 7fbb8be00640 1 -- 172.21.15.96:0/4231905192 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7fbb8c07a430 con 0x7fbb9415f6b0 2024-04-24T23:58:43.606 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:43.606 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:43.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbb7406be30 msgr2=0x7fbb7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbb7406be30 0x7fbb7406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbb9409db70 tx=0x7fbb84009040 comp rx=0 tx=0).stop 2024-04-24T23:58:43.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9415f6b0 msgr2=0x7fbb9415bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9415f6b0 0x7fbb9415bd40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009d90 tx=0x7fbb8c004a40 comp rx=0 tx=0).stop 2024-04-24T23:58:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 shutdown_connections 2024-04-24T23:58:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbb7406be30 0x7fbb7406e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9415f6b0 0x7fbb9415bd40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb940ccdf0 0x7fbb9409c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 --2- 172.21.15.96:0/4231905192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb940b4ec0 0x7fbb9414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 >> 172.21.15.96:0/4231905192 conn(0x7fbb940b1f10 msgr2=0x7fbb9415fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.609+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 shutdown_connections 2024-04-24T23:58:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.610+0000 7fbb99600640 1 -- 172.21.15.96:0/4231905192 wait complete. 2024-04-24T23:58:43.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:43.628 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:43.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.827+0000 7ff8cb200640 1 Processor -- start 2024-04-24T23:58:43.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.827+0000 7ff8cb200640 1 -- start start 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8cb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e220 0x7ff8c40d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8cb200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8c40d2c70 0x7ff8c40b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8cb200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c40d14c0 con 0x7ff8c415e600 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8cb200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c40b11f0 con 0x7ff8c40d2c70 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8cb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c40d17a0 con 0x7ff8c415e220 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8ca800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8c40d2c70 0x7ff8c40b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8ca800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8c40d2c70 0x7ff8c40b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43858/0 (socket says 172.21.15.96:43858) 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8ca800640 1 -- 172.21.15.96:0/3250074745 learned_addr learned my addr 172.21.15.96:0/3250074745 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8c9e00640 1 --2- 172.21.15.96:0/3250074745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e220 0x7ff8c40d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:43.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8ca800640 1 -- 172.21.15.96:0/3250074745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e220 msgr2=0x7ff8c40d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:43.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.829+0000 7ff8ca800640 1 --2- 172.21.15.96:0/3250074745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e220 0x7ff8c40d4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.830+0000 7ff8ca800640 1 -- 172.21.15.96:0/3250074745 >> v1:172.21.15.155:6789/0 conn(0x7ff8c415e600 legacy=0x7ff8c40d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:43.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.830+0000 7ff8ca800640 1 -- 172.21.15.96:0/3250074745 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c40b0e80 con 0x7ff8c40d2c70 2024-04-24T23:58:43.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.830+0000 7ff8c9e00640 1 --2- 172.21.15.96:0/3250074745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e220 0x7ff8c40d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:43.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.831+0000 7ff8ca800640 1 --2- 172.21.15.96:0/3250074745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 0x7ff8c40b1680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009e50 tx=0x7ff8c002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8642ed3312b651 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:43.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.831+0000 7ff8c8a00640 1 -- 172.21.15.96:0/3250074745 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0036070 con 0x7ff8c40d2c70 2024-04-24T23:58:43.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.831+0000 7ff8c8a00640 1 -- 172.21.15.96:0/3250074745 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c0031600 con 0x7ff8c40d2c70 2024-04-24T23:58:43.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.831+0000 7ff8c8a00640 1 -- 172.21.15.96:0/3250074745 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c00319d0 con 0x7ff8c40d2c70 2024-04-24T23:58:43.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.831+0000 7ff8cb200640 1 -- 172.21.15.96:0/3250074745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 msgr2=0x7ff8c40b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.831+0000 7ff8cb200640 1 --2- 172.21.15.96:0/3250074745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 0x7ff8c40b1680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009e50 tx=0x7ff8c002a760 comp rx=0 tx=0).stop 2024-04-24T23:58:43.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.832+0000 7ff8cb200640 1 -- 172.21.15.96:0/3250074745 shutdown_connections 2024-04-24T23:58:43.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.832+0000 7ff8cb200640 1 --2- 172.21.15.96:0/3250074745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 0x7ff8c40b1680 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.832+0000 7ff8cb200640 1 --2- 172.21.15.96:0/3250074745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e220 0x7ff8c40d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.832+0000 7ff8cb200640 1 -- 172.21.15.96:0/3250074745 >> 172.21.15.96:0/3250074745 conn(0x7ff8c40d3f80 msgr2=0x7ff8c40d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:43.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.832+0000 7ff8cb200640 1 -- 172.21.15.96:0/3250074745 shutdown_connections 2024-04-24T23:58:43.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.832+0000 7ff8cb200640 1 -- 172.21.15.96:0/3250074745 wait complete. 2024-04-24T23:58:43.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.833+0000 7ff8cb200640 1 Processor -- start 2024-04-24T23:58:43.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.834+0000 7ff8cb200640 1 -- start start 2024-04-24T23:58:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.834+0000 7ff8cb200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 0x7ff8c40cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.834+0000 7ff8cb200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c415e220 0x7ff8c414f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.834+0000 7ff8cb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e600 0x7ff8c40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.834+0000 7ff8cb200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c40d1140 con 0x7ff8c40d2c70 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.834+0000 7ff8cb200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c40d0fc0 con 0x7ff8c415e220 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.834+0000 7ff8cb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c40b1bc0 con 0x7ff8c415e600 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8c9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 0x7ff8c40cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8c9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 0x7ff8c40cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43860/0 (socket says 172.21.15.96:43860) 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8c9e00640 1 -- 172.21.15.96:0/2834750410 learned_addr learned my addr 172.21.15.96:0/2834750410 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8c9e00640 1 -- 172.21.15.96:0/2834750410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e600 msgr2=0x7ff8c40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8ca800640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e600 0x7ff8c40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8c9e00640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e600 0x7ff8c40b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8c9e00640 1 -- 172.21.15.96:0/2834750410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c415e220 msgr2=0x7ff8c414f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8c9e00640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c415e220 0x7ff8c414f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8c9e00640 1 -- 172.21.15.96:0/2834750410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c414f910 con 0x7ff8c40d2c70 2024-04-24T23:58:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8ca800640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e600 0x7ff8c40b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.835+0000 7ff8c9e00640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 0x7ff8c40cb050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c7f0 tx=0x7ff8b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.836+0000 7ff8be000640 1 -- 172.21.15.96:0/2834750410 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8015070 con 0x7ff8c40d2c70 2024-04-24T23:58:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.836+0000 7ff8be000640 1 -- 172.21.15.96:0/2834750410 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b8007a30 con 0x7ff8c40d2c70 2024-04-24T23:58:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.836+0000 7ff8be000640 1 -- 172.21.15.96:0/2834750410 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8007e00 con 0x7ff8c40d2c70 2024-04-24T23:58:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.836+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c40b5fd0 con 0x7ff8c40d2c70 2024-04-24T23:58:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.836+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c40cb9c0 con 0x7ff8c40d2c70 2024-04-24T23:58:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.837+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c40755d0 con 0x7ff8c40d2c70 2024-04-24T23:58:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.838+0000 7ff8be000640 1 -- 172.21.15.96:0/2834750410 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8b8018070 con 0x7ff8c40d2c70 2024-04-24T23:58:43.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.839+0000 7ff8be000640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8a806be30 0x7ff8a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:43.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.840+0000 7ff8be000640 1 -- 172.21.15.96:0/2834750410 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8b808ae30 con 0x7ff8c40d2c70 2024-04-24T23:58:43.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.840+0000 7ff8c9400640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8a806be30 0x7ff8a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:43.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.840+0000 7ff8c9400640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8a806be30 0x7ff8a806e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4006fd0 tx=0x7ff8b4006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:43.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:43.844+0000 7ff8be000640 1 -- 172.21.15.96:0/2834750410 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff8c414f910 con 0x7ff8c40d2c70 2024-04-24T23:58:44.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.044+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff8c415d790 con 0x7ff8c40d2c70 2024-04-24T23:58:44.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.045+0000 7ff8be000640 1 -- 172.21.15.96:0/2834750410 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ff8b80597d0 con 0x7ff8c40d2c70 2024-04-24T23:58:44.046 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:44.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8a806be30 msgr2=0x7ff8a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8a806be30 0x7ff8a806e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4006fd0 tx=0x7ff8b4006bc0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 msgr2=0x7ff8c40cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 0x7ff8c40cb050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c7f0 tx=0x7ff8b800cbf0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 shutdown_connections 2024-04-24T23:58:44.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c415e600 0x7ff8c40b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c415e220 0x7ff8c414f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8a806be30 0x7ff8a806e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 --2- 172.21.15.96:0/2834750410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8c40d2c70 0x7ff8c40cb050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.047+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 >> 172.21.15.96:0/2834750410 conn(0x7ff8c40d3f80 msgr2=0x7ff8c40d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:44.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.048+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 shutdown_connections 2024-04-24T23:58:44.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.048+0000 7ff8cb200640 1 -- 172.21.15.96:0/2834750410 wait complete. 2024-04-24T23:58:44.066 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:44.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.272+0000 7f6937400640 1 Processor -- start 2024-04-24T23:58:44.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.272+0000 7f6937400640 1 -- start start 2024-04-24T23:58:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.274+0000 7f6937400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6930156620 0x7f693015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.274+0000 7f6937400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f69300ae8e0 0x7f69300aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.274+0000 7f6937400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693006d100 con 0x7f693006edf0 2024-04-24T23:58:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.274+0000 7f6937400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f69300acda0 con 0x7f69300ae8e0 2024-04-24T23:58:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.274+0000 7f6937400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f69300ad060 con 0x7f6930156620 2024-04-24T23:58:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.274+0000 7f692fe00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f693006edf0 0x7f693006dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36624/0 (socket says 172.21.15.96:36624) 2024-04-24T23:58:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.274+0000 7f692fe00640 1 -- 172.21.15.96:0/4114127824 learned_addr learned my addr 172.21.15.96:0/4114127824 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.274+0000 7f6934a00640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6930156620 0x7f693015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.274+0000 7f6935400640 1 --2- 172.21.15.96:0/4114127824 >> v2:172.21.15.155:3300/0 conn(0x7f69300ae8e0 0x7f69300aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556845972 0 0) 0x7f693006d100 con 0x7f693006edf0 2024-04-24T23:58:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6918003520 con 0x7f693006edf0 2024-04-24T23:58:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2875919545 0 0) 0x7f6918003520 con 0x7f693006edf0 2024-04-24T23:58:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6930156620 msgr2=0x7f693015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6930156620 0x7f693015cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 >> v2:172.21.15.155:3300/0 conn(0x7f69300ae8e0 msgr2=0x7f69300aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 --2- 172.21.15.96:0/4114127824 >> v2:172.21.15.155:3300/0 conn(0x7f69300ae8e0 0x7f69300aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693006d3a0 con 0x7f693006edf0 2024-04-24T23:58:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f691c001670 con 0x7f693006edf0 2024-04-24T23:58:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 >> v1:172.21.15.96:6789/0 conn(0x7f693006edf0 legacy=0x7f693006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6930156620 0x7f69180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918003f80 0x7f6918004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6918004d40 0x7f69180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f69300acda0 con 0x7f6918004d40 2024-04-24T23:58:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f69300ad060 con 0x7f6918003f80 2024-04-24T23:58:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.275+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f691800ba70 con 0x7f6930156620 2024-04-24T23:58:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.276+0000 7f6935400640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6918004d40 0x7f69180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.276+0000 7f6934a00640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6930156620 0x7f69180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.276+0000 7f692fe00640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918003f80 0x7f6918004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.276+0000 7f6935400640 1 -- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6930156620 msgr2=0x7f69180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.276+0000 7f6935400640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6930156620 0x7f69180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.276+0000 7f6935400640 1 -- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918003f80 msgr2=0x7f6918004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.276+0000 7f6935400640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918003f80 0x7f6918004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.276+0000 7f6935400640 1 -- 172.21.15.96:0/4114127824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6918003520 con 0x7f6918004d40 2024-04-24T23:58:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.276+0000 7f692fe00640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918003f80 0x7f6918004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.277+0000 7f6935400640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6918004d40 0x7f69180051c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6928009fc0 tx=0x7f6918005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdf749167419895 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.277+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928009c10 con 0x7f6918004d40 2024-04-24T23:58:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.277+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6928036070 con 0x7f6918004d40 2024-04-24T23:58:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.277+0000 7f692f400640 1 -- 172.21.15.96:0/4114127824 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692802d070 con 0x7f6918004d40 2024-04-24T23:58:44.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.278+0000 7f6937400640 1 -- 172.21.15.96:0/4114127824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6918004d40 msgr2=0x7f69180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.278+0000 7f6937400640 1 --2- 172.21.15.96:0/4114127824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6918004d40 0x7f69180051c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6928009fc0 tx=0x7f6918005830 comp rx=0 tx=0).stop 2024-04-24T23:58:44.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.278+0000 7f6935400640 1 -- 172.21.15.96:0/4114127824 reap_dead start 2024-04-24T23:58:44.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.278+0000 7f6937400640 1 -- 172.21.15.96:0/4114127824 shutdown_connections 2024-04-24T23:58:44.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.278+0000 7f6937400640 1 -- 172.21.15.96:0/4114127824 >> 172.21.15.96:0/4114127824 conn(0x7f69300b19c0 msgr2=0x7f69300b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.278+0000 7f6937400640 1 -- 172.21.15.96:0/4114127824 shutdown_connections 2024-04-24T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.278+0000 7f6937400640 1 -- 172.21.15.96:0/4114127824 wait complete. 2024-04-24T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.280+0000 7f6937400640 1 Processor -- start 2024-04-24T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.280+0000 7f6937400640 1 -- start start 2024-04-24T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.281+0000 7f6937400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918004d40 0x7f6930148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.281+0000 7f6937400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69301f1cf0 0x7f69301f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.281+0000 7f6937400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f693009d4e0 0x7f693009d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.281+0000 7f6937400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f69300ad340 con 0x7f69301f1cf0 2024-04-24T23:58:44.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.281+0000 7f6937400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f69300af2b0 con 0x7f6918004d40 2024-04-24T23:58:44.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.281+0000 7f6937400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f69300ad4c0 con 0x7f693009d4e0 2024-04-24T23:58:44.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.281+0000 7f692fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69301f1cf0 0x7f69301f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.281+0000 7f692fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69301f1cf0 0x7f69301f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43880/0 (socket says 172.21.15.96:43880) 2024-04-24T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.281+0000 7f692fe00640 1 -- 172.21.15.96:0/2494325003 learned_addr learned my addr 172.21.15.96:0/2494325003 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f6934a00640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918004d40 0x7f6930148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f6935400640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f693009d4e0 0x7f693009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f692fe00640 1 -- 172.21.15.96:0/2494325003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f693009d4e0 msgr2=0x7f693009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f692fe00640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f693009d4e0 0x7f693009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f692fe00640 1 -- 172.21.15.96:0/2494325003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918004d40 msgr2=0x7f6930148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f692fe00640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918004d40 0x7f6930148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f692fe00640 1 -- 172.21.15.96:0/2494325003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6930148db0 con 0x7f69301f1cf0 2024-04-24T23:58:44.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f692fe00640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69301f1cf0 0x7f69301f2150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f691c00d840 tx=0x7f691c00dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:44.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f692cc00640 1 -- 172.21.15.96:0/2494325003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c019070 con 0x7f69301f1cf0 2024-04-24T23:58:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f692cc00640 1 -- 172.21.15.96:0/2494325003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c0074e0 con 0x7f69301f1cf0 2024-04-24T23:58:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f692cc00640 1 -- 172.21.15.96:0/2494325003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c0049e0 con 0x7f69301f1cf0 2024-04-24T23:58:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.282+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6930157ea0 con 0x7f69301f1cf0 2024-04-24T23:58:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.283+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6930158460 con 0x7f69301f1cf0 2024-04-24T23:58:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.284+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6930069110 con 0x7f69301f1cf0 2024-04-24T23:58:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.285+0000 7f692cc00640 1 -- 172.21.15.96:0/2494325003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f691c004b80 con 0x7f69301f1cf0 2024-04-24T23:58:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.285+0000 7f692cc00640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f691006be30 0x7f691006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.286+0000 7f692cc00640 1 -- 172.21.15.96:0/2494325003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f691c08aa50 con 0x7f69301f1cf0 2024-04-24T23:58:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.286+0000 7f6934a00640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f691006be30 0x7f691006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.286+0000 7f6934a00640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f691006be30 0x7f691006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6924009950 tx=0x7f6924008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.290+0000 7f692cc00640 1 -- 172.21.15.96:0/2494325003 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f691c0592d0 con 0x7f69301f1cf0 2024-04-24T23:58:44.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.489+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f69300b1e70 con 0x7f69301f1cf0 2024-04-24T23:58:44.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.490+0000 7f692cc00640 1 -- 172.21.15.96:0/2494325003 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f691c058bd0 con 0x7f69301f1cf0 2024-04-24T23:58:44.490 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f691006be30 msgr2=0x7f691006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f691006be30 0x7f691006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6924009950 tx=0x7f6924008040 comp rx=0 tx=0).stop 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69301f1cf0 msgr2=0x7f69301f2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69301f1cf0 0x7f69301f2150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f691c00d840 tx=0x7f691c00dd00 comp rx=0 tx=0).stop 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 shutdown_connections 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f693009d4e0 0x7f693009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f691006be30 0x7f691006e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69301f1cf0 0x7f69301f2150 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 --2- 172.21.15.96:0/2494325003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6918004d40 0x7f6930148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 >> 172.21.15.96:0/2494325003 conn(0x7f69300b19c0 msgr2=0x7f693015b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:44.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 shutdown_connections 2024-04-24T23:58:44.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.493+0000 7f6937400640 1 -- 172.21.15.96:0/2494325003 wait complete. 2024-04-24T23:58:44.513 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:44.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.714+0000 7fe6b9600640 1 Processor -- start 2024-04-24T23:58:44.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.714+0000 7fe6b9600640 1 -- start start 2024-04-24T23:58:44.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.716+0000 7fe6b9600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe6b41551c0 0x7fe6b415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.716+0000 7fe6b9600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b415f750 con 0x7fe6b40726d0 2024-04-24T23:58:44.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.716+0000 7fe6b9600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b415f190 con 0x7fe6b406edb0 2024-04-24T23:58:44.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.716+0000 7fe6b9600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe6b415f470 con 0x7fe6b41551c0 2024-04-24T23:58:44.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.717+0000 7fe6b2a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe6b41551c0 0x7fe6b415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.717+0000 7fe6b2a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe6b41551c0 0x7fe6b415e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43882/0 (socket says 172.21.15.96:43882) 2024-04-24T23:58:44.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.717+0000 7fe6b2a00640 1 -- 172.21.15.96:0/614123624 learned_addr learned my addr 172.21.15.96:0/614123624 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:44.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.717+0000 7fe6b3400640 1 --1- 172.21.15.96:0/614123624 >> v1:172.21.15.96:6789/0 conn(0x7fe6b40726d0 0x7fe6b4071950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36630/0 (socket says 172.21.15.96:36630) 2024-04-24T23:58:44.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.717+0000 7fe6b2a00640 1 -- 172.21.15.96:0/614123624 >> v1:172.21.15.155:6789/0 conn(0x7fe6b406edb0 legacy=0x7fe6b40b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.717+0000 7fe6b2a00640 1 -- 172.21.15.96:0/614123624 >> v1:172.21.15.96:6789/0 conn(0x7fe6b40726d0 legacy=0x7fe6b4071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.717+0000 7fe6b2a00640 1 -- 172.21.15.96:0/614123624 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b4071150 con 0x7fe6b41551c0 2024-04-24T23:58:44.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.717+0000 7fe6b1600640 1 -- 172.21.15.96:0/614123624 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683717441 0 0) 0x7fe6b415f750 con 0x7fe6b40726d0 2024-04-24T23:58:44.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.719+0000 7fe6b2a00640 1 --2- 172.21.15.96:0/614123624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b41551c0 0x7fe6b415e7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009e50 tx=0x7fe6a402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5a7fe0d59ae3e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:44.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.719+0000 7fe6b1600640 1 -- 172.21.15.96:0/614123624 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4036070 con 0x7fe6b41551c0 2024-04-24T23:58:44.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.719+0000 7fe6b1600640 1 -- 172.21.15.96:0/614123624 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a4031600 con 0x7fe6b41551c0 2024-04-24T23:58:44.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.719+0000 7fe6b1600640 1 -- 172.21.15.96:0/614123624 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a40319d0 con 0x7fe6b41551c0 2024-04-24T23:58:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.719+0000 7fe6b9600640 1 -- 172.21.15.96:0/614123624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b41551c0 msgr2=0x7fe6b415e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.719+0000 7fe6b9600640 1 --2- 172.21.15.96:0/614123624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b41551c0 0x7fe6b415e7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009e50 tx=0x7fe6a402a730 comp rx=0 tx=0).stop 2024-04-24T23:58:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.720+0000 7fe6b9600640 1 -- 172.21.15.96:0/614123624 shutdown_connections 2024-04-24T23:58:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.720+0000 7fe6b9600640 1 --2- 172.21.15.96:0/614123624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b41551c0 0x7fe6b415e7f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.720+0000 7fe6b9600640 1 -- 172.21.15.96:0/614123624 >> 172.21.15.96:0/614123624 conn(0x7fe6b40b19c0 msgr2=0x7fe6b40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.720+0000 7fe6b9600640 1 -- 172.21.15.96:0/614123624 shutdown_connections 2024-04-24T23:58:44.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.720+0000 7fe6b9600640 1 -- 172.21.15.96:0/614123624 wait complete. 2024-04-24T23:58:44.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.721+0000 7fe6b9600640 1 Processor -- start 2024-04-24T23:58:44.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.722+0000 7fe6b9600640 1 -- start start 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b406edb0 0x7fe6b4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b9600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b40726d0 0x7fe6b40b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b9600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b41551c0 0x7fe6b40b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b9600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b41555a0 con 0x7fe6b40726d0 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b9600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b40b33d0 con 0x7fe6b41551c0 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b415ed30 con 0x7fe6b406edb0 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b2000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b40726d0 0x7fe6b40b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b2000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b40726d0 0x7fe6b40b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43898/0 (socket says 172.21.15.96:43898) 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b2000640 1 -- 172.21.15.96:0/2200088666 learned_addr learned my addr 172.21.15.96:0/2200088666 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b2a00640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b406edb0 0x7fe6b4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.723+0000 7fe6b3400640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b41551c0 0x7fe6b40b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6b2000640 1 -- 172.21.15.96:0/2200088666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b406edb0 msgr2=0x7fe6b4151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6b2000640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b406edb0 0x7fe6b4151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6b2000640 1 -- 172.21.15.96:0/2200088666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b41551c0 msgr2=0x7fe6b40b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6b2000640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b41551c0 0x7fe6b40b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6b2000640 1 -- 172.21.15.96:0/2200088666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b4152160 con 0x7fe6b40726d0 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6b3400640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b41551c0 0x7fe6b40b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6b2000640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b40726d0 0x7fe6b40b0b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00c450 tx=0x7fe69c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6aaa00640 1 -- 172.21.15.96:0/2200088666 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0052d0 con 0x7fe6b40726d0 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6aaa00640 1 -- 172.21.15.96:0/2200088666 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69c005470 con 0x7fe6b40726d0 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6aaa00640 1 -- 172.21.15.96:0/2200088666 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c012870 con 0x7fe6b40726d0 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b409aa70 con 0x7fe6b40726d0 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.724+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b409b030 con 0x7fe6b40726d0 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.726+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b4069110 con 0x7fe6b40726d0 2024-04-24T23:58:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.726+0000 7fe6aaa00640 1 -- 172.21.15.96:0/2200088666 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe69c012a10 con 0x7fe6b40726d0 2024-04-24T23:58:44.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.728+0000 7fe6aaa00640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe69006be60 0x7fe69006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:44.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.728+0000 7fe6aaa00640 1 -- 172.21.15.96:0/2200088666 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe69c08aae0 con 0x7fe6b40726d0 2024-04-24T23:58:44.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.728+0000 7fe6b2a00640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe69006be60 0x7fe69006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:44.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.729+0000 7fe6b2a00640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe69006be60 0x7fe69006e320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4033000 tx=0x7fe6a4009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:44.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.732+0000 7fe6aaa00640 1 -- 172.21.15.96:0/2200088666 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe69c0593f0 con 0x7fe6b40726d0 2024-04-24T23:58:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.934+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe6b40b4e00 con 0x7fe6b40726d0 2024-04-24T23:58:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.935+0000 7fe6aaa00640 1 -- 172.21.15.96:0/2200088666 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe69c058cf0 con 0x7fe6b40726d0 2024-04-24T23:58:44.935 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe69006be60 msgr2=0x7fe69006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe69006be60 0x7fe69006e320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4033000 tx=0x7fe6a4009000 comp rx=0 tx=0).stop 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b40726d0 msgr2=0x7fe6b40b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b40726d0 0x7fe6b40b0b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00c450 tx=0x7fe69c00c910 comp rx=0 tx=0).stop 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 shutdown_connections 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b41551c0 0x7fe6b40b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe69006be60 0x7fe69006e320 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b40726d0 0x7fe6b40b0b00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 --2- 172.21.15.96:0/2200088666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6b406edb0 0x7fe6b4151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 >> 172.21.15.96:0/2200088666 conn(0x7fe6b40b19c0 msgr2=0x7fe6b40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 shutdown_connections 2024-04-24T23:58:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:44.938+0000 7fe6b9600640 1 -- 172.21.15.96:0/2200088666 wait complete. 2024-04-24T23:58:45.047 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2024-04-24T23:58:45.047 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:45.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.254+0000 7fd9b9c00640 1 Processor -- start 2024-04-24T23:58:45.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.254+0000 7fd9b9c00640 1 -- start start 2024-04-24T23:58:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b9c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd9b41553f0 0x7fd9b415b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b9c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9b40cdbd0 0x7fd9b40cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b9c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4070d60 0x7fd9b40711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b9c00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b40cf6e0 con 0x7fd9b41553f0 2024-04-24T23:58:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b9c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b4071710 con 0x7fd9b40cdbd0 2024-04-24T23:58:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b9c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b40ce100 con 0x7fd9b4070d60 2024-04-24T23:58:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b3e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd9b41553f0 0x7fd9b415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b3e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd9b41553f0 0x7fd9b415b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43914/0 (socket says 172.21.15.96:43914) 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b3e00640 1 -- 172.21.15.96:0/4159100884 learned_addr learned my addr 172.21.15.96:0/4159100884 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b3e00640 1 -- 172.21.15.96:0/4159100884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4070d60 msgr2=0x7fd9b40711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9ab400640 1 --2- 172.21.15.96:0/4159100884 >> v2:172.21.15.155:3300/0 conn(0x7fd9b40cdbd0 0x7fd9b40cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.256+0000 7fd9b9200640 1 --2- 172.21.15.96:0/4159100884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4070d60 0x7fd9b40711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.257+0000 7fd9b3e00640 1 --2- 172.21.15.96:0/4159100884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4070d60 0x7fd9b40711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.257+0000 7fd9b3e00640 1 -- 172.21.15.96:0/4159100884 >> v2:172.21.15.155:3300/0 conn(0x7fd9b40cdbd0 msgr2=0x7fd9b40cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.257+0000 7fd9b3e00640 1 --2- 172.21.15.96:0/4159100884 >> v2:172.21.15.155:3300/0 conn(0x7fd9b40cdbd0 0x7fd9b40cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.257+0000 7fd9b3e00640 1 -- 172.21.15.96:0/4159100884 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b40ce3e0 con 0x7fd9b41553f0 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.257+0000 7fd9b9200640 1 --2- 172.21.15.96:0/4159100884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4070d60 0x7fd9b40711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.257+0000 7fd9ab400640 1 --2- 172.21.15.96:0/4159100884 >> v2:172.21.15.155:3300/0 conn(0x7fd9b40cdbd0 0x7fd9b40cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.258+0000 7fd9b3e00640 1 --2- 172.21.15.96:0/4159100884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b41553f0 0x7fd9b415b530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd9b406f270 tx=0x7fd9a402c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef2109d907d7f52 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.258+0000 7fd9b3400640 1 -- 172.21.15.96:0/4159100884 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4038070 con 0x7fd9b41553f0 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.258+0000 7fd9b3400640 1 -- 172.21.15.96:0/4159100884 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a4031710 con 0x7fd9b41553f0 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.258+0000 7fd9b3400640 1 -- 172.21.15.96:0/4159100884 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4031ae0 con 0x7fd9b41553f0 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.259+0000 7fd9b9c00640 1 -- 172.21.15.96:0/4159100884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b41553f0 msgr2=0x7fd9b415b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.259+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/4159100884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b41553f0 0x7fd9b415b530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd9b406f270 tx=0x7fd9a402c3f0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.259+0000 7fd9b9c00640 1 -- 172.21.15.96:0/4159100884 shutdown_connections 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.259+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/4159100884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4070d60 0x7fd9b40711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.259+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/4159100884 >> v2:172.21.15.155:3300/0 conn(0x7fd9b40cdbd0 0x7fd9b40cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.259+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/4159100884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b41553f0 0x7fd9b415b530 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.259+0000 7fd9b9c00640 1 -- 172.21.15.96:0/4159100884 >> 172.21.15.96:0/4159100884 conn(0x7fd9b40b1f10 msgr2=0x7fd9b40cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.259+0000 7fd9b9c00640 1 -- 172.21.15.96:0/4159100884 shutdown_connections 2024-04-24T23:58:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.259+0000 7fd9b9c00640 1 -- 172.21.15.96:0/4159100884 wait complete. 2024-04-24T23:58:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.261+0000 7fd9b9c00640 1 Processor -- start 2024-04-24T23:58:45.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.261+0000 7fd9b9c00640 1 -- start start 2024-04-24T23:58:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.262+0000 7fd9b9c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b4070d60 0x7fd9b4149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.262+0000 7fd9b9c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b40cdbd0 0x7fd9b4149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.262+0000 7fd9b9c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b41553f0 0x7fd9b415f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.262+0000 7fd9b9c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b406cc30 con 0x7fd9b4070d60 2024-04-24T23:58:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b9c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40ce9a0 con 0x7fd9b41553f0 2024-04-24T23:58:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b9c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b406cdb0 con 0x7fd9b40cdbd0 2024-04-24T23:58:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b4070d60 0x7fd9b4149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b4070d60 0x7fd9b4149fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43930/0 (socket says 172.21.15.96:43930) 2024-04-24T23:58:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b3e00640 1 -- 172.21.15.96:0/2544357899 learned_addr learned my addr 172.21.15.96:0/2544357899 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9ab400640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b40cdbd0 0x7fd9b4149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b3e00640 1 -- 172.21.15.96:0/2544357899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b40cdbd0 msgr2=0x7fd9b4149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b3e00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b40cdbd0 0x7fd9b4149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b3e00640 1 -- 172.21.15.96:0/2544357899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b41553f0 msgr2=0x7fd9b415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b3e00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b41553f0 0x7fd9b415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9b3e00640 1 -- 172.21.15.96:0/2544357899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b4149cc0 con 0x7fd9b4070d60 2024-04-24T23:58:45.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.263+0000 7fd9ab400640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b40cdbd0 0x7fd9b4149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:45.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.264+0000 7fd9b3e00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b4070d60 0x7fd9b4149fa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4000c00 tx=0x7fd9a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:45.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.264+0000 7fd9b0c00640 1 -- 172.21.15.96:0/2544357899 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4038040 con 0x7fd9b4070d60 2024-04-24T23:58:45.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.264+0000 7fd9b0c00640 1 -- 172.21.15.96:0/2544357899 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a4033a50 con 0x7fd9b4070d60 2024-04-24T23:58:45.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.264+0000 7fd9b0c00640 1 -- 172.21.15.96:0/2544357899 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4033e40 con 0x7fd9b4070d60 2024-04-24T23:58:45.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.264+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b409bec0 con 0x7fd9b4070d60 2024-04-24T23:58:45.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.264+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b409c480 con 0x7fd9b4070d60 2024-04-24T23:58:45.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.265+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b4067e40 con 0x7fd9b4070d60 2024-04-24T23:58:45.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.266+0000 7fd9b0c00640 1 -- 172.21.15.96:0/2544357899 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9a4031530 con 0x7fd9b4070d60 2024-04-24T23:58:45.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.267+0000 7fd9b0c00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd99006be30 0x7fd99006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.267+0000 7fd9b0c00640 1 -- 172.21.15.96:0/2544357899 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd9a40abb10 con 0x7fd9b4070d60 2024-04-24T23:58:45.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.268+0000 7fd9ab400640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd99006be30 0x7fd99006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.269+0000 7fd9ab400640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd99006be30 0x7fd99006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd99c006fd0 tx=0x7fd99c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.272+0000 7fd9b0c00640 1 -- 172.21.15.96:0/2544357899 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd9b4149cc0 con 0x7fd9b4070d60 2024-04-24T23:58:45.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.469+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9b40756b0 con 0x7fd9b4070d60 2024-04-24T23:58:45.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.472+0000 7fd9b0c00640 1 -- 172.21.15.96:0/2544357899 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16557 (secure 0 0 0) 0x7fd9a407a4c0 con 0x7fd9b4070d60 2024-04-24T23:58:45.473 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:45.473 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:06.768779+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:45.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd99006be30 msgr2=0x7fd99006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd99006be30 0x7fd99006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd99c006fd0 tx=0x7fd99c008040 comp rx=0 tx=0).stop 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b4070d60 msgr2=0x7fd9b4149fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b4070d60 0x7fd9b4149fa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4000c00 tx=0x7fd9a40046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 shutdown_connections 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b41553f0 0x7fd9b415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b40cdbd0 0x7fd9b4149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd99006be30 0x7fd99006e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 --2- 172.21.15.96:0/2544357899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b4070d60 0x7fd9b4149fa0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 >> 172.21.15.96:0/2544357899 conn(0x7fd9b40b1f10 msgr2=0x7fd9b4154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.475+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 shutdown_connections 2024-04-24T23:58:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.476+0000 7fd9b9c00640 1 -- 172.21.15.96:0/2544357899 wait complete. 2024-04-24T23:58:45.495 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:45.495 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:45.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.701+0000 7fc20f000640 1 Processor -- start 2024-04-24T23:58:45.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.701+0000 7fc20f000640 1 -- start start 2024-04-24T23:58:45.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.703+0000 7fc20f000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2081446c0 0x7fc20806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.703+0000 7fc20f000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2080b36f0 con 0x7fc20815f160 2024-04-24T23:58:45.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.703+0000 7fc20f000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2080b39d0 con 0x7fc2080b4790 2024-04-24T23:58:45.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.703+0000 7fc20f000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc2080b4300 con 0x7fc2081446c0 2024-04-24T23:58:45.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.703+0000 7fc20dc00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2081446c0 0x7fc20806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.703+0000 7fc20e600640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc20815f160 0x7fc208070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36634/0 (socket says 172.21.15.96:36634) 2024-04-24T23:58:45.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.703+0000 7fc20e600640 1 -- 172.21.15.96:0/3741652933 learned_addr learned my addr 172.21.15.96:0/3741652933 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:45.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.704+0000 7fc20dc00640 1 -- 172.21.15.96:0/3741652933 >> v1:172.21.15.155:6789/0 conn(0x7fc2080b4790 legacy=0x7fc20815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:45.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.704+0000 7fc20dc00640 1 -- 172.21.15.96:0/3741652933 >> v1:172.21.15.96:6789/0 conn(0x7fc20815f160 legacy=0x7fc208070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.704+0000 7fc20dc00640 1 -- 172.21.15.96:0/3741652933 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2080b3cb0 con 0x7fc2081446c0 2024-04-24T23:58:45.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.704+0000 7fc207e00640 1 -- 172.21.15.96:0/3741652933 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458341246 0 0) 0x7fc2080b36f0 con 0x7fc20815f160 2024-04-24T23:58:45.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.705+0000 7fc20dc00640 1 --2- 172.21.15.96:0/3741652933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2081446c0 0x7fc20806e3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0097a0 tx=0x7fc1fc02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19901cbe225e2671 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:45.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.705+0000 7fc207e00640 1 -- 172.21.15.96:0/3741652933 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc037070 con 0x7fc2081446c0 2024-04-24T23:58:45.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.705+0000 7fc207e00640 1 -- 172.21.15.96:0/3741652933 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc02adc0 con 0x7fc2081446c0 2024-04-24T23:58:45.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.705+0000 7fc207e00640 1 -- 172.21.15.96:0/3741652933 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc032660 con 0x7fc2081446c0 2024-04-24T23:58:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.706+0000 7fc20f000640 1 -- 172.21.15.96:0/3741652933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2081446c0 msgr2=0x7fc20806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.706+0000 7fc20f000640 1 --2- 172.21.15.96:0/3741652933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2081446c0 0x7fc20806e3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0097a0 tx=0x7fc1fc02a0b0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.706+0000 7fc20f000640 1 -- 172.21.15.96:0/3741652933 shutdown_connections 2024-04-24T23:58:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.706+0000 7fc20f000640 1 --2- 172.21.15.96:0/3741652933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2081446c0 0x7fc20806e3c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.706+0000 7fc20f000640 1 -- 172.21.15.96:0/3741652933 >> 172.21.15.96:0/3741652933 conn(0x7fc2080b18b0 msgr2=0x7fc2080b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.706+0000 7fc20f000640 1 -- 172.21.15.96:0/3741652933 shutdown_connections 2024-04-24T23:58:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.706+0000 7fc20f000640 1 -- 172.21.15.96:0/3741652933 wait complete. 2024-04-24T23:58:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.708+0000 7fc20f000640 1 Processor -- start 2024-04-24T23:58:45.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.708+0000 7fc20f000640 1 -- start start 2024-04-24T23:58:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20f000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080b4790 0x7fc2080ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20f000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2081446c0 0x7fc20815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20f000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc20815f160 0x7fc2080cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20f000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc20815f7b0 con 0x7fc20815f160 2024-04-24T23:58:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20f000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc208144aa0 con 0x7fc2081446c0 2024-04-24T23:58:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20f000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc20806e900 con 0x7fc2080b4790 2024-04-24T23:58:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20e600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc20815f160 0x7fc2080cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20e600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc20815f160 0x7fc2080cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43948/0 (socket says 172.21.15.96:43948) 2024-04-24T23:58:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20e600640 1 -- 172.21.15.96:0/2311429949 learned_addr learned my addr 172.21.15.96:0/2311429949 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20dc00640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080b4790 0x7fc2080ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20d200640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2081446c0 0x7fc20815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20e600640 1 -- 172.21.15.96:0/2311429949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080b4790 msgr2=0x7fc2080ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20e600640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080b4790 0x7fc2080ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20e600640 1 -- 172.21.15.96:0/2311429949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2081446c0 msgr2=0x7fc20815a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.709+0000 7fc20e600640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2081446c0 0x7fc20815a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.710+0000 7fc20e600640 1 -- 172.21.15.96:0/2311429949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2080ce7f0 con 0x7fc20815f160 2024-04-24T23:58:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.710+0000 7fc20d200640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2081446c0 0x7fc20815a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.710+0000 7fc20e600640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc20815f160 0x7fc2080cebf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c780 tx=0x7fc20000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.710+0000 7fc205600640 1 -- 172.21.15.96:0/2311429949 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200018070 con 0x7fc20815f160 2024-04-24T23:58:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.710+0000 7fc205600640 1 -- 172.21.15.96:0/2311429949 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc200004d60 con 0x7fc20815f160 2024-04-24T23:58:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.710+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2080cd4f0 con 0x7fc20815f160 2024-04-24T23:58:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.710+0000 7fc205600640 1 -- 172.21.15.96:0/2311429949 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20000a880 con 0x7fc20815f160 2024-04-24T23:58:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.710+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2080cdab0 con 0x7fc20815f160 2024-04-24T23:58:45.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.711+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2080755d0 con 0x7fc20815f160 2024-04-24T23:58:45.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.712+0000 7fc205600640 1 -- 172.21.15.96:0/2311429949 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc20001b070 con 0x7fc20815f160 2024-04-24T23:58:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.713+0000 7fc205600640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc1e806be30 0x7fc1e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.713+0000 7fc205600640 1 -- 172.21.15.96:0/2311429949 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc20008a270 con 0x7fc20815f160 2024-04-24T23:58:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.713+0000 7fc20dc00640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc1e806be30 0x7fc1e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.714+0000 7fc20dc00640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc1e806be30 0x7fc1e806e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc034000 tx=0x7fc1fc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:45.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.717+0000 7fc205600640 1 -- 172.21.15.96:0/2311429949 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc200058cb0 con 0x7fc20815f160 2024-04-24T23:58:45.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.920+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc2080cc180 con 0x7fc20815f160 2024-04-24T23:58:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.921+0000 7fc205600640 1 -- 172.21.15.96:0/2311429949 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc2000585b0 con 0x7fc20815f160 2024-04-24T23:58:45.921 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:45.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc1e806be30 msgr2=0x7fc1e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc1e806be30 0x7fc1e806e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc034000 tx=0x7fc1fc02e000 comp rx=0 tx=0).stop 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc20815f160 msgr2=0x7fc2080cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc20815f160 0x7fc2080cebf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c780 tx=0x7fc20000cc40 comp rx=0 tx=0).stop 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 shutdown_connections 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc1e806be30 0x7fc1e806e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc20815f160 0x7fc2080cebf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2081446c0 0x7fc20815a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 --2- 172.21.15.96:0/2311429949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080b4790 0x7fc2080ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 >> 172.21.15.96:0/2311429949 conn(0x7fc2080b18b0 msgr2=0x7fc20806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 shutdown_connections 2024-04-24T23:58:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:45.923+0000 7fc20f000640 1 -- 172.21.15.96:0/2311429949 wait complete. 2024-04-24T23:58:45.942 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:46.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.147+0000 7fd98f200640 1 Processor -- start 2024-04-24T23:58:46.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.147+0000 7fd98f200640 1 -- start start 2024-04-24T23:58:46.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.149+0000 7fd98f200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd99015f2b0 0x7fd99006ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.149+0000 7fd98f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.149+0000 7fd98f200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd990071700 con 0x7fd99006d930 2024-04-24T23:58:46.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.149+0000 7fd98f200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd9900719e0 con 0x7fd99015f2b0 2024-04-24T23:58:46.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.149+0000 7fd98f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd990071cc0 con 0x7fd9900b4630 2024-04-24T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.149+0000 7fd98e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.150+0000 7fd98e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:58416/0 (socket says 172.21.15.96:58416) 2024-04-24T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.150+0000 7fd98e800640 1 -- 172.21.15.96:0/279054485 learned_addr learned my addr 172.21.15.96:0/279054485 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.150+0000 7fd98d400640 1 --2- 172.21.15.96:0/279054485 >> v2:172.21.15.155:3300/0 conn(0x7fd99015f2b0 0x7fd99006ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.150+0000 7fd98d400640 1 -- 172.21.15.96:0/279054485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 msgr2=0x7fd9900b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.150+0000 7fd98d400640 1 --2- 172.21.15.96:0/279054485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.150+0000 7fd98d400640 1 -- 172.21.15.96:0/279054485 >> v1:172.21.15.155:6789/0 conn(0x7fd99006d930 legacy=0x7fd990070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.150+0000 7fd98d400640 1 -- 172.21.15.96:0/279054485 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9900b3230 con 0x7fd99015f2b0 2024-04-24T23:58:46.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.152+0000 7fd98d400640 1 --2- 172.21.15.96:0/279054485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99015f2b0 0x7fd99006ca20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0097a0 tx=0x7fd97c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d84bbb48c6bdec75 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:46.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.152+0000 7fd98ca00640 1 -- 172.21.15.96:0/279054485 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c037070 con 0x7fd99015f2b0 2024-04-24T23:58:46.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.152+0000 7fd98ca00640 1 -- 172.21.15.96:0/279054485 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97c032440 con 0x7fd99015f2b0 2024-04-24T23:58:46.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.152+0000 7fd98ca00640 1 -- 172.21.15.96:0/279054485 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c032810 con 0x7fd99015f2b0 2024-04-24T23:58:46.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.153+0000 7fd98f200640 1 -- 172.21.15.96:0/279054485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99015f2b0 msgr2=0x7fd99006ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.153+0000 7fd98f200640 1 --2- 172.21.15.96:0/279054485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99015f2b0 0x7fd99006ca20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0097a0 tx=0x7fd97c02a210 comp rx=0 tx=0).stop 2024-04-24T23:58:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.153+0000 7fd98f200640 1 -- 172.21.15.96:0/279054485 shutdown_connections 2024-04-24T23:58:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.153+0000 7fd98f200640 1 --2- 172.21.15.96:0/279054485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.153+0000 7fd98f200640 1 --2- 172.21.15.96:0/279054485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99015f2b0 0x7fd99006ca20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.153+0000 7fd98f200640 1 -- 172.21.15.96:0/279054485 >> 172.21.15.96:0/279054485 conn(0x7fd9900b18b0 msgr2=0x7fd9900b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.153+0000 7fd98f200640 1 -- 172.21.15.96:0/279054485 shutdown_connections 2024-04-24T23:58:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.153+0000 7fd98f200640 1 -- 172.21.15.96:0/279054485 wait complete. 2024-04-24T23:58:46.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.155+0000 7fd98f200640 1 Processor -- start 2024-04-24T23:58:46.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.156+0000 7fd98f200640 1 -- start start 2024-04-24T23:58:46.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99006d930 0x7fd99014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98f200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd99015f2b0 0x7fd990148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98f200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd99006de90 con 0x7fd99015f2b0 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd99006dd10 con 0x7fd99006d930 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd9900b2dc0 con 0x7fd9900b4630 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98e800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd99015f2b0 0x7fd990148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98e800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd99015f2b0 0x7fd990148220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43964/0 (socket says 172.21.15.96:43964) 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98e800640 1 -- 172.21.15.96:0/2137586198 learned_addr learned my addr 172.21.15.96:0/2137586198 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98de00640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99006d930 0x7fd99014b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.157+0000 7fd98d400640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd98e800640 1 -- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 msgr2=0x7fd9900afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd98e800640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd98e800640 1 -- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99006d930 msgr2=0x7fd99014b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd98e800640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99006d930 0x7fd99014b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd98e800640 1 -- 172.21.15.96:0/2137586198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9900b05c0 con 0x7fd99015f2b0 2024-04-24T23:58:46.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd98de00640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99006d930 0x7fd99014b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:46.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd98d400640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd98e800640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd99015f2b0 0x7fd990148220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd98800efc0 tx=0x7fd98800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd986000640 1 -- 172.21.15.96:0/2137586198 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98800ccc0 con 0x7fd99015f2b0 2024-04-24T23:58:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd986000640 1 -- 172.21.15.96:0/2137586198 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd988003990 con 0x7fd99015f2b0 2024-04-24T23:58:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd986000640 1 -- 172.21.15.96:0/2137586198 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98800ce60 con 0x7fd99015f2b0 2024-04-24T23:58:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.158+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9900b08a0 con 0x7fd99015f2b0 2024-04-24T23:58:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.159+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd990148d10 con 0x7fd99015f2b0 2024-04-24T23:58:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.160+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9900b0dc0 con 0x7fd99015f2b0 2024-04-24T23:58:46.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.161+0000 7fd986000640 1 -- 172.21.15.96:0/2137586198 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd988012050 con 0x7fd99015f2b0 2024-04-24T23:58:46.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.162+0000 7fd986000640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd97006be30 0x7fd97006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.162+0000 7fd986000640 1 -- 172.21.15.96:0/2137586198 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd98808b2b0 con 0x7fd99015f2b0 2024-04-24T23:58:46.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.162+0000 7fd98de00640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd97006be30 0x7fd97006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.163+0000 7fd98de00640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd97006be30 0x7fd97006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd980001660 tx=0x7fd980009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:46.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.166+0000 7fd986000640 1 -- 172.21.15.96:0/2137586198 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd9900b0dc0 con 0x7fd99015f2b0 2024-04-24T23:58:46.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.369+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd9900755d0 con 0x7fd99015f2b0 2024-04-24T23:58:46.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.370+0000 7fd986000640 1 -- 172.21.15.96:0/2137586198 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fd988010040 con 0x7fd99015f2b0 2024-04-24T23:58:46.370 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:46.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd97006be30 msgr2=0x7fd97006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd97006be30 0x7fd97006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd980001660 tx=0x7fd980009040 comp rx=0 tx=0).stop 2024-04-24T23:58:46.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd99015f2b0 msgr2=0x7fd990148220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd99015f2b0 0x7fd990148220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd98800efc0 tx=0x7fd98800c490 comp rx=0 tx=0).stop 2024-04-24T23:58:46.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 shutdown_connections 2024-04-24T23:58:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd97006be30 0x7fd97006e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd99015f2b0 0x7fd990148220 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9900b4630 0x7fd9900afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 --2- 172.21.15.96:0/2137586198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd99006d930 0x7fd99014b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 >> 172.21.15.96:0/2137586198 conn(0x7fd9900b18b0 msgr2=0x7fd9900ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 shutdown_connections 2024-04-24T23:58:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.373+0000 7fd98f200640 1 -- 172.21.15.96:0/2137586198 wait complete. 2024-04-24T23:58:46.391 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:46.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.584+0000 7f583ca00640 1 Processor -- start 2024-04-24T23:58:46.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.584+0000 7f583ca00640 1 -- start start 2024-04-24T23:58:46.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.586+0000 7f583ca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380d15c0 0x7f58380afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.586+0000 7f583ca00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58380aff80 0x7f583815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.586+0000 7f583ca00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5838161b40 con 0x7f583815dfd0 2024-04-24T23:58:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.586+0000 7f583ca00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5838161e20 con 0x7f58380aff80 2024-04-24T23:58:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.586+0000 7f583ca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5838162100 con 0x7f58380d15c0 2024-04-24T23:58:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.587+0000 7f582de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380d15c0 0x7f58380afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.587+0000 7f582de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380d15c0 0x7f58380afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:58446/0 (socket says 172.21.15.96:58446) 2024-04-24T23:58:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.587+0000 7f582de00640 1 -- 172.21.15.96:0/692657941 learned_addr learned my addr 172.21.15.96:0/692657941 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.587+0000 7f5836800640 1 --1- 172.21.15.96:0/692657941 >> v1:172.21.15.155:6789/0 conn(0x7f583815dfd0 0x7f58380d0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:41956/0 (socket says 172.21.15.96:41956) 2024-04-24T23:58:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.587+0000 7f5837200640 1 --2- 172.21.15.96:0/692657941 >> v2:172.21.15.155:3300/0 conn(0x7f58380aff80 0x7f583815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.588+0000 7f582de00640 1 -- 172.21.15.96:0/692657941 >> v2:172.21.15.155:3300/0 conn(0x7f58380aff80 msgr2=0x7f583815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.588+0000 7f582de00640 1 --2- 172.21.15.96:0/692657941 >> v2:172.21.15.155:3300/0 conn(0x7f58380aff80 0x7f583815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.588+0000 7f582de00640 1 -- 172.21.15.96:0/692657941 >> v1:172.21.15.155:6789/0 conn(0x7f583815dfd0 legacy=0x7f58380d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.588+0000 7f582de00640 1 -- 172.21.15.96:0/692657941 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58381623e0 con 0x7f58380d15c0 2024-04-24T23:58:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.588+0000 7f5837200640 1 --2- 172.21.15.96:0/692657941 >> v2:172.21.15.155:3300/0 conn(0x7f58380aff80 0x7f583815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:58:46.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.589+0000 7f582de00640 1 --2- 172.21.15.96:0/692657941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380d15c0 0x7f58380afa40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5820009870 tx=0x7f582002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1ecc21b15c6b080 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.590+0000 7f5835e00640 1 -- 172.21.15.96:0/692657941 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820037070 con 0x7f58380d15c0 2024-04-24T23:58:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.590+0000 7f5835e00640 1 -- 172.21.15.96:0/692657941 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5820032440 con 0x7f58380d15c0 2024-04-24T23:58:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.590+0000 7f5835e00640 1 -- 172.21.15.96:0/692657941 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820032810 con 0x7f58380d15c0 2024-04-24T23:58:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.591+0000 7f583ca00640 1 -- 172.21.15.96:0/692657941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380d15c0 msgr2=0x7f58380afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.591+0000 7f583ca00640 1 --2- 172.21.15.96:0/692657941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380d15c0 0x7f58380afa40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5820009870 tx=0x7f582002a1c0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.591+0000 7f583ca00640 1 -- 172.21.15.96:0/692657941 shutdown_connections 2024-04-24T23:58:46.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.591+0000 7f583ca00640 1 --2- 172.21.15.96:0/692657941 >> v2:172.21.15.155:3300/0 conn(0x7f58380aff80 0x7f583815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.591+0000 7f583ca00640 1 --2- 172.21.15.96:0/692657941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380d15c0 0x7f58380afa40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.591+0000 7f583ca00640 1 -- 172.21.15.96:0/692657941 >> 172.21.15.96:0/692657941 conn(0x7f583806c3b0 msgr2=0x7f583806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:46.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.591+0000 7f583ca00640 1 -- 172.21.15.96:0/692657941 shutdown_connections 2024-04-24T23:58:46.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.591+0000 7f583ca00640 1 -- 172.21.15.96:0/692657941 wait complete. 2024-04-24T23:58:46.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.593+0000 7f583ca00640 1 Processor -- start 2024-04-24T23:58:46.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.593+0000 7f583ca00640 1 -- start start 2024-04-24T23:58:46.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f583ca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380aff80 0x7f583815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f583ca00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58380d15c0 0x7f58381456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f583ca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815dfd0 0x7f583815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f583ca00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f583806ddd0 con 0x7f58380d15c0 2024-04-24T23:58:46.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f583ca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f583806dc50 con 0x7f583815dfd0 2024-04-24T23:58:46.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f583ca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58380b03f0 con 0x7f58380aff80 2024-04-24T23:58:46.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f582de00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58380d15c0 0x7f58381456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f582de00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58380d15c0 0x7f58381456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43974/0 (socket says 172.21.15.96:43974) 2024-04-24T23:58:46.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f582de00640 1 -- 172.21.15.96:0/743401903 learned_addr learned my addr 172.21.15.96:0/743401903 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:46.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f5836800640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380aff80 0x7f583815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.594+0000 7f5837200640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815dfd0 0x7f583815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f582de00640 1 -- 172.21.15.96:0/743401903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380aff80 msgr2=0x7f583815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f582de00640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380aff80 0x7f583815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f582de00640 1 -- 172.21.15.96:0/743401903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815dfd0 msgr2=0x7f583815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f582de00640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815dfd0 0x7f583815ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f582de00640 1 -- 172.21.15.96:0/743401903 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5838145c00 con 0x7f58380d15c0 2024-04-24T23:58:46.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f582de00640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58380d15c0 0x7f58381456c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5820000c00 tx=0x7f58200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:46.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f582f400640 1 -- 172.21.15.96:0/743401903 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820037040 con 0x7f58380d15c0 2024-04-24T23:58:46.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f582f400640 1 -- 172.21.15.96:0/743401903 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5820042070 con 0x7f58380d15c0 2024-04-24T23:58:46.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583815d470 con 0x7f58380d15c0 2024-04-24T23:58:46.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f582f400640 1 -- 172.21.15.96:0/743401903 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820030880 con 0x7f58380d15c0 2024-04-24T23:58:46.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.595+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5838158450 con 0x7f58380d15c0 2024-04-24T23:58:46.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.597+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58380755d0 con 0x7f58380d15c0 2024-04-24T23:58:46.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.597+0000 7f582f400640 1 -- 172.21.15.96:0/743401903 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f582002ad10 con 0x7f58380d15c0 2024-04-24T23:58:46.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.599+0000 7f582f400640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f581406be30 0x7f581406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:46.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.599+0000 7f582f400640 1 -- 172.21.15.96:0/743401903 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58200ab3f0 con 0x7f58380d15c0 2024-04-24T23:58:46.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.599+0000 7f5836800640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f581406be30 0x7f581406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:46.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.600+0000 7f5836800640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f581406be30 0x7f581406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5828000f60 tx=0x7f5828007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:46.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.603+0000 7f582f400640 1 -- 172.21.15.96:0/743401903 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5820079d90 con 0x7f58380d15c0 2024-04-24T23:58:46.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.798+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f58380b55e0 con 0x7f58380d15c0 2024-04-24T23:58:46.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.799+0000 7f582f400640 1 -- 172.21.15.96:0/743401903 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f5820079690 con 0x7f58380d15c0 2024-04-24T23:58:46.799 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f581406be30 msgr2=0x7f581406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f581406be30 0x7f581406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5828000f60 tx=0x7f5828007cc0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58380d15c0 msgr2=0x7f58381456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58380d15c0 0x7f58381456c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5820000c00 tx=0x7f58200046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 shutdown_connections 2024-04-24T23:58:46.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815dfd0 0x7f583815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f581406be30 0x7f581406e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58380d15c0 0x7f58381456c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 --2- 172.21.15.96:0/743401903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380aff80 0x7f583815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:46.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 >> 172.21.15.96:0/743401903 conn(0x7f583806c3b0 msgr2=0x7f58380d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:46.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 shutdown_connections 2024-04-24T23:58:46.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:46.802+0000 7f583ca00640 1 -- 172.21.15.96:0/743401903 wait complete. 2024-04-24T23:58:46.821 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-04-24T23:58:47.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.021+0000 7f9338a00640 1 Processor -- start 2024-04-24T23:58:47.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.021+0000 7f9338a00640 1 -- start start 2024-04-24T23:58:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9338a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f933415f450 0x7f93340b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9338a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93340b4590 0x7f93340b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9338a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93340b4ee0 con 0x7f93341551c0 2024-04-24T23:58:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9338a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f93340b3960 con 0x7f933415f450 2024-04-24T23:58:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9338a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f93340b3070 con 0x7f93340b4590 2024-04-24T23:58:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9331400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f933415f450 0x7f93340b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9331e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f93341551c0 0x7f9334070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55282/0 (socket says 172.21.15.96:55282) 2024-04-24T23:58:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9331e00640 1 -- 172.21.15.96:0/1487971082 learned_addr learned my addr 172.21.15.96:0/1487971082 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:47.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9332800640 1 --2- 172.21.15.96:0/1487971082 >> v2:172.21.15.155:3300/0 conn(0x7f93340b4590 0x7f93340b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:47.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.023+0000 7f9330a00640 1 -- 172.21.15.96:0/1487971082 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793463749 0 0) 0x7f9324001110 con 0x7f93341551c0 2024-04-24T23:58:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.024+0000 7f9330a00640 1 -- 172.21.15.96:0/1487971082 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9318003520 con 0x7f93341551c0 2024-04-24T23:58:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.024+0000 7f9331400640 1 -- 172.21.15.96:0/1487971082 >> v2:172.21.15.155:3300/0 conn(0x7f93340b4590 msgr2=0x7f93340b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.024+0000 7f9331400640 1 --2- 172.21.15.96:0/1487971082 >> v2:172.21.15.155:3300/0 conn(0x7f93340b4590 0x7f93340b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.024+0000 7f9331400640 1 -- 172.21.15.96:0/1487971082 >> v1:172.21.15.96:6789/0 conn(0x7f93341551c0 legacy=0x7f9334070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.024+0000 7f9331400640 1 -- 172.21.15.96:0/1487971082 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93340b3310 con 0x7f933415f450 2024-04-24T23:58:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.024+0000 7f9332800640 1 --2- 172.21.15.96:0/1487971082 >> v2:172.21.15.155:3300/0 conn(0x7f93340b4590 0x7f93340b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:47.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.025+0000 7f9331400640 1 --2- 172.21.15.96:0/1487971082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f933415f450 0x7f93340b3df0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f93340b3ae0 tx=0x7f932002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4467191887a61758 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:47.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.025+0000 7f9330a00640 1 -- 172.21.15.96:0/1487971082 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320037070 con 0x7f933415f450 2024-04-24T23:58:47.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.025+0000 7f9330a00640 1 -- 172.21.15.96:0/1487971082 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9320032440 con 0x7f933415f450 2024-04-24T23:58:47.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.025+0000 7f9330a00640 1 -- 172.21.15.96:0/1487971082 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932002ae60 con 0x7f933415f450 2024-04-24T23:58:47.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.026+0000 7f9338a00640 1 -- 172.21.15.96:0/1487971082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f933415f450 msgr2=0x7f93340b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.026+0000 7f9338a00640 1 --2- 172.21.15.96:0/1487971082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f933415f450 0x7f93340b3df0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f93340b3ae0 tx=0x7f932002a110 comp rx=0 tx=0).stop 2024-04-24T23:58:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.026+0000 7f9338a00640 1 -- 172.21.15.96:0/1487971082 shutdown_connections 2024-04-24T23:58:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.026+0000 7f9338a00640 1 --2- 172.21.15.96:0/1487971082 >> v2:172.21.15.155:3300/0 conn(0x7f93340b4590 0x7f93340b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.026+0000 7f9338a00640 1 --2- 172.21.15.96:0/1487971082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f933415f450 0x7f93340b3df0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.026+0000 7f9338a00640 1 -- 172.21.15.96:0/1487971082 >> 172.21.15.96:0/1487971082 conn(0x7f93340b19c0 msgr2=0x7f93340b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.026+0000 7f9338a00640 1 -- 172.21.15.96:0/1487971082 shutdown_connections 2024-04-24T23:58:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.026+0000 7f9338a00640 1 -- 172.21.15.96:0/1487971082 wait complete. 2024-04-24T23:58:47.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.028+0000 7f9338a00640 1 Processor -- start 2024-04-24T23:58:47.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.028+0000 7f9338a00640 1 -- start start 2024-04-24T23:58:47.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.029+0000 7f9338a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93340b4590 0x7f933414fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.029+0000 7f9338a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93341551c0 0x7f9334156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.029+0000 7f9338a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f933415f450 0x7f9334153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.029+0000 7f9338a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f93341555a0 con 0x7f93340b4590 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.029+0000 7f9338a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9334071500 con 0x7f93341551c0 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.029+0000 7f9338a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9334155720 con 0x7f933415f450 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.029+0000 7f9331e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93340b4590 0x7f933414fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.029+0000 7f9331e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93340b4590 0x7f933414fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59566/0 (socket says 172.21.15.96:59566) 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.029+0000 7f9331e00640 1 -- 172.21.15.96:0/1068206418 learned_addr learned my addr 172.21.15.96:0/1068206418 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9331400640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93341551c0 0x7f9334156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9332800640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f933415f450 0x7f9334153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9331e00640 1 -- 172.21.15.96:0/1068206418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f933415f450 msgr2=0x7f9334153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9331e00640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f933415f450 0x7f9334153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:47.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9331e00640 1 -- 172.21.15.96:0/1068206418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93341551c0 msgr2=0x7f9334156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:47.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9331e00640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93341551c0 0x7f9334156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:47.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9331e00640 1 -- 172.21.15.96:0/1068206418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93341501c0 con 0x7f93340b4590 2024-04-24T23:58:47.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9331400640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93341551c0 0x7f9334156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:47.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9331e00640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93340b4590 0x7f933414fc80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f932400c760 tx=0x7f932400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:47.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f932a000640 1 -- 172.21.15.96:0/1068206418 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324017070 con 0x7f93340b4590 2024-04-24T23:58:47.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f932a000640 1 -- 172.21.15.96:0/1068206418 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9324005ad0 con 0x7f93340b4590 2024-04-24T23:58:47.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f932a000640 1 -- 172.21.15.96:0/1068206418 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324007e20 con 0x7f93340b4590 2024-04-24T23:58:47.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.030+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93341570f0 con 0x7f93340b4590 2024-04-24T23:58:47.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.031+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93341576b0 con 0x7f93340b4590 2024-04-24T23:58:47.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.032+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9334069110 con 0x7f93340b4590 2024-04-24T23:58:47.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.032+0000 7f932a000640 1 -- 172.21.15.96:0/1068206418 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f932401a070 con 0x7f93340b4590 2024-04-24T23:58:47.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.033+0000 7f932a000640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f931406be30 0x7f931406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:47.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.033+0000 7f932a000640 1 -- 172.21.15.96:0/1068206418 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f932408a230 con 0x7f93340b4590 2024-04-24T23:58:47.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.034+0000 7f9331400640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f931406be30 0x7f931406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:47.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.034+0000 7f9331400640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f931406be30 0x7f931406e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9320034000 tx=0x7f932002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:47.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.038+0000 7f932a000640 1 -- 172.21.15.96:0/1068206418 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f93340b4ee0 con 0x7f93340b4590 2024-04-24T23:58:47.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:47.320+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7f93340b29d0 con 0x7f93340b4590 2024-04-24T23:58:48.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.273+0000 7f932a000640 1 -- 172.21.15.96:0/1068206418 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v60) ==== 170+0+0 (secure 0 0 0) 0x7f9324058bd0 con 0x7f93340b4590 2024-04-24T23:58:48.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f931406be30 msgr2=0x7f931406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:48.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f931406be30 0x7f931406e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9320034000 tx=0x7f932002e000 comp rx=0 tx=0).stop 2024-04-24T23:58:48.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93340b4590 msgr2=0x7f933414fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:48.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93340b4590 0x7f933414fc80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f932400c760 tx=0x7f932400cc20 comp rx=0 tx=0).stop 2024-04-24T23:58:48.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 shutdown_connections 2024-04-24T23:58:48.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f933415f450 0x7f9334153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93341551c0 0x7f9334156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f931406be30 0x7f931406e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 --2- 172.21.15.96:0/1068206418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93340b4590 0x7f933414fc80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.277+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 >> 172.21.15.96:0/1068206418 conn(0x7f93340b19c0 msgr2=0x7f933406da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:48.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.278+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 shutdown_connections 2024-04-24T23:58:48.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.278+0000 7f9338a00640 1 -- 172.21.15.96:0/1068206418 wait complete. 2024-04-24T23:58:48.301 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-24T23:58:48.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.493+0000 7f869b200640 1 Processor -- start 2024-04-24T23:58:48.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.493+0000 7f869b200640 1 -- start start 2024-04-24T23:58:48.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.495+0000 7f869b200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f869c15df10 0x7f869c06ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:48.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.495+0000 7f869b200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f869c162340 0x7f869c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:48.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.495+0000 7f869b200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f869c06d540 con 0x7f869c15e2f0 2024-04-24T23:58:48.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.495+0000 7f869b200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f869c06d820 con 0x7f869c15df10 2024-04-24T23:58:48.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.495+0000 7f869b200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f869c06db00 con 0x7f869c162340 2024-04-24T23:58:48.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.496+0000 7f8699e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f869c15df10 0x7f869c06ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:48.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.496+0000 7f8699e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f869c15df10 0x7f869c06ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59568/0 (socket says 172.21.15.96:59568) 2024-04-24T23:58:48.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.496+0000 7f8699e00640 1 -- 172.21.15.96:0/502322603 learned_addr learned my addr 172.21.15.96:0/502322603 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:48.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.496+0000 7f8699e00640 1 -- 172.21.15.96:0/502322603 >> v2:172.21.15.155:3300/0 conn(0x7f869c162340 msgr2=0x7f869c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:48.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.496+0000 7f8699e00640 1 --2- 172.21.15.96:0/502322603 >> v2:172.21.15.155:3300/0 conn(0x7f869c162340 0x7f869c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.496+0000 7f8699e00640 1 -- 172.21.15.96:0/502322603 >> v1:172.21.15.155:6789/0 conn(0x7f869c15e2f0 legacy=0x7f869c161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:48.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.496+0000 7f8699e00640 1 -- 172.21.15.96:0/502322603 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869c06dde0 con 0x7f869c15df10 2024-04-24T23:58:48.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.497+0000 7f8699e00640 1 --2- 172.21.15.96:0/502322603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c15df10 0x7f869c06ce80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f869c0b4a30 tx=0x7f868c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d96030b70feeca server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:48.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.497+0000 7f8698a00640 1 -- 172.21.15.96:0/502322603 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c037070 con 0x7f869c15df10 2024-04-24T23:58:48.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.497+0000 7f8698a00640 1 -- 172.21.15.96:0/502322603 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c032440 con 0x7f869c15df10 2024-04-24T23:58:48.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.497+0000 7f8698a00640 1 -- 172.21.15.96:0/502322603 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c032810 con 0x7f869c15df10 2024-04-24T23:58:48.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.498+0000 7f869b200640 1 -- 172.21.15.96:0/502322603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c15df10 msgr2=0x7f869c06ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:48.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.498+0000 7f869b200640 1 --2- 172.21.15.96:0/502322603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c15df10 0x7f869c06ce80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f869c0b4a30 tx=0x7f868c02a230 comp rx=0 tx=0).stop 2024-04-24T23:58:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.498+0000 7f869b200640 1 -- 172.21.15.96:0/502322603 shutdown_connections 2024-04-24T23:58:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.498+0000 7f869b200640 1 --2- 172.21.15.96:0/502322603 >> v2:172.21.15.155:3300/0 conn(0x7f869c162340 0x7f869c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.498+0000 7f869b200640 1 --2- 172.21.15.96:0/502322603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c15df10 0x7f869c06ce80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.498+0000 7f869b200640 1 -- 172.21.15.96:0/502322603 >> 172.21.15.96:0/502322603 conn(0x7f869c0b1740 msgr2=0x7f869c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.498+0000 7f869b200640 1 -- 172.21.15.96:0/502322603 shutdown_connections 2024-04-24T23:58:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.498+0000 7f869b200640 1 -- 172.21.15.96:0/502322603 wait complete. 2024-04-24T23:58:48.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.500+0000 7f869b200640 1 Processor -- start 2024-04-24T23:58:48.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.500+0000 7f869b200640 1 -- start start 2024-04-24T23:58:48.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.501+0000 7f869b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f869c15df10 0x7f869c15e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:48.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.501+0000 7f869b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f869c15e2f0 0x7f869c150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:48.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.501+0000 7f869b200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c162340 0x7f869c15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:48.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.501+0000 7f869b200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f869c1627a0 con 0x7f869c162340 2024-04-24T23:58:48.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.501+0000 7f869b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f869c0b4c50 con 0x7f869c15e2f0 2024-04-24T23:58:48.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.501+0000 7f869b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f869c162920 con 0x7f869c15df10 2024-04-24T23:58:48.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.501+0000 7f869a800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c162340 0x7f869c15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:48.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.501+0000 7f869a800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c162340 0x7f869c15efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59584/0 (socket says 172.21.15.96:59584) 2024-04-24T23:58:48.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.501+0000 7f869a800640 1 -- 172.21.15.96:0/1614973927 learned_addr learned my addr 172.21.15.96:0/1614973927 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:48.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f8699e00640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f869c15df10 0x7f869c15e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:48.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f869a800640 1 -- 172.21.15.96:0/1614973927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f869c15df10 msgr2=0x7f869c15e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:48.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f869a800640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f869c15df10 0x7f869c15e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f8699400640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f869c15e2f0 0x7f869c150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:48.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f869a800640 1 -- 172.21.15.96:0/1614973927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f869c15e2f0 msgr2=0x7f869c150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:48.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f869a800640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f869c15e2f0 0x7f869c150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f869a800640 1 -- 172.21.15.96:0/1614973927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869c156f70 con 0x7f869c162340 2024-04-24T23:58:48.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f869a800640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c162340 0x7f869c15efb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f869400b970 tx=0x7f869400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:48.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f8692000640 1 -- 172.21.15.96:0/1614973927 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694019070 con 0x7f869c162340 2024-04-24T23:58:48.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f8692000640 1 -- 172.21.15.96:0/1614973927 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869400cb60 con 0x7f869c162340 2024-04-24T23:58:48.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f869c1e85a0 con 0x7f869c162340 2024-04-24T23:58:48.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.502+0000 7f8692000640 1 -- 172.21.15.96:0/1614973927 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694014440 con 0x7f869c162340 2024-04-24T23:58:48.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.503+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f869c157230 con 0x7f869c162340 2024-04-24T23:58:48.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.504+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f869c157430 con 0x7f869c162340 2024-04-24T23:58:48.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.505+0000 7f8692000640 1 -- 172.21.15.96:0/1614973927 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f869401c070 con 0x7f869c162340 2024-04-24T23:58:48.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.506+0000 7f8692000640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f867c06be30 0x7f867c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:48.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.506+0000 7f8692000640 1 -- 172.21.15.96:0/1614973927 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f869408acc0 con 0x7f869c162340 2024-04-24T23:58:48.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.506+0000 7f8699e00640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f867c06be30 0x7f867c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:48.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.507+0000 7f8699e00640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f867c06be30 0x7f867c06e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f868c034000 tx=0x7f868c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:48.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.510+0000 7f8692000640 1 -- 172.21.15.96:0/1614973927 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8694091080 con 0x7f869c162340 2024-04-24T23:58:48.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.707+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f869c071050 con 0x7f869c162340 2024-04-24T23:58:48.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.712+0000 7f8692000640 1 -- 172.21.15.96:0/1614973927 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f8694059540 con 0x7f869c162340 2024-04-24T23:58:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f867c06be30 msgr2=0x7f867c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f867c06be30 0x7f867c06e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f868c034000 tx=0x7f868c02e000 comp rx=0 tx=0).stop 2024-04-24T23:58:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c162340 msgr2=0x7f869c15efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c162340 0x7f869c15efb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f869400b970 tx=0x7f869400be30 comp rx=0 tx=0).stop 2024-04-24T23:58:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 shutdown_connections 2024-04-24T23:58:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f867c06be30 0x7f867c06e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f869c162340 0x7f869c15efb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f869c15e2f0 0x7f869c150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 --2- 172.21.15.96:0/1614973927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f869c15df10 0x7f869c15e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 >> 172.21.15.96:0/1614973927 conn(0x7f869c0b1740 msgr2=0x7f869c0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 shutdown_connections 2024-04-24T23:58:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:48.715+0000 7f869b200640 1 -- 172.21.15.96:0/1614973927 wait complete. 2024-04-24T23:58:48.734 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:58:48.734 DEBUG:teuthology.orchestra.run.smithi096:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:58:48.834 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:58:48.944 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:58:48.945 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:58:48.945 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:49.003 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:58:49.004 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:49.059 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:58:49.059 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:49.110 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.358+0000 7fe11ec00640 1 Processor -- start 2024-04-24T23:58:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.358+0000 7fe11ec00640 1 -- start start 2024-04-24T23:58:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.359+0000 7fe11ec00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe11815e0f0 0x7fe1180b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.359+0000 7fe11ec00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe11815e4d0 0x7fe118162770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.359+0000 7fe11ec00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1180aff90 con 0x7fe11806f880 2024-04-24T23:58:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.359+0000 7fe11ec00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe1180b5ad0 con 0x7fe11815e0f0 2024-04-24T23:58:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.359+0000 7fe11ec00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe1180b5d00 con 0x7fe11815e4d0 2024-04-24T23:58:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.360+0000 7fe11d800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe11815e0f0 0x7fe1180b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.360+0000 7fe11d800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe11815e0f0 0x7fe1180b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59588/0 (socket says 172.21.15.96:59588) 2024-04-24T23:58:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.360+0000 7fe11d800640 1 -- 172.21.15.96:0/3741789787 learned_addr learned my addr 172.21.15.96:0/3741789787 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.360+0000 7fe11d800640 1 -- 172.21.15.96:0/3741789787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe11815e4d0 msgr2=0x7fe118162770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.360+0000 7fe11d800640 1 --2- 172.21.15.96:0/3741789787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe11815e4d0 0x7fe118162770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.360+0000 7fe11d800640 1 -- 172.21.15.96:0/3741789787 >> v1:172.21.15.155:6789/0 conn(0x7fe11806f880 legacy=0x7fe1180d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.360+0000 7fe11d800640 1 -- 172.21.15.96:0/3741789787 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1180b6280 con 0x7fe11815e0f0 2024-04-24T23:58:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.361+0000 7fe11d800640 1 --2- 172.21.15.96:0/3741789787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11815e0f0 0x7fe1180b03c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe1180d1ef0 tx=0x7fe10c02a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e4488b451cc358 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe117e00640 1 -- 172.21.15.96:0/3741789787 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c037070 con 0x7fe11815e0f0 2024-04-24T23:58:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe117e00640 1 -- 172.21.15.96:0/3741789787 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10c02ade0 con 0x7fe11815e0f0 2024-04-24T23:58:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe117e00640 1 -- 172.21.15.96:0/3741789787 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c032660 con 0x7fe11815e0f0 2024-04-24T23:58:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe11ec00640 1 -- 172.21.15.96:0/3741789787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11815e0f0 msgr2=0x7fe1180b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe11ec00640 1 --2- 172.21.15.96:0/3741789787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11815e0f0 0x7fe1180b03c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe1180d1ef0 tx=0x7fe10c02a0d0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe11ec00640 1 -- 172.21.15.96:0/3741789787 shutdown_connections 2024-04-24T23:58:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe11ec00640 1 --2- 172.21.15.96:0/3741789787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe11815e4d0 0x7fe118162770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe11ec00640 1 --2- 172.21.15.96:0/3741789787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11815e0f0 0x7fe1180b03c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe11ec00640 1 -- 172.21.15.96:0/3741789787 >> 172.21.15.96:0/3741789787 conn(0x7fe11806c3b0 msgr2=0x7fe11806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe11ec00640 1 -- 172.21.15.96:0/3741789787 shutdown_connections 2024-04-24T23:58:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.362+0000 7fe11ec00640 1 -- 172.21.15.96:0/3741789787 wait complete. 2024-04-24T23:58:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.364+0000 7fe11ec00640 1 Processor -- start 2024-04-24T23:58:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.364+0000 7fe11ec00640 1 -- start start 2024-04-24T23:58:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.365+0000 7fe11ec00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe11806f880 0x7fe118142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.365+0000 7fe11ec00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815e0f0 0x7fe118155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.365+0000 7fe11ec00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1181f7e80 0x7fe1180ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.365+0000 7fe11ec00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe118162250 con 0x7fe1181f7e80 2024-04-24T23:58:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.365+0000 7fe11ec00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe118161f70 con 0x7fe11815e0f0 2024-04-24T23:58:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.365+0000 7fe11ec00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe118162cb0 con 0x7fe11806f880 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11e200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1181f7e80 0x7fe1180ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11e200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1181f7e80 0x7fe1180ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59600/0 (socket says 172.21.15.96:59600) 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11e200640 1 -- 172.21.15.96:0/1127334192 learned_addr learned my addr 172.21.15.96:0/1127334192 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11ce00640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815e0f0 0x7fe118155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11d800640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe11806f880 0x7fe118142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11e200640 1 -- 172.21.15.96:0/1127334192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe11806f880 msgr2=0x7fe118142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11e200640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe11806f880 0x7fe118142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11e200640 1 -- 172.21.15.96:0/1127334192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815e0f0 msgr2=0x7fe118155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11e200640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815e0f0 0x7fe118155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.366+0000 7fe11e200640 1 -- 172.21.15.96:0/1127334192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe118153d10 con 0x7fe1181f7e80 2024-04-24T23:58:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.367+0000 7fe11e200640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1181f7e80 0x7fe1180ae500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe11000b9c0 tx=0x7fe11000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.367+0000 7fe115600640 1 -- 172.21.15.96:0/1127334192 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110019070 con 0x7fe1181f7e80 2024-04-24T23:58:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.367+0000 7fe115600640 1 -- 172.21.15.96:0/1127334192 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe11000cb40 con 0x7fe1181f7e80 2024-04-24T23:58:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.367+0000 7fe115600640 1 -- 172.21.15.96:0/1127334192 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110014440 con 0x7fe1181f7e80 2024-04-24T23:58:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.367+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe118155a50 con 0x7fe1181f7e80 2024-04-24T23:58:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.367+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe118156010 con 0x7fe1181f7e80 2024-04-24T23:58:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.368+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1180afc80 con 0x7fe1181f7e80 2024-04-24T23:58:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.369+0000 7fe115600640 1 -- 172.21.15.96:0/1127334192 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe11001c070 con 0x7fe1181f7e80 2024-04-24T23:58:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.370+0000 7fe115600640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0f806be30 0x7fe0f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.370+0000 7fe115600640 1 -- 172.21.15.96:0/1127334192 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fe11008ac00 con 0x7fe1181f7e80 2024-04-24T23:58:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.370+0000 7fe11d800640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0f806be30 0x7fe0f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.371+0000 7fe11d800640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0f806be30 0x7fe0f806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe10c034000 tx=0x7fe10c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.374+0000 7fe115600640 1 -- 172.21.15.96:0/1127334192 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe1180afc80 con 0x7fe1181f7e80 2024-04-24T23:58:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.574+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1180756b0 con 0x7fe1181f7e80 2024-04-24T23:58:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.576+0000 7fe115600640 1 -- 172.21.15.96:0/1127334192 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16851 (secure 0 0 0) 0x7fe118153d10 con 0x7fe1181f7e80 2024-04-24T23:58:49.576 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:49.577 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:48.255571+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:49.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0f806be30 msgr2=0x7fe0f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0f806be30 0x7fe0f806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe10c034000 tx=0x7fe10c02e000 comp rx=0 tx=0).stop 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1181f7e80 msgr2=0x7fe1180ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1181f7e80 0x7fe1180ae500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe11000b9c0 tx=0x7fe11000be80 comp rx=0 tx=0).stop 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 shutdown_connections 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe0f806be30 0x7fe0f806e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1181f7e80 0x7fe1180ae500 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815e0f0 0x7fe118155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 --2- 172.21.15.96:0/1127334192 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe11806f880 0x7fe118142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 >> 172.21.15.96:0/1127334192 conn(0x7fe11806c3b0 msgr2=0x7fe11806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 shutdown_connections 2024-04-24T23:58:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.579+0000 7fe11ec00640 1 -- 172.21.15.96:0/1127334192 wait complete. 2024-04-24T23:58:49.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:49.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.800+0000 7fa067600640 1 Processor -- start 2024-04-24T23:58:49.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.800+0000 7fa067600640 1 -- start start 2024-04-24T23:58:49.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.802+0000 7fa067600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06006edf0 0x7fa06015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.802+0000 7fa067600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06006d100 con 0x7fa060156620 2024-04-24T23:58:49.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.802+0000 7fa067600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0600acda0 con 0x7fa0600ae8e0 2024-04-24T23:58:49.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.802+0000 7fa067600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa0600ad060 con 0x7fa06006edf0 2024-04-24T23:58:49.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.802+0000 7fa064c00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa060156620 0x7fa06006dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55286/0 (socket says 172.21.15.96:55286) 2024-04-24T23:58:49.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.802+0000 7fa064c00640 1 -- 172.21.15.96:0/2678613545 learned_addr learned my addr 172.21.15.96:0/2678613545 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:49.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05fe00640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06006edf0 0x7fa06015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545964772 0 0) 0x7fa06006d100 con 0x7fa060156620 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa044003520 con 0x7fa060156620 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 761642708 0 0) 0x7fa044003520 con 0x7fa060156620 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06006edf0 msgr2=0x7fa06015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06006edf0 0x7fa06015cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 >> v1:172.21.15.155:6789/0 conn(0x7fa0600ae8e0 legacy=0x7fa0600aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06006d3a0 con 0x7fa060156620 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fa050001670 con 0x7fa060156620 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 >> v1:172.21.15.96:6789/0 conn(0x7fa060156620 legacy=0x7fa06006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0440039e0 0x7fa044003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa044004800 0x7fa044004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06006edf0 0x7fa044005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600ad060 con 0x7fa044004800 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa04400baf0 con 0x7fa0440039e0 2024-04-24T23:58:49.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.803+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa04400bcf0 con 0x7fa06006edf0 2024-04-24T23:58:49.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.804+0000 7fa05fe00640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa044004800 0x7fa044004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.804+0000 7fa065600640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06006edf0 0x7fa044005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.804+0000 7fa064c00640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0440039e0 0x7fa044003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.804+0000 7fa05fe00640 1 -- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06006edf0 msgr2=0x7fa044005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:49.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.804+0000 7fa05fe00640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06006edf0 0x7fa044005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.804+0000 7fa05fe00640 1 -- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0440039e0 msgr2=0x7fa044003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:49.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.804+0000 7fa05fe00640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0440039e0 0x7fa044003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.804+0000 7fa05fe00640 1 -- 172.21.15.96:0/2678613545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa044003520 con 0x7fa044004800 2024-04-24T23:58:49.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.805+0000 7fa05fe00640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa044004800 0x7fa044004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009f90 tx=0x7fa044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd33868d2ec26ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.805+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c009c10 con 0x7fa044004800 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.805+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c036070 con 0x7fa044004800 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.805+0000 7fa05f400640 1 -- 172.21.15.96:0/2678613545 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c031850 con 0x7fa044004800 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.806+0000 7fa067600640 1 -- 172.21.15.96:0/2678613545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa044004800 msgr2=0x7fa044004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.806+0000 7fa067600640 1 --2- 172.21.15.96:0/2678613545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa044004800 0x7fa044004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009f90 tx=0x7fa044005830 comp rx=0 tx=0).stop 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.806+0000 7fa065600640 1 -- 172.21.15.96:0/2678613545 reap_dead start 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.806+0000 7fa067600640 1 -- 172.21.15.96:0/2678613545 shutdown_connections 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.806+0000 7fa067600640 1 -- 172.21.15.96:0/2678613545 >> 172.21.15.96:0/2678613545 conn(0x7fa0600b19c0 msgr2=0x7fa0600b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.806+0000 7fa067600640 1 -- 172.21.15.96:0/2678613545 shutdown_connections 2024-04-24T23:58:49.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.806+0000 7fa067600640 1 -- 172.21.15.96:0/2678613545 wait complete. 2024-04-24T23:58:49.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.808+0000 7fa067600640 1 Processor -- start 2024-04-24T23:58:49.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.808+0000 7fa067600640 1 -- start start 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.809+0000 7fa067600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa044004800 0x7fa06013ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.809+0000 7fa067600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06009bac0 0x7fa06013f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.809+0000 7fa067600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa06013fdf0 0x7fa060150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.809+0000 7fa067600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600ad4c0 con 0x7fa06013fdf0 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.809+0000 7fa067600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600ad340 con 0x7fa044004800 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.809+0000 7fa067600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa06015cf70 con 0x7fa06009bac0 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa065600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa06013fdf0 0x7fa060150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa065600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa06013fdf0 0x7fa060150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59608/0 (socket says 172.21.15.96:59608) 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa065600640 1 -- 172.21.15.96:0/417673749 learned_addr learned my addr 172.21.15.96:0/417673749 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa05fe00640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06009bac0 0x7fa06013f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa065600640 1 -- 172.21.15.96:0/417673749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06009bac0 msgr2=0x7fa06013f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa065600640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06009bac0 0x7fa06013f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa065600640 1 -- 172.21.15.96:0/417673749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa044004800 msgr2=0x7fa06013ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:49.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa065600640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa044004800 0x7fa06013ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:49.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa065600640 1 -- 172.21.15.96:0/417673749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0601525e0 con 0x7fa06013fdf0 2024-04-24T23:58:49.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.810+0000 7fa065600640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa06013fdf0 0x7fa060150770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa058000c00 tx=0x7fa05800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:49.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.811+0000 7fa05cc00640 1 -- 172.21.15.96:0/417673749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058019070 con 0x7fa06013fdf0 2024-04-24T23:58:49.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.811+0000 7fa05cc00640 1 -- 172.21.15.96:0/417673749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0580052e0 con 0x7fa06013fdf0 2024-04-24T23:58:49.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.811+0000 7fa05cc00640 1 -- 172.21.15.96:0/417673749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058003830 con 0x7fa06013fdf0 2024-04-24T23:58:49.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.811+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa060140290 con 0x7fa06013fdf0 2024-04-24T23:58:49.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.811+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa060152860 con 0x7fa06013fdf0 2024-04-24T23:58:49.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.812+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0601407b0 con 0x7fa06013fdf0 2024-04-24T23:58:49.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.813+0000 7fa05cc00640 1 -- 172.21.15.96:0/417673749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa05801c070 con 0x7fa06013fdf0 2024-04-24T23:58:49.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.814+0000 7fa05cc00640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa04006be60 0x7fa04006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:49.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.815+0000 7fa05cc00640 1 -- 172.21.15.96:0/417673749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fa05808a2b0 con 0x7fa06013fdf0 2024-04-24T23:58:49.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.815+0000 7fa064c00640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa04006be60 0x7fa04006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:49.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.815+0000 7fa064c00640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa04006be60 0x7fa04006e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0500079b0 tx=0x7fa050009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:49.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:49.819+0000 7fa05cc00640 1 -- 172.21.15.96:0/417673749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa0601407b0 con 0x7fa06013fdf0 2024-04-24T23:58:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.014+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa060074330 con 0x7fa06013fdf0 2024-04-24T23:58:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.015+0000 7fa05cc00640 1 -- 172.21.15.96:0/417673749 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fa0601525e0 con 0x7fa06013fdf0 2024-04-24T23:58:50.015 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:50.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa04006be60 msgr2=0x7fa04006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa04006be60 0x7fa04006e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0500079b0 tx=0x7fa050009040 comp rx=0 tx=0).stop 2024-04-24T23:58:50.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa06013fdf0 msgr2=0x7fa060150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa06013fdf0 0x7fa060150770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa058000c00 tx=0x7fa05800e8a0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 shutdown_connections 2024-04-24T23:58:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa04006be60 0x7fa04006e320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa06013fdf0 0x7fa060150770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa06009bac0 0x7fa06013f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 --2- 172.21.15.96:0/417673749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa044004800 0x7fa06013ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 >> 172.21.15.96:0/417673749 conn(0x7fa0600b19c0 msgr2=0x7fa06015c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 shutdown_connections 2024-04-24T23:58:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.018+0000 7fa067600640 1 -- 172.21.15.96:0/417673749 wait complete. 2024-04-24T23:58:50.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.236+0000 7f940e800640 1 Processor -- start 2024-04-24T23:58:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.236+0000 7f940e800640 1 -- start start 2024-04-24T23:58:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.237+0000 7f940e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 0x7f940815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.237+0000 7f940e800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f940806edf0 0x7f940806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.237+0000 7f940e800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f94080ae8e0 0x7f94080aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.237+0000 7f940e800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f940806d100 con 0x7f94080ae8e0 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f940e800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f94080acda0 con 0x7f940806edf0 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f940e800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94080ad060 con 0x7f9408156620 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f94080ae8e0 0x7f94080aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f94080ae8e0 0x7f94080aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59610/0 (socket says 172.21.15.96:59610) 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407e00640 1 -- 172.21.15.96:0/2322167430 learned_addr learned my addr 172.21.15.96:0/2322167430 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407400640 1 --2- 172.21.15.96:0/2322167430 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 0x7f940815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407e00640 1 -- 172.21.15.96:0/2322167430 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 msgr2=0x7f940815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407e00640 1 --2- 172.21.15.96:0/2322167430 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 0x7f940815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407e00640 1 -- 172.21.15.96:0/2322167430 >> v2:172.21.15.155:3300/0 conn(0x7f940806edf0 msgr2=0x7f940806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:50.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407e00640 1 --2- 172.21.15.96:0/2322167430 >> v2:172.21.15.155:3300/0 conn(0x7f940806edf0 0x7f940806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407e00640 1 -- 172.21.15.96:0/2322167430 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940806d3a0 con 0x7f94080ae8e0 2024-04-24T23:58:50.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.238+0000 7f9407400640 1 --2- 172.21.15.96:0/2322167430 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 0x7f940815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.239+0000 7f9407e00640 1 --2- 172.21.15.96:0/2322167430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 0x7f94080aed70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94080709b0 tx=0x7f940002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0c078ecd5a24d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f9406000640 1 -- 172.21.15.96:0/2322167430 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400036070 con 0x7f94080ae8e0 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f9406000640 1 -- 172.21.15.96:0/2322167430 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9400031600 con 0x7f94080ae8e0 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f9406000640 1 -- 172.21.15.96:0/2322167430 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94000319d0 con 0x7f94080ae8e0 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f940e800640 1 -- 172.21.15.96:0/2322167430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 msgr2=0x7f94080aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f940e800640 1 --2- 172.21.15.96:0/2322167430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 0x7f94080aed70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94080709b0 tx=0x7f940002a6a0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f940e800640 1 -- 172.21.15.96:0/2322167430 shutdown_connections 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f940e800640 1 --2- 172.21.15.96:0/2322167430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 0x7f94080aed70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f940e800640 1 --2- 172.21.15.96:0/2322167430 >> v2:172.21.15.155:3300/0 conn(0x7f940806edf0 0x7f940806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f940e800640 1 --2- 172.21.15.96:0/2322167430 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 0x7f940815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f940e800640 1 -- 172.21.15.96:0/2322167430 >> 172.21.15.96:0/2322167430 conn(0x7f94080b19c0 msgr2=0x7f94080b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:50.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f940e800640 1 -- 172.21.15.96:0/2322167430 shutdown_connections 2024-04-24T23:58:50.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.240+0000 7f940e800640 1 -- 172.21.15.96:0/2322167430 wait complete. 2024-04-24T23:58:50.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.242+0000 7f940e800640 1 Processor -- start 2024-04-24T23:58:50.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.242+0000 7f940e800640 1 -- start start 2024-04-24T23:58:50.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.243+0000 7f940e800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f940806edf0 0x7f940815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.243+0000 7f940e800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 0x7f9408156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.243+0000 7f940e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 0x7f94081f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.243+0000 7f940e800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f940806e0e0 con 0x7f94080ae8e0 2024-04-24T23:58:50.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.243+0000 7f940e800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94080af2b0 con 0x7f940806edf0 2024-04-24T23:58:50.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.243+0000 7f940e800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94080ad340 con 0x7f9408156620 2024-04-24T23:58:50.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.243+0000 7f9406a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 0x7f9408156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9406a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 0x7f9408156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59614/0 (socket says 172.21.15.96:59614) 2024-04-24T23:58:50.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9406a00640 1 -- 172.21.15.96:0/1293494555 learned_addr learned my addr 172.21.15.96:0/1293494555 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:50.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9407400640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f940806edf0 0x7f940815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9407e00640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 0x7f94081f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9406a00640 1 -- 172.21.15.96:0/1293494555 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 msgr2=0x7f94081f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9406a00640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 0x7f94081f1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9406a00640 1 -- 172.21.15.96:0/1293494555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f940806edf0 msgr2=0x7f940815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9406a00640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f940806edf0 0x7f940815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9406a00640 1 -- 172.21.15.96:0/1293494555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940815e330 con 0x7f94080ae8e0 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9407400640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f940806edf0 0x7f940815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f9406a00640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 0x7f9408156a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f93f400b440 tx=0x7f93f400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.244+0000 7f93ff400640 1 -- 172.21.15.96:0/1293494555 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4015020 con 0x7f94080ae8e0 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.245+0000 7f93ff400640 1 -- 172.21.15.96:0/1293494555 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f4011890 con 0x7f94080ae8e0 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.245+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940815e610 con 0x7f94080ae8e0 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.245+0000 7f93ff400640 1 -- 172.21.15.96:0/1293494555 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4011c80 con 0x7f94080ae8e0 2024-04-24T23:58:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.245+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940815e8f0 con 0x7f94080ae8e0 2024-04-24T23:58:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.246+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9408069110 con 0x7f94080ae8e0 2024-04-24T23:58:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.247+0000 7f93ff400640 1 -- 172.21.15.96:0/1293494555 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93f4018020 con 0x7f94080ae8e0 2024-04-24T23:58:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.248+0000 7f93ff400640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f93e806be30 0x7f93e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.248+0000 7f93ff400640 1 -- 172.21.15.96:0/1293494555 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f93f408afd0 con 0x7f94080ae8e0 2024-04-24T23:58:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.248+0000 7f9407400640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f93e806be30 0x7f93e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.249+0000 7f9407400640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f93e806be30 0x7f93e806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9408068350 tx=0x7f93f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:50.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.253+0000 7f93ff400640 1 -- 172.21.15.96:0/1293494555 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f93f401f020 con 0x7f94080ae8e0 2024-04-24T23:58:50.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.452+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f940809d210 con 0x7f94080ae8e0 2024-04-24T23:58:50.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.453+0000 7f93ff400640 1 -- 172.21.15.96:0/1293494555 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f93f400d040 con 0x7f94080ae8e0 2024-04-24T23:58:50.453 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:50.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f93e806be30 msgr2=0x7f93e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f93e806be30 0x7f93e806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9408068350 tx=0x7f93f8008040 comp rx=0 tx=0).stop 2024-04-24T23:58:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 msgr2=0x7f9408156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 0x7f9408156a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f93f400b440 tx=0x7f93f400b900 comp rx=0 tx=0).stop 2024-04-24T23:58:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 shutdown_connections 2024-04-24T23:58:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9408156620 0x7f94081f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f93e806be30 0x7f93e806e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94080ae8e0 0x7f9408156a00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 --2- 172.21.15.96:0/1293494555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f940806edf0 0x7f940815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.456+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 >> 172.21.15.96:0/1293494555 conn(0x7f94080b19c0 msgr2=0x7f94080b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:50.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.457+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 shutdown_connections 2024-04-24T23:58:50.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.457+0000 7f940e800640 1 -- 172.21.15.96:0/1293494555 wait complete. 2024-04-24T23:58:50.477 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.678+0000 7f5476200640 1 Processor -- start 2024-04-24T23:58:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.678+0000 7f5476200640 1 -- start start 2024-04-24T23:58:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.680+0000 7f5476200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5470156620 0x7f547015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.680+0000 7f5476200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54700ae8e0 0x7f54700aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.680+0000 7f5476200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f547006d100 con 0x7f547006edf0 2024-04-24T23:58:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.680+0000 7f5476200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f54700acda0 con 0x7f5470156620 2024-04-24T23:58:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.680+0000 7f5476200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f54700af2d0 con 0x7f54700ae8e0 2024-04-24T23:58:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.680+0000 7f546f400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5470156620 0x7f547015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.680+0000 7f546f400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5470156620 0x7f547015cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59618/0 (socket says 172.21.15.96:59618) 2024-04-24T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.680+0000 7f546f400640 1 -- 172.21.15.96:0/1754123444 learned_addr learned my addr 172.21.15.96:0/1754123444 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.680+0000 7f5466a00640 1 --1- 172.21.15.96:0/1754123444 >> v1:172.21.15.96:6789/0 conn(0x7f547006edf0 0x7f547006dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55290/0 (socket says 172.21.15.96:55290) 2024-04-24T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.681+0000 7f546f400640 1 -- 172.21.15.96:0/1754123444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54700ae8e0 msgr2=0x7f54700aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.681+0000 7f546fe00640 1 --2- 172.21.15.96:0/1754123444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54700ae8e0 0x7f54700aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.681+0000 7f546f400640 1 --2- 172.21.15.96:0/1754123444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54700ae8e0 0x7f54700aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.681+0000 7f546ea00640 1 -- 172.21.15.96:0/1754123444 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215316184 0 0) 0x7f547006d100 con 0x7f547006edf0 2024-04-24T23:58:50.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.681+0000 7f546f400640 1 -- 172.21.15.96:0/1754123444 >> v1:172.21.15.96:6789/0 conn(0x7f547006edf0 legacy=0x7f547006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.681+0000 7f546f400640 1 -- 172.21.15.96:0/1754123444 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54700ad060 con 0x7f5470156620 2024-04-24T23:58:50.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.682+0000 7f546f400640 1 --2- 172.21.15.96:0/1754123444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5470156620 0x7f547015cf70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5460009870 tx=0x7f546002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a8338e6d03961d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:50.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.682+0000 7f546ea00640 1 -- 172.21.15.96:0/1754123444 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460037070 con 0x7f5470156620 2024-04-24T23:58:50.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.682+0000 7f546ea00640 1 -- 172.21.15.96:0/1754123444 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5460032440 con 0x7f5470156620 2024-04-24T23:58:50.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.682+0000 7f546ea00640 1 -- 172.21.15.96:0/1754123444 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460032810 con 0x7f5470156620 2024-04-24T23:58:50.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.683+0000 7f5476200640 1 -- 172.21.15.96:0/1754123444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5470156620 msgr2=0x7f547015cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.683+0000 7f5476200640 1 --2- 172.21.15.96:0/1754123444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5470156620 0x7f547015cf70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5460009870 tx=0x7f546002a1c0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.683+0000 7f5476200640 1 -- 172.21.15.96:0/1754123444 shutdown_connections 2024-04-24T23:58:50.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.683+0000 7f5476200640 1 --2- 172.21.15.96:0/1754123444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54700ae8e0 0x7f54700aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.683+0000 7f5476200640 1 --2- 172.21.15.96:0/1754123444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5470156620 0x7f547015cf70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.683+0000 7f5476200640 1 -- 172.21.15.96:0/1754123444 >> 172.21.15.96:0/1754123444 conn(0x7f54700b19c0 msgr2=0x7f54700b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:50.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.683+0000 7f5476200640 1 -- 172.21.15.96:0/1754123444 shutdown_connections 2024-04-24T23:58:50.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.683+0000 7f5476200640 1 -- 172.21.15.96:0/1754123444 wait complete. 2024-04-24T23:58:50.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.685+0000 7f5476200640 1 Processor -- start 2024-04-24T23:58:50.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.685+0000 7f5476200640 1 -- start start 2024-04-24T23:58:50.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f5476200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f547006edf0 0x7f54701f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f5476200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54700ae8e0 0x7f5470156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f5476200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5470156620 0x7f54700b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f5476200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f54700ad340 con 0x7f547006edf0 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f5476200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f547006d680 con 0x7f54700ae8e0 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f5476200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f54700ad4c0 con 0x7f5470156620 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f546f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f547006edf0 0x7f54701f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f546f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f547006edf0 0x7f54701f7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59634/0 (socket says 172.21.15.96:59634) 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f546f400640 1 -- 172.21.15.96:0/1732300675 learned_addr learned my addr 172.21.15.96:0/1732300675 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f546f400640 1 -- 172.21.15.96:0/1732300675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5470156620 msgr2=0x7f54700b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f546f400640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5470156620 0x7f54700b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f546f400640 1 -- 172.21.15.96:0/1732300675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54700ae8e0 msgr2=0x7f5470156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f546f400640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54700ae8e0 0x7f5470156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.686+0000 7f546f400640 1 -- 172.21.15.96:0/1732300675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54701571e0 con 0x7f547006edf0 2024-04-24T23:58:50.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.687+0000 7f546f400640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f547006edf0 0x7f54701f7f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5460000c00 tx=0x7f54600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:50.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.687+0000 7f5467e00640 1 -- 172.21.15.96:0/1732300675 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460037040 con 0x7f547006edf0 2024-04-24T23:58:50.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.687+0000 7f5467e00640 1 -- 172.21.15.96:0/1732300675 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5460042070 con 0x7f547006edf0 2024-04-24T23:58:50.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.687+0000 7f5467e00640 1 -- 172.21.15.96:0/1732300675 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460030bd0 con 0x7f547006edf0 2024-04-24T23:58:50.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.687+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54701574c0 con 0x7f547006edf0 2024-04-24T23:58:50.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.687+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5470157f70 con 0x7f547006edf0 2024-04-24T23:58:50.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.688+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54701579e0 con 0x7f547006edf0 2024-04-24T23:58:50.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.689+0000 7f5467e00640 1 -- 172.21.15.96:0/1732300675 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f546002ad10 con 0x7f547006edf0 2024-04-24T23:58:50.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.690+0000 7f5467e00640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f544c06be30 0x7f544c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:50.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.690+0000 7f5467e00640 1 -- 172.21.15.96:0/1732300675 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f54600ab950 con 0x7f547006edf0 2024-04-24T23:58:50.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.690+0000 7f5466a00640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f544c06be30 0x7f544c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:50.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.691+0000 7f5466a00640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f544c06be30 0x7f544c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5458007fd0 tx=0x7f5458007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:50.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.695+0000 7f5467e00640 1 -- 172.21.15.96:0/1732300675 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f54701579e0 con 0x7f547006edf0 2024-04-24T23:58:50.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.895+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5470069110 con 0x7f547006edf0 2024-04-24T23:58:50.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.896+0000 7f5467e00640 1 -- 172.21.15.96:0/1732300675 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f546007a1d0 con 0x7f547006edf0 2024-04-24T23:58:50.897 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:50.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.898+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f544c06be30 msgr2=0x7f544c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f544c06be30 0x7f544c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5458007fd0 tx=0x7f5458007960 comp rx=0 tx=0).stop 2024-04-24T23:58:50.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f547006edf0 msgr2=0x7f54701f7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:50.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f547006edf0 0x7f54701f7f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5460000c00 tx=0x7f54600046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 shutdown_connections 2024-04-24T23:58:50.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5470156620 0x7f54700b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54700ae8e0 0x7f5470156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f544c06be30 0x7f544c06e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 --2- 172.21.15.96:0/1732300675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f547006edf0 0x7f54701f7f20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:50.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 >> 172.21.15.96:0/1732300675 conn(0x7f54700b19c0 msgr2=0x7f547015b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:50.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 shutdown_connections 2024-04-24T23:58:50.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:50.899+0000 7f5476200640 1 -- 172.21.15.96:0/1732300675 wait complete. 2024-04-24T23:58:50.917 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:58:51.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.121+0000 7fbd73400640 1 Processor -- start 2024-04-24T23:58:51.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.122+0000 7fbd73400640 1 -- start start 2024-04-24T23:58:51.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.123+0000 7fbd73400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd6c1551c0 0x7fbd6c0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.123+0000 7fbd73400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6c0b3070 con 0x7fbd6c15f450 2024-04-24T23:58:51.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.123+0000 7fbd73400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6c0b3310 con 0x7fbd6c0b4590 2024-04-24T23:58:51.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.123+0000 7fbd73400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6c0b3960 con 0x7fbd6c1551c0 2024-04-24T23:58:51.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.124+0000 7fbd6be00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbd6c15f450 0x7fbd6c070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55300/0 (socket says 172.21.15.96:55300) 2024-04-24T23:58:51.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.124+0000 7fbd6be00640 1 -- 172.21.15.96:0/4099706355 learned_addr learned my addr 172.21.15.96:0/4099706355 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:51.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.124+0000 7fbd70a00640 1 --2- 172.21.15.96:0/4099706355 >> v2:172.21.15.155:3300/0 conn(0x7fbd6c1551c0 0x7fbd6c0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.124+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612757279 0 0) 0x7fbd6c0b3070 con 0x7fbd6c15f450 2024-04-24T23:58:51.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.124+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd50003520 con 0x7fbd6c15f450 2024-04-24T23:58:51.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.124+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2815971817 0 0) 0x7fbd50003520 con 0x7fbd6c15f450 2024-04-24T23:58:51.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 >> v2:172.21.15.155:3300/0 conn(0x7fbd6c1551c0 msgr2=0x7fbd6c0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:51.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 --2- 172.21.15.96:0/4099706355 >> v2:172.21.15.155:3300/0 conn(0x7fbd6c1551c0 0x7fbd6c0b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 >> v1:172.21.15.155:6789/0 conn(0x7fbd6c0b4590 legacy=0x7fbd6c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c0b35f0 con 0x7fbd6c15f450 2024-04-24T23:58:51.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fbd58001670 con 0x7fbd6c15f450 2024-04-24T23:58:51.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 >> v1:172.21.15.96:6789/0 conn(0x7fbd6c15f450 legacy=0x7fbd6c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd500039b0 0x7fbd50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd50004800 0x7fbd50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd500051c0 0x7fbd5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c0b3960 con 0x7fbd500039b0 2024-04-24T23:58:51.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5000c160 con 0x7fbd500051c0 2024-04-24T23:58:51.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5000c360 con 0x7fbd50004800 2024-04-24T23:58:51.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.125+0000 7fbd70a00640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd500039b0 0x7fbd50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.126+0000 7fbd71400640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd500051c0 0x7fbd5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.126+0000 7fbd70a00640 1 -- 172.21.15.96:0/4099706355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd50004800 msgr2=0x7fbd50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:51.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.126+0000 7fbd70a00640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd50004800 0x7fbd50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.126+0000 7fbd70a00640 1 -- 172.21.15.96:0/4099706355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd500051c0 msgr2=0x7fbd5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:51.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.126+0000 7fbd70a00640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd500051c0 0x7fbd5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.126+0000 7fbd70a00640 1 -- 172.21.15.96:0/4099706355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd50003520 con 0x7fbd500039b0 2024-04-24T23:58:51.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.126+0000 7fbd71400640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd500051c0 0x7fbd5000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:51.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.126+0000 7fbd71400640 1 -- 172.21.15.96:0/4099706355 reap_dead start 2024-04-24T23:58:51.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.127+0000 7fbd70a00640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd500039b0 0x7fbd50003dd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009fc0 tx=0x7fbd50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e1cf652868570c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:51.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.127+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c009c10 con 0x7fbd500039b0 2024-04-24T23:58:51.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.127+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c036070 con 0x7fbd500039b0 2024-04-24T23:58:51.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.127+0000 7fbd6b400640 1 -- 172.21.15.96:0/4099706355 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c031880 con 0x7fbd500039b0 2024-04-24T23:58:51.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.128+0000 7fbd73400640 1 -- 172.21.15.96:0/4099706355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd500039b0 msgr2=0x7fbd50003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.128+0000 7fbd73400640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd500039b0 0x7fbd50003dd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009fc0 tx=0x7fbd50005830 comp rx=0 tx=0).stop 2024-04-24T23:58:51.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.128+0000 7fbd73400640 1 -- 172.21.15.96:0/4099706355 shutdown_connections 2024-04-24T23:58:51.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.128+0000 7fbd73400640 1 --2- 172.21.15.96:0/4099706355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd500039b0 0x7fbd50003dd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.128+0000 7fbd73400640 1 -- 172.21.15.96:0/4099706355 >> 172.21.15.96:0/4099706355 conn(0x7fbd6c0b19c0 msgr2=0x7fbd6c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:51.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.128+0000 7fbd73400640 1 -- 172.21.15.96:0/4099706355 shutdown_connections 2024-04-24T23:58:51.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.128+0000 7fbd73400640 1 -- 172.21.15.96:0/4099706355 wait complete. 2024-04-24T23:58:51.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.130+0000 7fbd73400640 1 Processor -- start 2024-04-24T23:58:51.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.130+0000 7fbd73400640 1 -- start start 2024-04-24T23:58:51.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.130+0000 7fbd73400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd500039b0 0x7fbd6c14f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd73400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd6c1536d0 0x7fbd6c0af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd73400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd6c1f4a10 0x7fbd6c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd73400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c0719c0 con 0x7fbd6c1536d0 2024-04-24T23:58:51.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd73400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c071840 con 0x7fbd6c1f4a10 2024-04-24T23:58:51.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd73400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6c0b3df0 con 0x7fbd500039b0 2024-04-24T23:58:51.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd6be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd6c1536d0 0x7fbd6c0af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd6be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd6c1536d0 0x7fbd6c0af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59652/0 (socket says 172.21.15.96:59652) 2024-04-24T23:58:51.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd6be00640 1 -- 172.21.15.96:0/2164629816 learned_addr learned my addr 172.21.15.96:0/2164629816 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:51.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd6be00640 1 -- 172.21.15.96:0/2164629816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd500039b0 msgr2=0x7fbd6c14f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd6be00640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd500039b0 0x7fbd6c14f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd6be00640 1 -- 172.21.15.96:0/2164629816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd6c1f4a10 msgr2=0x7fbd6c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd6be00640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd6c1f4a10 0x7fbd6c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.131+0000 7fbd6be00640 1 -- 172.21.15.96:0/2164629816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c0aff80 con 0x7fbd6c1536d0 2024-04-24T23:58:51.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.132+0000 7fbd6be00640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd6c1536d0 0x7fbd6c0af610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800c760 tx=0x7fbd5800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:51.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.132+0000 7fbd68c00640 1 -- 172.21.15.96:0/2164629816 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58018070 con 0x7fbd6c1536d0 2024-04-24T23:58:51.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.132+0000 7fbd68c00640 1 -- 172.21.15.96:0/2164629816 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd580072f0 con 0x7fbd6c1536d0 2024-04-24T23:58:51.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.132+0000 7fbd68c00640 1 -- 172.21.15.96:0/2164629816 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd580047e0 con 0x7fbd6c1536d0 2024-04-24T23:58:51.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.132+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6c1f3f30 con 0x7fbd6c1536d0 2024-04-24T23:58:51.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.132+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6c1f44f0 con 0x7fbd6c1536d0 2024-04-24T23:58:51.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.133+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6c1f3d30 con 0x7fbd6c1536d0 2024-04-24T23:58:51.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.134+0000 7fbd68c00640 1 -- 172.21.15.96:0/2164629816 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd5801b070 con 0x7fbd6c1536d0 2024-04-24T23:58:51.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.135+0000 7fbd68c00640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd4c06be60 0x7fbd4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.135+0000 7fbd68c00640 1 -- 172.21.15.96:0/2164629816 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fbd5808a4e0 con 0x7fbd6c1536d0 2024-04-24T23:58:51.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.135+0000 7fbd70a00640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd4c06be60 0x7fbd4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.136+0000 7fbd70a00640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd4c06be60 0x7fbd4c06e320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c035000 tx=0x7fbd5c02d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:51.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.140+0000 7fbd68c00640 1 -- 172.21.15.96:0/2164629816 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbd58058d60 con 0x7fbd6c1536d0 2024-04-24T23:58:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.352+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbd6c069110 con 0x7fbd6c1536d0 2024-04-24T23:58:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.353+0000 7fbd68c00640 1 -- 172.21.15.96:0/2164629816 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fbd58058660 con 0x7fbd6c1536d0 2024-04-24T23:58:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-24T23:58:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd4c06be60 msgr2=0x7fbd4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd4c06be60 0x7fbd4c06e320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c035000 tx=0x7fbd5c02d000 comp rx=0 tx=0).stop 2024-04-24T23:58:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd6c1536d0 msgr2=0x7fbd6c0af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd6c1536d0 0x7fbd6c0af610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800c760 tx=0x7fbd5800cc20 comp rx=0 tx=0).stop 2024-04-24T23:58:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 shutdown_connections 2024-04-24T23:58:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd6c1f4a10 0x7fbd6c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbd4c06be60 0x7fbd4c06e320 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd6c1536d0 0x7fbd6c0af610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 --2- 172.21.15.96:0/2164629816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd500039b0 0x7fbd6c14f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 >> 172.21.15.96:0/2164629816 conn(0x7fbd6c0b19c0 msgr2=0x7fbd6c0b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 shutdown_connections 2024-04-24T23:58:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.356+0000 7fbd73400640 1 -- 172.21.15.96:0/2164629816 wait complete. 2024-04-24T23:58:51.376 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:58:51.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:51.376 DEBUG:teuthology.orchestra.run.smithi096:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-24T23:58:51.465 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-04-24T23:58:51.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:51.466 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:58:51.534 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:58:51.535 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:51.592 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:58:51.592 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:51.645 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:58:51.645 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:51.700 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:51.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.910+0000 7fadcda00640 1 Processor -- start 2024-04-24T23:58:51.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.910+0000 7fadcda00640 1 -- start start 2024-04-24T23:58:51.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.912+0000 7fadcda00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fadc80b4ec0 0x7fadc80cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.912+0000 7fadcda00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc815fa90 con 0x7fadc80ccc20 2024-04-24T23:58:51.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.912+0000 7fadcda00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc80b3e20 con 0x7fadc815f6b0 2024-04-24T23:58:51.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.912+0000 7fadcda00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fadc80b4a30 con 0x7fadc80b4ec0 2024-04-24T23:58:51.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.912+0000 7fadcd000640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fadc80ccc20 0x7fadc8070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55316/0 (socket says 172.21.15.96:55316) 2024-04-24T23:58:51.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.912+0000 7fadcd000640 1 -- 172.21.15.96:0/1988890168 learned_addr learned my addr 172.21.15.96:0/1988890168 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:51.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.912+0000 7fadc7400640 1 --2- 172.21.15.96:0/1988890168 >> v2:172.21.15.155:3300/0 conn(0x7fadc80b4ec0 0x7fadc80cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034323068 0 0) 0x7fadc815fa90 con 0x7fadc80ccc20 2024-04-24T23:58:51.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadac003520 con 0x7fadc80ccc20 2024-04-24T23:58:51.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2682624256 0 0) 0x7fadac003520 con 0x7fadc80ccc20 2024-04-24T23:58:51.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 >> v2:172.21.15.155:3300/0 conn(0x7fadc80b4ec0 msgr2=0x7fadc80cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:51.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 --2- 172.21.15.96:0/1988890168 >> v2:172.21.15.155:3300/0 conn(0x7fadc80b4ec0 0x7fadc80cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 >> v1:172.21.15.155:6789/0 conn(0x7fadc815f6b0 legacy=0x7fadc80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc80b4100 con 0x7fadc80ccc20 2024-04-24T23:58:51.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fadc0001670 con 0x7fadc80ccc20 2024-04-24T23:58:51.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 >> v1:172.21.15.96:6789/0 conn(0x7fadc80ccc20 legacy=0x7fadc8070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 --2- 172.21.15.96:0/1988890168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0039b0 0x7fadac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 --2- 172.21.15.96:0/1988890168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadac004800 0x7fadac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 --2- 172.21.15.96:0/1988890168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadac0051c0 0x7fadac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fadc80b4a30 con 0x7fadac0039b0 2024-04-24T23:58:51.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fadac00c060 con 0x7fadac0051c0 2024-04-24T23:58:51.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fadac00c260 con 0x7fadac004800 2024-04-24T23:58:51.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.913+0000 7fadc7e00640 1 --2- 172.21.15.96:0/1988890168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0039b0 0x7fadac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.914+0000 7fadc7e00640 1 -- 172.21.15.96:0/1988890168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadac004800 msgr2=0x7fadac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:51.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.914+0000 7fadc7e00640 1 --2- 172.21.15.96:0/1988890168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadac004800 0x7fadac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.914+0000 7fadc7e00640 1 -- 172.21.15.96:0/1988890168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadac0051c0 msgr2=0x7fadac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:51.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.914+0000 7fadc7e00640 1 --2- 172.21.15.96:0/1988890168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadac0051c0 0x7fadac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.914+0000 7fadc7e00640 1 -- 172.21.15.96:0/1988890168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac003520 con 0x7fadac0039b0 2024-04-24T23:58:51.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.914+0000 7fadcd000640 1 -- 172.21.15.96:0/1988890168 reap_dead start 2024-04-24T23:58:51.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.915+0000 7fadc7e00640 1 --2- 172.21.15.96:0/1988890168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0039b0 0x7fadac003dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fadb0001750 tx=0x7fadac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63d91ceaf6bdaf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:51.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.915+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0001370 con 0x7fadac0039b0 2024-04-24T23:58:51.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.915+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb00052d0 con 0x7fadac0039b0 2024-04-24T23:58:51.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.915+0000 7fadc6a00640 1 -- 172.21.15.96:0/1988890168 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb002abe0 con 0x7fadac0039b0 2024-04-24T23:58:51.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.916+0000 7fadcda00640 1 -- 172.21.15.96:0/1988890168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0039b0 msgr2=0x7fadac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.916+0000 7fadcda00640 1 --2- 172.21.15.96:0/1988890168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0039b0 0x7fadac003dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fadb0001750 tx=0x7fadac005830 comp rx=0 tx=0).stop 2024-04-24T23:58:51.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.916+0000 7fadcda00640 1 -- 172.21.15.96:0/1988890168 shutdown_connections 2024-04-24T23:58:51.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.916+0000 7fadcda00640 1 --2- 172.21.15.96:0/1988890168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0039b0 0x7fadac003dd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.916+0000 7fadcda00640 1 -- 172.21.15.96:0/1988890168 >> 172.21.15.96:0/1988890168 conn(0x7fadc80b1f10 msgr2=0x7fadc80cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:51.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.916+0000 7fadcda00640 1 -- 172.21.15.96:0/1988890168 shutdown_connections 2024-04-24T23:58:51.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.916+0000 7fadcda00640 1 -- 172.21.15.96:0/1988890168 wait complete. 2024-04-24T23:58:51.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.918+0000 7fadcda00640 1 Processor -- start 2024-04-24T23:58:51.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.918+0000 7fadcda00640 1 -- start start 2024-04-24T23:58:51.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcda00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadac0039b0 0x7fadc8149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcda00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80c9b70 0x7fadc806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcda00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadc80c9ff0 0x7fadc806e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcda00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fadc80cf1c0 con 0x7fadc80c9ff0 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcda00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fadc80b46c0 con 0x7fadc80c9b70 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcda00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fadc80b3a40 con 0x7fadac0039b0 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcd000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadc80c9ff0 0x7fadc806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcd000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadc80c9ff0 0x7fadc806e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59670/0 (socket says 172.21.15.96:59670) 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcd000640 1 -- 172.21.15.96:0/1435682660 learned_addr learned my addr 172.21.15.96:0/1435682660 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcd000640 1 -- 172.21.15.96:0/1435682660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadac0039b0 msgr2=0x7fadc8149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadc7e00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadac0039b0 0x7fadc8149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadc7400640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80c9b70 0x7fadc806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcd000640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadac0039b0 0x7fadc8149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcd000640 1 -- 172.21.15.96:0/1435682660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80c9b70 msgr2=0x7fadc806dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcd000640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80c9b70 0x7fadc806dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.919+0000 7fadcd000640 1 -- 172.21.15.96:0/1435682660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc8149cc0 con 0x7fadc80c9ff0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.920+0000 7fadcd000640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadc80c9ff0 0x7fadc806e240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fadc806c1f0 tx=0x7fadc000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.920+0000 7fadbfe00640 1 -- 172.21.15.96:0/1435682660 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc00074e0 con 0x7fadc80c9ff0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.920+0000 7fadbfe00640 1 -- 172.21.15.96:0/1435682660 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc00047e0 con 0x7fadc80c9ff0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.920+0000 7fadbfe00640 1 -- 172.21.15.96:0/1435682660 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0004bd0 con 0x7fadc80c9ff0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.920+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc8156d90 con 0x7fadc80c9ff0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.920+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc80c9090 con 0x7fadc80c9ff0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.921+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc8067e40 con 0x7fadc80c9ff0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.922+0000 7fadbfe00640 1 -- 172.21.15.96:0/1435682660 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadc0012360 con 0x7fadc80c9ff0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.923+0000 7fadbfe00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fada406be30 0x7fada406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.923+0000 7fadbfe00640 1 -- 172.21.15.96:0/1435682660 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fadc008a5a0 con 0x7fadc80c9ff0 2024-04-24T23:58:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.923+0000 7fadc7e00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fada406be30 0x7fada406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:51.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.924+0000 7fadc7e00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fada406be30 0x7fada406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadb0032000 tx=0x7fadb002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:51.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:51.928+0000 7fadbfe00640 1 -- 172.21.15.96:0/1435682660 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fadc001b030 con 0x7fadc80c9ff0 2024-04-24T23:58:52.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.128+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadc8160710 con 0x7fadc80c9ff0 2024-04-24T23:58:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.131+0000 7fadbfe00640 1 -- 172.21.15.96:0/1435682660 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16851 (secure 0 0 0) 0x7fadc8149cc0 con 0x7fadc80c9ff0 2024-04-24T23:58:52.132 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:52.132 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:48.255571+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:52.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fada406be30 msgr2=0x7fada406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fada406be30 0x7fada406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadb0032000 tx=0x7fadb002e000 comp rx=0 tx=0).stop 2024-04-24T23:58:52.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadc80c9ff0 msgr2=0x7fadc806e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadc80c9ff0 0x7fadc806e240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fadc806c1f0 tx=0x7fadc000c890 comp rx=0 tx=0).stop 2024-04-24T23:58:52.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 shutdown_connections 2024-04-24T23:58:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fada406be30 0x7fada406e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadc80c9ff0 0x7fadc806e240 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80c9b70 0x7fadc806dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 --2- 172.21.15.96:0/1435682660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadac0039b0 0x7fadc8149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 >> 172.21.15.96:0/1435682660 conn(0x7fadc80b1f10 msgr2=0x7fadc815d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 shutdown_connections 2024-04-24T23:58:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.134+0000 7fadcda00640 1 -- 172.21.15.96:0/1435682660 wait complete. 2024-04-24T23:58:52.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:52.155 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:52.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.350+0000 7f715b600640 1 Processor -- start 2024-04-24T23:58:52.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.350+0000 7f715b600640 1 -- start start 2024-04-24T23:58:52.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.352+0000 7f715b600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f715406d2a0 0x7f71540acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.352+0000 7f715b600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71540b3080 con 0x7f715415cd10 2024-04-24T23:58:52.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.352+0000 7f715b600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71540b3360 con 0x7f7154163610 2024-04-24T23:58:52.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.352+0000 7f715b600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f71540b4830 con 0x7f715406d2a0 2024-04-24T23:58:52.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.352+0000 7f7158c00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f715415cd10 0x7f71540b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55330/0 (socket says 172.21.15.96:55330) 2024-04-24T23:58:52.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.352+0000 7f7158c00640 1 -- 172.21.15.96:0/396121692 learned_addr learned my addr 172.21.15.96:0/396121692 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:52.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.352+0000 7f7159600640 1 --2- 172.21.15.96:0/396121692 >> v2:172.21.15.155:3300/0 conn(0x7f715406d2a0 0x7f71540acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260771748 0 0) 0x7f71540b3080 con 0x7f715415cd10 2024-04-24T23:58:52.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f713c003520 con 0x7f715415cd10 2024-04-24T23:58:52.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 791377066 0 0) 0x7f713c003520 con 0x7f715415cd10 2024-04-24T23:58:52.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 >> v2:172.21.15.155:3300/0 conn(0x7f715406d2a0 msgr2=0x7f71540acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:52.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 --2- 172.21.15.96:0/396121692 >> v2:172.21.15.155:3300/0 conn(0x7f715406d2a0 0x7f71540acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 >> v1:172.21.15.155:6789/0 conn(0x7f7154163610 legacy=0x7f715406cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71540b3640 con 0x7f715415cd10 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f7148001670 con 0x7f715415cd10 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 >> v1:172.21.15.96:6789/0 conn(0x7f715415cd10 legacy=0x7f71540b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 --2- 172.21.15.96:0/396121692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f713c0039b0 0x7f713c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 --2- 172.21.15.96:0/396121692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f713c004800 0x7f713c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 --2- 172.21.15.96:0/396121692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f713c0051c0 0x7f713c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f71540b4830 con 0x7f713c004800 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f713c00c060 con 0x7f713c0051c0 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f713c00c260 con 0x7f713c0039b0 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.353+0000 7f7153e00640 1 --2- 172.21.15.96:0/396121692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f713c004800 0x7f713c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.354+0000 7f7153e00640 1 -- 172.21.15.96:0/396121692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f713c0039b0 msgr2=0x7f713c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.354+0000 7f7153e00640 1 --2- 172.21.15.96:0/396121692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f713c0039b0 0x7f713c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.354+0000 7f7153e00640 1 -- 172.21.15.96:0/396121692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f713c0051c0 msgr2=0x7f713c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.354+0000 7f7153e00640 1 --2- 172.21.15.96:0/396121692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f713c0051c0 0x7f713c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.354+0000 7f7153e00640 1 -- 172.21.15.96:0/396121692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713c003520 con 0x7f713c004800 2024-04-24T23:58:52.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.354+0000 7f7159600640 1 -- 172.21.15.96:0/396121692 reap_dead start 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.355+0000 7f7153e00640 1 --2- 172.21.15.96:0/396121692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f713c004800 0x7f713c004c80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7140001750 tx=0x7f713c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8066b171abe94a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.355+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140001370 con 0x7f713c004800 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.355+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71400052d0 con 0x7f713c004800 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.355+0000 7f7153400640 1 -- 172.21.15.96:0/396121692 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714002abe0 con 0x7f713c004800 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.356+0000 7f715b600640 1 -- 172.21.15.96:0/396121692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f713c004800 msgr2=0x7f713c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.356+0000 7f715b600640 1 --2- 172.21.15.96:0/396121692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f713c004800 0x7f713c004c80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7140001750 tx=0x7f713c005830 comp rx=0 tx=0).stop 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.356+0000 7f715b600640 1 -- 172.21.15.96:0/396121692 shutdown_connections 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.356+0000 7f715b600640 1 --2- 172.21.15.96:0/396121692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f713c004800 0x7f713c004c80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.356+0000 7f715b600640 1 -- 172.21.15.96:0/396121692 >> 172.21.15.96:0/396121692 conn(0x7f71540b19c0 msgr2=0x7f71540b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.356+0000 7f715b600640 1 -- 172.21.15.96:0/396121692 shutdown_connections 2024-04-24T23:58:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.356+0000 7f715b600640 1 -- 172.21.15.96:0/396121692 wait complete. 2024-04-24T23:58:52.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.358+0000 7f715b600640 1 Processor -- start 2024-04-24T23:58:52.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.358+0000 7f715b600640 1 -- start start 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f715b600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f713c004800 0x7f71541f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f715b600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715409ab90 0x7f715409b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f715b600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71541ed040 0x7f71541ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f715b600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7154163a90 con 0x7f71541ed040 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f715b600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71540b3c90 con 0x7f715409ab90 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f715b600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f715406ee90 con 0x7f713c004800 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f7159600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71541ed040 0x7f71541ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f7159600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71541ed040 0x7f71541ed4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59694/0 (socket says 172.21.15.96:59694) 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f7159600640 1 -- 172.21.15.96:0/1569744054 learned_addr learned my addr 172.21.15.96:0/1569744054 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f7158c00640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f713c004800 0x7f71541f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.360+0000 7f7153e00640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715409ab90 0x7f715409b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7159600640 1 -- 172.21.15.96:0/1569744054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f713c004800 msgr2=0x7f71541f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7159600640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f713c004800 0x7f71541f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7159600640 1 -- 172.21.15.96:0/1569744054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715409ab90 msgr2=0x7f715409b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7159600640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715409ab90 0x7f715409b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7159600640 1 -- 172.21.15.96:0/1569744054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715409b550 con 0x7f71541ed040 2024-04-24T23:58:52.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7153e00640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715409ab90 0x7f715409b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:52.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7159600640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71541ed040 0x7f71541ed4c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7154070dc0 tx=0x7f714c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7150c00640 1 -- 172.21.15.96:0/1569744054 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c018020 con 0x7f71541ed040 2024-04-24T23:58:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7150c00640 1 -- 172.21.15.96:0/1569744054 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c00bab0 con 0x7f71541ed040 2024-04-24T23:58:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71541edd30 con 0x7f71541ed040 2024-04-24T23:58:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f7150c00640 1 -- 172.21.15.96:0/1569744054 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c014400 con 0x7f71541ed040 2024-04-24T23:58:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.361+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541ee2f0 con 0x7f71541ed040 2024-04-24T23:58:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.363+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7154069110 con 0x7f71541ed040 2024-04-24T23:58:52.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.363+0000 7f7150c00640 1 -- 172.21.15.96:0/1569744054 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f714c005d10 con 0x7f71541ed040 2024-04-24T23:58:52.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.364+0000 7f7150c00640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f713406be30 0x7f713406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.364+0000 7f7150c00640 1 -- 172.21.15.96:0/1569744054 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f714c08b510 con 0x7f71541ed040 2024-04-24T23:58:52.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.365+0000 7f7158c00640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f713406be30 0x7f713406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.365+0000 7f7158c00640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f713406be30 0x7f713406e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7154069890 tx=0x7f71480015b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.369+0000 7f7150c00640 1 -- 172.21.15.96:0/1569744054 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f714c022030 con 0x7f71541ed040 2024-04-24T23:58:52.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.567+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f715406ec20 con 0x7f71541ed040 2024-04-24T23:58:52.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.568+0000 7f7150c00640 1 -- 172.21.15.96:0/1569744054 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f715409b550 con 0x7f71541ed040 2024-04-24T23:58:52.568 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:52.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f713406be30 msgr2=0x7f713406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f713406be30 0x7f713406e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7154069890 tx=0x7f71480015b0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71541ed040 msgr2=0x7f71541ed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71541ed040 0x7f71541ed4c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7154070dc0 tx=0x7f714c00eea0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 shutdown_connections 2024-04-24T23:58:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f713406be30 0x7f713406e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71541ed040 0x7f71541ed4c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715409ab90 0x7f715409b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 --2- 172.21.15.96:0/1569744054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f713c004800 0x7f71541f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.571+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 >> 172.21.15.96:0/1569744054 conn(0x7f71540b19c0 msgr2=0x7f71540ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:52.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.572+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 shutdown_connections 2024-04-24T23:58:52.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.572+0000 7f715b600640 1 -- 172.21.15.96:0/1569744054 wait complete. 2024-04-24T23:58:52.591 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.794+0000 7f58dca00640 1 Processor -- start 2024-04-24T23:58:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.794+0000 7f58dca00640 1 -- start start 2024-04-24T23:58:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.796+0000 7f58dca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d815e2f0 0x7f58d80d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.796+0000 7f58dca00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58d80d4bc0 0x7f58d80cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.796+0000 7f58dca00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f58d80cef50 0x7f58d80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.796+0000 7f58dca00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f58d80d1900 con 0x7f58d80cef50 2024-04-24T23:58:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.796+0000 7f58dca00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f58d80cf890 con 0x7f58d80d4bc0 2024-04-24T23:58:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.796+0000 7f58dca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58d80cfb70 con 0x7f58d815e2f0 2024-04-24T23:58:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.796+0000 7f58d7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f58d80cef50 0x7f58d80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.796+0000 7f58d7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f58d80cef50 0x7f58d80d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59700/0 (socket says 172.21.15.96:59700) 2024-04-24T23:58:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.796+0000 7f58d7e00640 1 -- 172.21.15.96:0/2597411479 learned_addr learned my addr 172.21.15.96:0/2597411479 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.797+0000 7f58d7400640 1 --2- 172.21.15.96:0/2597411479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d815e2f0 0x7f58d80d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.797+0000 7f58d6a00640 1 --2- 172.21.15.96:0/2597411479 >> v2:172.21.15.155:3300/0 conn(0x7f58d80d4bc0 0x7f58d80cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.797+0000 7f58d7e00640 1 -- 172.21.15.96:0/2597411479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d815e2f0 msgr2=0x7f58d80d4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.797+0000 7f58d7e00640 1 --2- 172.21.15.96:0/2597411479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d815e2f0 0x7f58d80d4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.797+0000 7f58d7e00640 1 -- 172.21.15.96:0/2597411479 >> v2:172.21.15.155:3300/0 conn(0x7f58d80d4bc0 msgr2=0x7f58d80cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.797+0000 7f58d7e00640 1 --2- 172.21.15.96:0/2597411479 >> v2:172.21.15.155:3300/0 conn(0x7f58d80d4bc0 0x7f58d80cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.797+0000 7f58d7e00640 1 -- 172.21.15.96:0/2597411479 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d80b3660 con 0x7f58d80cef50 2024-04-24T23:58:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.797+0000 7f58d6a00640 1 --2- 172.21.15.96:0/2597411479 >> v2:172.21.15.155:3300/0 conn(0x7f58d80d4bc0 0x7f58d80cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:52.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.798+0000 7f58d7e00640 1 --2- 172.21.15.96:0/2597411479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d80cef50 0x7f58d80d05a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58d808c190 tx=0x7f58d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b6cc59116c6ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:52.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.798+0000 7f58d6000640 1 -- 172.21.15.96:0/2597411479 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0037070 con 0x7f58d80cef50 2024-04-24T23:58:52.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.798+0000 7f58d6000640 1 -- 172.21.15.96:0/2597411479 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d0032440 con 0x7f58d80cef50 2024-04-24T23:58:52.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.798+0000 7f58d6000640 1 -- 172.21.15.96:0/2597411479 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0032810 con 0x7f58d80cef50 2024-04-24T23:58:52.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.799+0000 7f58dca00640 1 -- 172.21.15.96:0/2597411479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d80cef50 msgr2=0x7f58d80d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.799+0000 7f58dca00640 1 --2- 172.21.15.96:0/2597411479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d80cef50 0x7f58d80d05a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58d808c190 tx=0x7f58d002a140 comp rx=0 tx=0).stop 2024-04-24T23:58:52.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.799+0000 7f58dca00640 1 -- 172.21.15.96:0/2597411479 shutdown_connections 2024-04-24T23:58:52.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.799+0000 7f58dca00640 1 --2- 172.21.15.96:0/2597411479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d80cef50 0x7f58d80d05a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.799+0000 7f58dca00640 1 --2- 172.21.15.96:0/2597411479 >> v2:172.21.15.155:3300/0 conn(0x7f58d80d4bc0 0x7f58d80cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.799+0000 7f58dca00640 1 --2- 172.21.15.96:0/2597411479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d815e2f0 0x7f58d80d4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.799+0000 7f58dca00640 1 -- 172.21.15.96:0/2597411479 >> 172.21.15.96:0/2597411479 conn(0x7f58d809d260 msgr2=0x7f58d80d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:52.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.799+0000 7f58dca00640 1 -- 172.21.15.96:0/2597411479 shutdown_connections 2024-04-24T23:58:52.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.799+0000 7f58dca00640 1 -- 172.21.15.96:0/2597411479 wait complete. 2024-04-24T23:58:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.801+0000 7f58dca00640 1 Processor -- start 2024-04-24T23:58:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.801+0000 7f58dca00640 1 -- start start 2024-04-24T23:58:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.802+0000 7f58dca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d80cef50 0x7f58d814e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.802+0000 7f58dca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d80d4bc0 0x7f58d80b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.802+0000 7f58dca00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d815e2f0 0x7f58d815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.802+0000 7f58dca00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f58d815e850 con 0x7f58d815e2f0 2024-04-24T23:58:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.802+0000 7f58dca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f58d815e6d0 con 0x7f58d80d4bc0 2024-04-24T23:58:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.802+0000 7f58dca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58d80cf3c0 con 0x7f58d80cef50 2024-04-24T23:58:52.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.802+0000 7f58d7e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d815e2f0 0x7f58d815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.802+0000 7f58d7e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d815e2f0 0x7f58d815b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59702/0 (socket says 172.21.15.96:59702) 2024-04-24T23:58:52.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.802+0000 7f58d7e00640 1 -- 172.21.15.96:0/372879458 learned_addr learned my addr 172.21.15.96:0/372879458 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:52.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58d7400640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d80cef50 0x7f58d814e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58d6a00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d80d4bc0 0x7f58d80b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58d7e00640 1 -- 172.21.15.96:0/372879458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d80cef50 msgr2=0x7f58d814e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58d7e00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d80cef50 0x7f58d814e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58d7e00640 1 -- 172.21.15.96:0/372879458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d80d4bc0 msgr2=0x7f58d80b90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58d7e00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d80d4bc0 0x7f58d80b90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58d7e00640 1 -- 172.21.15.96:0/372879458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d815ec20 con 0x7f58d815e2f0 2024-04-24T23:58:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58d7e00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d815e2f0 0x7f58d815b620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f58d00090b0 tx=0x7f58d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58cf400640 1 -- 172.21.15.96:0/372879458 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0037040 con 0x7f58d815e2f0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58cf400640 1 -- 172.21.15.96:0/372879458 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d0042070 con 0x7f58d815e2f0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58cf400640 1 -- 172.21.15.96:0/372879458 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0030920 con 0x7f58d815e2f0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.803+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d815ee90 con 0x7f58d815e2f0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.804+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d815f450 con 0x7f58d815e2f0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.805+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d80755d0 con 0x7f58d815e2f0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.806+0000 7f58cf400640 1 -- 172.21.15.96:0/372879458 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58d0030ac0 con 0x7f58d815e2f0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.807+0000 7f58cf400640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f58b406be30 0x7f58b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.807+0000 7f58cf400640 1 -- 172.21.15.96:0/372879458 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f58d00ab8c0 con 0x7f58d815e2f0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.807+0000 7f58d7400640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f58b406be30 0x7f58b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.808+0000 7f58d7400640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f58b406be30 0x7f58b406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f58c80099c0 tx=0x7f58c8003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:52.811+0000 7f58cf400640 1 -- 172.21.15.96:0/372879458 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f58d0079b00 con 0x7f58d815e2f0 2024-04-24T23:58:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.010+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f58d815f620 con 0x7f58d815e2f0 2024-04-24T23:58:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.011+0000 7f58cf400640 1 -- 172.21.15.96:0/372879458 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f58d007de00 con 0x7f58d815e2f0 2024-04-24T23:58:53.011 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:53.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f58b406be30 msgr2=0x7f58b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f58b406be30 0x7f58b406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f58c80099c0 tx=0x7f58c8003990 comp rx=0 tx=0).stop 2024-04-24T23:58:53.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d815e2f0 msgr2=0x7f58d815b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d815e2f0 0x7f58d815b620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f58d00090b0 tx=0x7f58d00046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 shutdown_connections 2024-04-24T23:58:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f58b406be30 0x7f58b406e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d815e2f0 0x7f58d815b620 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d80d4bc0 0x7f58d80b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 --2- 172.21.15.96:0/372879458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58d80cef50 0x7f58d814e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 >> 172.21.15.96:0/372879458 conn(0x7f58d809d260 msgr2=0x7f58d806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 shutdown_connections 2024-04-24T23:58:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.014+0000 7f58dca00640 1 -- 172.21.15.96:0/372879458 wait complete. 2024-04-24T23:58:53.033 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:53.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.234+0000 7fc47fe00640 1 Processor -- start 2024-04-24T23:58:53.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.234+0000 7fc47fe00640 1 -- start start 2024-04-24T23:58:53.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.235+0000 7fc47fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48015f160 0x7fc480165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.236+0000 7fc47fe00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4800b36f0 con 0x7fc4801446c0 2024-04-24T23:58:53.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.236+0000 7fc47fe00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4800b39d0 con 0x7fc4800b4790 2024-04-24T23:58:53.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.236+0000 7fc47fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc4800b4300 con 0x7fc48015f160 2024-04-24T23:58:53.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.236+0000 7fc47ea00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc4801446c0 0x7fc48006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55336/0 (socket says 172.21.15.96:55336) 2024-04-24T23:58:53.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.236+0000 7fc47ea00640 1 -- 172.21.15.96:0/1671731445 learned_addr learned my addr 172.21.15.96:0/1671731445 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:53.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.236+0000 7fc47f400640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48015f160 0x7fc480165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.236+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028374079 0 0) 0x7fc4800b36f0 con 0x7fc4801446c0 2024-04-24T23:58:53.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.236+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc464003420 con 0x7fc4801446c0 2024-04-24T23:58:53.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2687927340 0 0) 0x7fc464003420 con 0x7fc4801446c0 2024-04-24T23:58:53.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48015f160 msgr2=0x7fc480165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:53.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48015f160 0x7fc480165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 >> v1:172.21.15.155:6789/0 conn(0x7fc4800b4790 legacy=0x7fc48015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4800b3cb0 con 0x7fc4801446c0 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fc470001670 con 0x7fc4801446c0 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 >> v1:172.21.15.96:6789/0 conn(0x7fc4801446c0 legacy=0x7fc48006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48015f160 0x7fc464004ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc464005060 0x7fc4640036a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc46400fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc4800b4300 con 0x7fc464003de0 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc4640100b0 con 0x7fc464005060 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc464010230 con 0x7fc48015f160 2024-04-24T23:58:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47f400640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc46400fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47ea00640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48015f160 0x7fc464004ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.237+0000 7fc47e000640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc464005060 0x7fc4640036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.238+0000 7fc47f400640 1 -- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48015f160 msgr2=0x7fc464004ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.238+0000 7fc47f400640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48015f160 0x7fc464004ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.238+0000 7fc47f400640 1 -- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc464005060 msgr2=0x7fc4640036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.238+0000 7fc47f400640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc464005060 0x7fc4640036a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.238+0000 7fc47f400640 1 -- 172.21.15.96:0/1671731445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc464003420 con 0x7fc464003de0 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.238+0000 7fc47e000640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc464005060 0x7fc4640036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.239+0000 7fc47f400640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc46400fb70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc478009fc0 tx=0x7fc464004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2f317589f6d179 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.239+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478009c10 con 0x7fc464003de0 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.239+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc478036070 con 0x7fc464003de0 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.239+0000 7fc47d600640 1 -- 172.21.15.96:0/1671731445 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478031840 con 0x7fc464003de0 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.239+0000 7fc47fe00640 1 -- 172.21.15.96:0/1671731445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 msgr2=0x7fc46400fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.239+0000 7fc47fe00640 1 --2- 172.21.15.96:0/1671731445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc46400fb70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc478009fc0 tx=0x7fc464004720 comp rx=0 tx=0).stop 2024-04-24T23:58:53.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.239+0000 7fc47f400640 1 -- 172.21.15.96:0/1671731445 reap_dead start 2024-04-24T23:58:53.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.240+0000 7fc47fe00640 1 -- 172.21.15.96:0/1671731445 shutdown_connections 2024-04-24T23:58:53.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.240+0000 7fc47fe00640 1 -- 172.21.15.96:0/1671731445 >> 172.21.15.96:0/1671731445 conn(0x7fc4800b18b0 msgr2=0x7fc4800b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:53.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.240+0000 7fc47fe00640 1 -- 172.21.15.96:0/1671731445 shutdown_connections 2024-04-24T23:58:53.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.240+0000 7fc47fe00640 1 -- 172.21.15.96:0/1671731445 wait complete. 2024-04-24T23:58:53.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.241+0000 7fc47fe00640 1 Processor -- start 2024-04-24T23:58:53.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.241+0000 7fc47fe00640 1 -- start start 2024-04-24T23:58:53.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.242+0000 7fc47fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc480137560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.242+0000 7fc47fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48013b730 0x7fc48013bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.242+0000 7fc47fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4800cfe20 0x7fc4800d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.242+0000 7fc47fe00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc48006ead0 con 0x7fc464003de0 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.242+0000 7fc47fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc480071cb0 con 0x7fc4800cfe20 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.242+0000 7fc47fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc480144aa0 con 0x7fc48013b730 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47ea00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc480137560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47ea00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc480137560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59728/0 (socket says 172.21.15.96:59728) 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47ea00640 1 -- 172.21.15.96:0/2791566141 learned_addr learned my addr 172.21.15.96:0/2791566141 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47f400640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4800cfe20 0x7fc4800d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47e000640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48013b730 0x7fc48013bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47ea00640 1 -- 172.21.15.96:0/2791566141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48013b730 msgr2=0x7fc48013bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47ea00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48013b730 0x7fc48013bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47ea00640 1 -- 172.21.15.96:0/2791566141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4800cfe20 msgr2=0x7fc4800d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47ea00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4800cfe20 0x7fc4800d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47ea00640 1 -- 172.21.15.96:0/2791566141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48013e9b0 con 0x7fc464003de0 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47f400640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4800cfe20 0x7fc4800d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.243+0000 7fc47ea00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc480137560 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc47000e840 tx=0x7fc47000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.244+0000 7fc476a00640 1 -- 172.21.15.96:0/2791566141 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47000c8d0 con 0x7fc464003de0 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.244+0000 7fc476a00640 1 -- 172.21.15.96:0/2791566141 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc470018070 con 0x7fc464003de0 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.244+0000 7fc476a00640 1 -- 172.21.15.96:0/2791566141 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47000ccb0 con 0x7fc464003de0 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.244+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc480137aa0 con 0x7fc464003de0 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.244+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4800cd5d0 con 0x7fc464003de0 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.245+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4800755d0 con 0x7fc464003de0 2024-04-24T23:58:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.246+0000 7fc476a00640 1 -- 172.21.15.96:0/2791566141 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc47001d460 con 0x7fc464003de0 2024-04-24T23:58:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.247+0000 7fc476a00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc46006be30 0x7fc46006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.247+0000 7fc476a00640 1 -- 172.21.15.96:0/2791566141 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fc47008aeb0 con 0x7fc464003de0 2024-04-24T23:58:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.247+0000 7fc47e000640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc46006be30 0x7fc46006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.248+0000 7fc47e000640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc46006be30 0x7fc46006e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007fd0 tx=0x7fc46c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:53.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.251+0000 7fc476a00640 1 -- 172.21.15.96:0/2791566141 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc480137aa0 con 0x7fc464003de0 2024-04-24T23:58:53.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.448+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc48006ce30 con 0x7fc464003de0 2024-04-24T23:58:53.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.449+0000 7fc476a00640 1 -- 172.21.15.96:0/2791566141 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fc470059740 con 0x7fc464003de0 2024-04-24T23:58:53.449 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:53.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc46006be30 msgr2=0x7fc46006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc46006be30 0x7fc46006e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007fd0 tx=0x7fc46c009040 comp rx=0 tx=0).stop 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 msgr2=0x7fc480137560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc480137560 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc47000e840 tx=0x7fc47000ed00 comp rx=0 tx=0).stop 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 shutdown_connections 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4800cfe20 0x7fc4800d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc48013b730 0x7fc48013bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc46006be30 0x7fc46006e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 --2- 172.21.15.96:0/2791566141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc464003de0 0x7fc480137560 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 >> 172.21.15.96:0/2791566141 conn(0x7fc4800b18b0 msgr2=0x7fc480142230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 shutdown_connections 2024-04-24T23:58:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.452+0000 7fc47fe00640 1 -- 172.21.15.96:0/2791566141 wait complete. 2024-04-24T23:58:53.472 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:58:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.667+0000 7fb6af200640 1 Processor -- start 2024-04-24T23:58:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.667+0000 7fb6af200640 1 -- start start 2024-04-24T23:58:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.669+0000 7fb6af200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb6a80b4ec0 0x7fb6a80cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.669+0000 7fb6af200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a815fa90 con 0x7fb6a80ccc20 2024-04-24T23:58:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.669+0000 7fb6af200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a80b3e20 con 0x7fb6a815f6b0 2024-04-24T23:58:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.669+0000 7fb6af200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb6a80b4a30 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.669+0000 7fb6ad400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb6a80b4ec0 0x7fb6a80cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.670+0000 7fb6ae800640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb6a80ccc20 0x7fb6a8070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55352/0 (socket says 172.21.15.96:55352) 2024-04-24T23:58:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.670+0000 7fb6ae800640 1 -- 172.21.15.96:0/2489571122 learned_addr learned my addr 172.21.15.96:0/2489571122 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.670+0000 7fb6ad400640 1 -- 172.21.15.96:0/2489571122 >> v1:172.21.15.155:6789/0 conn(0x7fb6a815f6b0 legacy=0x7fb6a80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.670+0000 7fb6ad400640 1 -- 172.21.15.96:0/2489571122 >> v1:172.21.15.96:6789/0 conn(0x7fb6a80ccc20 legacy=0x7fb6a8070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.670+0000 7fb6ad400640 1 -- 172.21.15.96:0/2489571122 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a80b4100 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.670+0000 7fb6aca00640 1 -- 172.21.15.96:0/2489571122 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2615365661 0 0) 0x7fb6a815fa90 con 0x7fb6a80ccc20 2024-04-24T23:58:53.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.671+0000 7fb6ad400640 1 --2- 172.21.15.96:0/2489571122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 0x7fb6a80cc6e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb6980097a0 tx=0x7fb69802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37884ae3cbb90e2b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:53.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.671+0000 7fb6aca00640 1 -- 172.21.15.96:0/2489571122 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb698037070 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.671+0000 7fb6aca00640 1 -- 172.21.15.96:0/2489571122 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb698032440 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.671+0000 7fb6aca00640 1 -- 172.21.15.96:0/2489571122 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb698032810 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.672+0000 7fb6af200640 1 -- 172.21.15.96:0/2489571122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 msgr2=0x7fb6a80cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.672+0000 7fb6af200640 1 --2- 172.21.15.96:0/2489571122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 0x7fb6a80cc6e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb6980097a0 tx=0x7fb69802a1e0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.672+0000 7fb6af200640 1 -- 172.21.15.96:0/2489571122 shutdown_connections 2024-04-24T23:58:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.672+0000 7fb6af200640 1 --2- 172.21.15.96:0/2489571122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 0x7fb6a80cc6e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.672+0000 7fb6af200640 1 -- 172.21.15.96:0/2489571122 >> 172.21.15.96:0/2489571122 conn(0x7fb6a80b1f10 msgr2=0x7fb6a80cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.672+0000 7fb6af200640 1 -- 172.21.15.96:0/2489571122 shutdown_connections 2024-04-24T23:58:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.672+0000 7fb6af200640 1 -- 172.21.15.96:0/2489571122 wait complete. 2024-04-24T23:58:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.674+0000 7fb6af200640 1 Processor -- start 2024-04-24T23:58:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.674+0000 7fb6af200640 1 -- start start 2024-04-24T23:58:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.675+0000 7fb6af200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 0x7fb6a8150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.675+0000 7fb6af200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6a80ccc20 0x7fb6a81f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.675+0000 7fb6af200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6a815f6b0 0x7fb6a809d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.675+0000 7fb6af200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a80cf1c0 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.675+0000 7fb6af200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a80b46c0 con 0x7fb6a815f6b0 2024-04-24T23:58:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.675+0000 7fb6af200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a80b3a40 con 0x7fb6a80ccc20 2024-04-24T23:58:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.675+0000 7fb6ade00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 0x7fb6a8150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.675+0000 7fb6ade00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 0x7fb6a8150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59746/0 (socket says 172.21.15.96:59746) 2024-04-24T23:58:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.675+0000 7fb6ade00640 1 -- 172.21.15.96:0/1181788567 learned_addr learned my addr 172.21.15.96:0/1181788567 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6ade00640 1 -- 172.21.15.96:0/1181788567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6a80ccc20 msgr2=0x7fb6a81f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6ade00640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6a80ccc20 0x7fb6a81f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6ade00640 1 -- 172.21.15.96:0/1181788567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6a815f6b0 msgr2=0x7fb6a809d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6ade00640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6a815f6b0 0x7fb6a809d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6ade00640 1 -- 172.21.15.96:0/1181788567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a80ad250 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6ade00640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 0x7fb6a8150860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00b3f0 tx=0x7fb69c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6a2000640 1 -- 172.21.15.96:0/1181788567 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c015020 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6a2000640 1 -- 172.21.15.96:0/1181788567 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c011830 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6a2000640 1 -- 172.21.15.96:0/1181788567 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c011c20 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a80ad530 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.676+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a80adaf0 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.677+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a8067e40 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.678+0000 7fb6a2000640 1 -- 172.21.15.96:0/1181788567 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb69c018020 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.680+0000 7fb6a2000640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb68c06be30 0x7fb68c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.680+0000 7fb6a2000640 1 -- 172.21.15.96:0/1181788567 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fb69c08aaa0 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.680+0000 7fb6ad400640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb68c06be30 0x7fb68c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.681+0000 7fb6ad400640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb68c06be30 0x7fb68c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb698034000 tx=0x7fb69802c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:53.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.684+0000 7fb6a2000640 1 -- 172.21.15.96:0/1181788567 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb69c01f030 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.885+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb6a80d07d0 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.886+0000 7fb6a2000640 1 -- 172.21.15.96:0/1181788567 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fb69c0172c0 con 0x7fb6a80b4ec0 2024-04-24T23:58:53.887 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-24T23:58:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.888+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb68c06be30 msgr2=0x7fb68c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.888+0000 7fb6af200640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb68c06be30 0x7fb68c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb698034000 tx=0x7fb69802c000 comp rx=0 tx=0).stop 2024-04-24T23:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.888+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 msgr2=0x7fb6a8150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.888+0000 7fb6af200640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 0x7fb6a8150860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00b3f0 tx=0x7fb69c00b8b0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.889+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 shutdown_connections 2024-04-24T23:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.889+0000 7fb6af200640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6a815f6b0 0x7fb6a809d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.889+0000 7fb6af200640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6a80ccc20 0x7fb6a81f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.889+0000 7fb6af200640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb68c06be30 0x7fb68c06e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.889+0000 7fb6af200640 1 --2- 172.21.15.96:0/1181788567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6a80b4ec0 0x7fb6a8150860 secure :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00b3f0 tx=0x7fb69c00b8b0 comp rx=0 tx=0).stop 2024-04-24T23:58:53.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.889+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 >> 172.21.15.96:0/1181788567 conn(0x7fb6a80b1f10 msgr2=0x7fb6a80ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:53.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.889+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 shutdown_connections 2024-04-24T23:58:53.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:53.889+0000 7fb6af200640 1 -- 172.21.15.96:0/1181788567 wait complete. 2024-04-24T23:58:53.908 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-24T23:58:53.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:53.909 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-24T23:58:54.006 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-04-24T23:58:54.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:54.006 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-24T23:58:54.066 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:58:54.066 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:54.119 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:58:54.120 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:54.169 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:58:54.169 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:54.267 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:54.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.472+0000 7f6667000640 1 Processor -- start 2024-04-24T23:58:54.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.472+0000 7f6667000640 1 -- start start 2024-04-24T23:58:54.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.474+0000 7f6667000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f66601553f0 0x7f666015b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.474+0000 7f6667000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6660071470 0x7f66600cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.474+0000 7f6667000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66600ce100 con 0x7f66600cdbd0 2024-04-24T23:58:54.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.474+0000 7f6667000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f66600cf6e0 con 0x7f6660071470 2024-04-24T23:58:54.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.474+0000 7f6667000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f66600ce3e0 con 0x7f66601553f0 2024-04-24T23:58:54.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.474+0000 7f6666600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6660071470 0x7f66600cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.474+0000 7f6666600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6660071470 0x7f66600cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59762/0 (socket says 172.21.15.96:59762) 2024-04-24T23:58:54.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.474+0000 7f6666600640 1 -- 172.21.15.96:0/4214194270 learned_addr learned my addr 172.21.15.96:0/4214194270 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:54.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.475+0000 7f6666600640 1 -- 172.21.15.96:0/4214194270 >> v2:172.21.15.155:3300/0 conn(0x7f66601553f0 msgr2=0x7f666015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:54.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.475+0000 7f6666600640 1 --2- 172.21.15.96:0/4214194270 >> v2:172.21.15.155:3300/0 conn(0x7f66601553f0 0x7f666015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.475+0000 7f6666600640 1 -- 172.21.15.96:0/4214194270 >> v1:172.21.15.155:6789/0 conn(0x7f66600cdbd0 legacy=0x7f6660070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:54.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.475+0000 7f6666600640 1 -- 172.21.15.96:0/4214194270 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66600ce6c0 con 0x7f6660071470 2024-04-24T23:58:54.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.476+0000 7f6666600640 1 --2- 172.21.15.96:0/4214194270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6660071470 0x7f66600cf1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f66600cda80 tx=0x7f665802c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b547264ecf2e46f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:54.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.476+0000 7f665fe00640 1 -- 172.21.15.96:0/4214194270 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658009600 con 0x7f6660071470 2024-04-24T23:58:54.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.476+0000 7f665fe00640 1 -- 172.21.15.96:0/4214194270 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66580097a0 con 0x7f6660071470 2024-04-24T23:58:54.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.476+0000 7f665fe00640 1 -- 172.21.15.96:0/4214194270 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658009b70 con 0x7f6660071470 2024-04-24T23:58:54.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.477+0000 7f6667000640 1 -- 172.21.15.96:0/4214194270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6660071470 msgr2=0x7f66600cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:54.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.477+0000 7f6667000640 1 --2- 172.21.15.96:0/4214194270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6660071470 0x7f66600cf1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f66600cda80 tx=0x7f665802c900 comp rx=0 tx=0).stop 2024-04-24T23:58:54.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.477+0000 7f6667000640 1 -- 172.21.15.96:0/4214194270 shutdown_connections 2024-04-24T23:58:54.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.477+0000 7f6667000640 1 --2- 172.21.15.96:0/4214194270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6660071470 0x7f66600cf1a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.477+0000 7f6667000640 1 --2- 172.21.15.96:0/4214194270 >> v2:172.21.15.155:3300/0 conn(0x7f66601553f0 0x7f666015b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.477+0000 7f6667000640 1 -- 172.21.15.96:0/4214194270 >> 172.21.15.96:0/4214194270 conn(0x7f66600b1f10 msgr2=0x7f66600cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:54.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.477+0000 7f6667000640 1 -- 172.21.15.96:0/4214194270 shutdown_connections 2024-04-24T23:58:54.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.477+0000 7f6667000640 1 -- 172.21.15.96:0/4214194270 wait complete. 2024-04-24T23:58:54.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.479+0000 7f6667000640 1 Processor -- start 2024-04-24T23:58:54.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.480+0000 7f6667000640 1 -- start start 2024-04-24T23:58:54.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6667000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6660071470 0x7f66600ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6667000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600cdbd0 0x7f666009c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6667000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601553f0 0x7f66600ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6667000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f666006cdb0 con 0x7f66601553f0 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6667000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f666006cc30 con 0x7f6660071470 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6667000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f66601557d0 con 0x7f66600cdbd0 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6666600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601553f0 0x7f66600ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6666600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601553f0 0x7f66600ae460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59778/0 (socket says 172.21.15.96:59778) 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6666600640 1 -- 172.21.15.96:0/281256528 learned_addr learned my addr 172.21.15.96:0/281256528 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6665200640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600cdbd0 0x7f666009c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6665c00640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6660071470 0x7f66600ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6666600640 1 -- 172.21.15.96:0/281256528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600cdbd0 msgr2=0x7f666009c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.481+0000 7f6666600640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600cdbd0 0x7f666009c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.482+0000 7f6666600640 1 -- 172.21.15.96:0/281256528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6660071470 msgr2=0x7f66600ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:54.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.482+0000 7f6666600640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6660071470 0x7f66600ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.482+0000 7f6666600640 1 -- 172.21.15.96:0/281256528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66600af400 con 0x7f66601553f0 2024-04-24T23:58:54.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.482+0000 7f6666600640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601553f0 0x7f66600ae460 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f665800d210 tx=0x7f6658004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:54.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.482+0000 7f665d600640 1 -- 172.21.15.96:0/281256528 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658042070 con 0x7f66601553f0 2024-04-24T23:58:54.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.482+0000 7f665d600640 1 -- 172.21.15.96:0/281256528 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6658034b90 con 0x7f66601553f0 2024-04-24T23:58:54.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.482+0000 7f665d600640 1 -- 172.21.15.96:0/281256528 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665800b720 con 0x7f66601553f0 2024-04-24T23:58:54.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.482+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66600af120 con 0x7f66601553f0 2024-04-24T23:58:54.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.482+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66600ad190 con 0x7f66601553f0 2024-04-24T23:58:54.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.484+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66600d0be0 con 0x7f66601553f0 2024-04-24T23:58:54.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.485+0000 7f665d600640 1 -- 172.21.15.96:0/281256528 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f665803c430 con 0x7f66601553f0 2024-04-24T23:58:54.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.485+0000 7f665d600640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f664006be30 0x7f664006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.486+0000 7f665d600640 1 -- 172.21.15.96:0/281256528 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f66580abe70 con 0x7f66601553f0 2024-04-24T23:58:54.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.486+0000 7f6665c00640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f664006be30 0x7f664006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.486+0000 7f6665c00640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f664006be30 0x7f664006e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f665400b810 tx=0x7f6654008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:54.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.490+0000 7f665d600640 1 -- 172.21.15.96:0/281256528 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f66600d0be0 con 0x7f66601553f0 2024-04-24T23:58:54.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.690+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66600d0930 con 0x7f66601553f0 2024-04-24T23:58:54.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.692+0000 7f665d600640 1 -- 172.21.15.96:0/281256528 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16851 (secure 0 0 0) 0x7f665807a850 con 0x7f66601553f0 2024-04-24T23:58:54.692 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:54.693 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:48.255571+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f664006be30 msgr2=0x7f664006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f664006be30 0x7f664006e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f665400b810 tx=0x7f6654008040 comp rx=0 tx=0).stop 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601553f0 msgr2=0x7f66600ae460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601553f0 0x7f66600ae460 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f665800d210 tx=0x7f6658004a40 comp rx=0 tx=0).stop 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 shutdown_connections 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f664006be30 0x7f664006e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601553f0 0x7f66600ae460 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600cdbd0 0x7f666009c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 --2- 172.21.15.96:0/281256528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6660071470 0x7f66600ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 >> 172.21.15.96:0/281256528 conn(0x7f66600b1f10 msgr2=0x7f666015b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 shutdown_connections 2024-04-24T23:58:54.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.695+0000 7f6667000640 1 -- 172.21.15.96:0/281256528 wait complete. 2024-04-24T23:58:54.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:54.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:54.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.924+0000 7fc8c1a00640 1 Processor -- start 2024-04-24T23:58:54.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.924+0000 7fc8c1a00640 1 -- start start 2024-04-24T23:58:54.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.925+0000 7fc8c1a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc8bc15bfc0 0x7fc8bc0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.925+0000 7fc8c1a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8bc162d90 con 0x7fc8bc0d0210 2024-04-24T23:58:54.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.925+0000 7fc8c1a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8bc15c3a0 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.925+0000 7fc8c1a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc8bc0d0760 con 0x7fc8bc15bfc0 2024-04-24T23:58:54.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.925+0000 7fc8baa00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc8bc15bfc0 0x7fc8bc0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.925+0000 7fc8baa00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc8bc15bfc0 0x7fc8bc0ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59786/0 (socket says 172.21.15.96:59786) 2024-04-24T23:58:54.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.925+0000 7fc8ba000640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc8bc0d0210 0x7fc8bc161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55362/0 (socket says 172.21.15.96:55362) 2024-04-24T23:58:54.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.925+0000 7fc8baa00640 1 -- 172.21.15.96:0/55917340 learned_addr learned my addr 172.21.15.96:0/55917340 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:54.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.926+0000 7fc8baa00640 1 -- 172.21.15.96:0/55917340 >> v1:172.21.15.155:6789/0 conn(0x7fc8bc15e9f0 legacy=0x7fc8bc162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:54.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.926+0000 7fc8baa00640 1 -- 172.21.15.96:0/55917340 >> v1:172.21.15.96:6789/0 conn(0x7fc8bc0d0210 legacy=0x7fc8bc161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:54.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.926+0000 7fc8baa00640 1 -- 172.21.15.96:0/55917340 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc0d0a40 con 0x7fc8bc15bfc0 2024-04-24T23:58:54.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.926+0000 7fc8b9600640 1 -- 172.21.15.96:0/55917340 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3717340014 0 0) 0x7fc8bc162d90 con 0x7fc8bc0d0210 2024-04-24T23:58:54.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.927+0000 7fc8baa00640 1 --2- 172.21.15.96:0/55917340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15bfc0 0x7fc8bc0ce750 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009870 tx=0x7fc8ac02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5faca36aff8866aa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:54.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8b9600640 1 -- 172.21.15.96:0/55917340 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac037070 con 0x7fc8bc15bfc0 2024-04-24T23:58:54.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8b9600640 1 -- 172.21.15.96:0/55917340 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac032440 con 0x7fc8bc15bfc0 2024-04-24T23:58:54.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8b9600640 1 -- 172.21.15.96:0/55917340 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac032810 con 0x7fc8bc15bfc0 2024-04-24T23:58:54.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8c1a00640 1 -- 172.21.15.96:0/55917340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15bfc0 msgr2=0x7fc8bc0ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:54.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8c1a00640 1 --2- 172.21.15.96:0/55917340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15bfc0 0x7fc8bc0ce750 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009870 tx=0x7fc8ac02a2a0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8c1a00640 1 -- 172.21.15.96:0/55917340 shutdown_connections 2024-04-24T23:58:54.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8c1a00640 1 --2- 172.21.15.96:0/55917340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15bfc0 0x7fc8bc0ce750 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8c1a00640 1 -- 172.21.15.96:0/55917340 >> 172.21.15.96:0/55917340 conn(0x7fc8bc0d1ed0 msgr2=0x7fc8bc0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:54.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8c1a00640 1 -- 172.21.15.96:0/55917340 shutdown_connections 2024-04-24T23:58:54.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.928+0000 7fc8c1a00640 1 -- 172.21.15.96:0/55917340 wait complete. 2024-04-24T23:58:54.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.930+0000 7fc8c1a00640 1 Processor -- start 2024-04-24T23:58:54.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.930+0000 7fc8c1a00640 1 -- start start 2024-04-24T23:58:54.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.931+0000 7fc8c1a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8bc0d0210 0x7fc8bc143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.931+0000 7fc8c1a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8bc15bfc0 0x7fc8bc158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.931+0000 7fc8c1a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15e9f0 0x7fc8bc157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.931+0000 7fc8c1a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc0d12e0 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.931+0000 7fc8c1a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc0d1000 con 0x7fc8bc15bfc0 2024-04-24T23:58:54.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.931+0000 7fc8c1a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8bc0cf690 con 0x7fc8bc0d0210 2024-04-24T23:58:54.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8bb400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15e9f0 0x7fc8bc157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8bb400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15e9f0 0x7fc8bc157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59790/0 (socket says 172.21.15.96:59790) 2024-04-24T23:58:54.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8bb400640 1 -- 172.21.15.96:0/2784203241 learned_addr learned my addr 172.21.15.96:0/2784203241 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:54.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8baa00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8bc0d0210 0x7fc8bc143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8ba000640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8bc15bfc0 0x7fc8bc158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8bb400640 1 -- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8bc0d0210 msgr2=0x7fc8bc143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8bb400640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8bc0d0210 0x7fc8bc143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8bb400640 1 -- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8bc15bfc0 msgr2=0x7fc8bc158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8bb400640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8bc15bfc0 0x7fc8bc158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8bb400640 1 -- 172.21.15.96:0/2784203241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc157d60 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8baa00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8bc0d0210 0x7fc8bc143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8ba000640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8bc15bfc0 0x7fc8bc158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.932+0000 7fc8bb400640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15e9f0 0x7fc8bc157120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b970 tx=0x7fc8b400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.933+0000 7fc8b2a00640 1 -- 172.21.15.96:0/2784203241 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4019070 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.933+0000 7fc8b2a00640 1 -- 172.21.15.96:0/2784203241 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b400cb40 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.933+0000 7fc8b2a00640 1 -- 172.21.15.96:0/2784203241 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4014440 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.933+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc158040 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.933+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc158600 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.934+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8bc069110 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.935+0000 7fc8b2a00640 1 -- 172.21.15.96:0/2784203241 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8b401c070 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.936+0000 7fc8b2a00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc89c06be30 0x7fc89c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:54.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.937+0000 7fc8b2a00640 1 -- 172.21.15.96:0/2784203241 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fc8b408abe0 con 0x7fc8bc15e9f0 2024-04-24T23:58:54.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.937+0000 7fc8baa00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc89c06be30 0x7fc89c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:54.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.937+0000 7fc8baa00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc89c06be30 0x7fc89c06e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac034000 tx=0x7fc8ac02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:54.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:54.941+0000 7fc8b2a00640 1 -- 172.21.15.96:0/2784203241 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc8b4059460 con 0x7fc8bc15e9f0 2024-04-24T23:58:55.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.136+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8bc0b2d80 con 0x7fc8bc15e9f0 2024-04-24T23:58:55.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.137+0000 7fc8b2a00640 1 -- 172.21.15.96:0/2784203241 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fc8b4058d60 con 0x7fc8bc15e9f0 2024-04-24T23:58:55.138 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:55.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc89c06be30 msgr2=0x7fc89c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc89c06be30 0x7fc89c06e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac034000 tx=0x7fc8ac02e000 comp rx=0 tx=0).stop 2024-04-24T23:58:55.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15e9f0 msgr2=0x7fc8bc157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15e9f0 0x7fc8bc157120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b970 tx=0x7fc8b400be30 comp rx=0 tx=0).stop 2024-04-24T23:58:55.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 shutdown_connections 2024-04-24T23:58:55.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc89c06be30 0x7fc89c06e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8bc15e9f0 0x7fc8bc157120 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8bc15bfc0 0x7fc8bc158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 --2- 172.21.15.96:0/2784203241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8bc0d0210 0x7fc8bc143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 >> 172.21.15.96:0/2784203241 conn(0x7fc8bc0d1ed0 msgr2=0x7fc8bc15c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:55.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 shutdown_connections 2024-04-24T23:58:55.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.140+0000 7fc8c1a00640 1 -- 172.21.15.96:0/2784203241 wait complete. 2024-04-24T23:58:55.160 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:55.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.365+0000 7f64a8400640 1 Processor -- start 2024-04-24T23:58:55.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.365+0000 7f64a8400640 1 -- start start 2024-04-24T23:58:55.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.367+0000 7f64a8400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f64a006edb0 0x7f64a00b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.367+0000 7f64a8400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a015f750 con 0x7f64a01551c0 2024-04-24T23:58:55.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.367+0000 7f64a8400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a015ef00 con 0x7f64a00b3200 2024-04-24T23:58:55.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.367+0000 7f64a8400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f64a015f190 con 0x7f64a006edb0 2024-04-24T23:58:55.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.367+0000 7f64a5a00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f64a01551c0 0x7f64a015e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55374/0 (socket says 172.21.15.96:55374) 2024-04-24T23:58:55.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.367+0000 7f64a5a00640 1 -- 172.21.15.96:0/100570437 learned_addr learned my addr 172.21.15.96:0/100570437 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:55.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.367+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448939507 0 0) 0x7f64a015f750 con 0x7f64a01551c0 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6488003520 con 0x7f64a01551c0 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f64a5000640 1 --2- 172.21.15.96:0/100570437 >> v2:172.21.15.155:3300/0 conn(0x7f64a006edb0 0x7f64a00b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1283926547 0 0) 0x7f6488003520 con 0x7f64a01551c0 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 >> v2:172.21.15.155:3300/0 conn(0x7f64a006edb0 msgr2=0x7f64a00b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 --2- 172.21.15.96:0/100570437 >> v2:172.21.15.155:3300/0 conn(0x7f64a006edb0 0x7f64a00b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 >> v1:172.21.15.155:6789/0 conn(0x7f64a00b3200 legacy=0x7f64a00726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a015f470 con 0x7f64a01551c0 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f6494001670 con 0x7f64a01551c0 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 >> v1:172.21.15.96:6789/0 conn(0x7f64a01551c0 legacy=0x7f64a015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880039b0 0x7f6488003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6488004800 0x7f6488004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880052e0 0x7f648800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f64a015f190 con 0x7f64880052e0 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f648800c1b0 con 0x7f64880039b0 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.368+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f648800c3b0 con 0x7f6488004800 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.369+0000 7f64a6400640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880052e0 0x7f648800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.369+0000 7f64a5a00640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880039b0 0x7f6488003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.369+0000 7f64a5000640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6488004800 0x7f6488004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.369+0000 7f64a6400640 1 -- 172.21.15.96:0/100570437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6488004800 msgr2=0x7f6488004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.369+0000 7f64a6400640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6488004800 0x7f6488004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.369+0000 7f64a6400640 1 -- 172.21.15.96:0/100570437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880039b0 msgr2=0x7f6488003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.369+0000 7f64a6400640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880039b0 0x7f6488003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.369+0000 7f64a6400640 1 -- 172.21.15.96:0/100570437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6488003520 con 0x7f64880052e0 2024-04-24T23:58:55.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.369+0000 7f64a5000640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6488004800 0x7f6488004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.370+0000 7f64a6400640 1 -- 172.21.15.96:0/100570437 reap_dead start 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.370+0000 7f64a6400640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880052e0 0x7f648800b9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f64a0158df0 tx=0x7f6488005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacf392cea2c5100 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.370+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498001a70 con 0x7f64880052e0 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.370+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649802ae10 con 0x7f64880052e0 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.370+0000 7f649fe00640 1 -- 172.21.15.96:0/100570437 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498003bb0 con 0x7f64880052e0 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.371+0000 7f64a8400640 1 -- 172.21.15.96:0/100570437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880052e0 msgr2=0x7f648800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.371+0000 7f64a8400640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880052e0 0x7f648800b9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f64a0158df0 tx=0x7f6488005830 comp rx=0 tx=0).stop 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.371+0000 7f64a8400640 1 -- 172.21.15.96:0/100570437 shutdown_connections 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.371+0000 7f64a8400640 1 --2- 172.21.15.96:0/100570437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880052e0 0x7f648800b9c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.371+0000 7f64a8400640 1 -- 172.21.15.96:0/100570437 >> 172.21.15.96:0/100570437 conn(0x7f64a00b19c0 msgr2=0x7f64a00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:55.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.371+0000 7f64a8400640 1 -- 172.21.15.96:0/100570437 shutdown_connections 2024-04-24T23:58:55.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.371+0000 7f64a8400640 1 -- 172.21.15.96:0/100570437 wait complete. 2024-04-24T23:58:55.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.373+0000 7f64a8400640 1 Processor -- start 2024-04-24T23:58:55.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.373+0000 7f64a8400640 1 -- start start 2024-04-24T23:58:55.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.374+0000 7f64a8400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880052e0 0x7f64a013f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.374+0000 7f64a8400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64a014cb50 0x7f64a0161f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.374+0000 7f64a8400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a009aa70 0x7f64a0153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.374+0000 7f64a8400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01555a0 con 0x7f64a014cb50 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.374+0000 7f64a8400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64a0071430 con 0x7f64880052e0 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.374+0000 7f64a8400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f64a00b2cc0 con 0x7f64a009aa70 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.374+0000 7f64a5000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64a014cb50 0x7f64a0161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.374+0000 7f64a5000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64a014cb50 0x7f64a0161f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59822/0 (socket says 172.21.15.96:59822) 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.374+0000 7f64a5000640 1 -- 172.21.15.96:0/1877342632 learned_addr learned my addr 172.21.15.96:0/1877342632 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a5a00640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880052e0 0x7f64a013f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a6400640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a009aa70 0x7f64a0153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a5000640 1 -- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a009aa70 msgr2=0x7f64a0153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a5000640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a009aa70 0x7f64a0153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a5000640 1 -- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880052e0 msgr2=0x7f64a013f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a5000640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880052e0 0x7f64a013f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a5000640 1 -- 172.21.15.96:0/1877342632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a0161180 con 0x7f64a014cb50 2024-04-24T23:58:55.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a5a00640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880052e0 0x7f64a013f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:55.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a6400640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a009aa70 0x7f64a0153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:55.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a5000640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64a014cb50 0x7f64a0161f40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f648c00f5b0 tx=0x7f648c00fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:55.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f649d600640 1 -- 172.21.15.96:0/1877342632 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c013810 con 0x7f64a014cb50 2024-04-24T23:58:55.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f649d600640 1 -- 172.21.15.96:0/1877342632 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c01a070 con 0x7f64a014cb50 2024-04-24T23:58:55.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f649d600640 1 -- 172.21.15.96:0/1877342632 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c013bb0 con 0x7f64a014cb50 2024-04-24T23:58:55.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.375+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a0161460 con 0x7f64a014cb50 2024-04-24T23:58:55.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.376+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a0161a20 con 0x7f64a014cb50 2024-04-24T23:58:55.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.377+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a0069110 con 0x7f64a014cb50 2024-04-24T23:58:55.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.378+0000 7f649d600640 1 -- 172.21.15.96:0/1877342632 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f648c012070 con 0x7f64a014cb50 2024-04-24T23:58:55.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.379+0000 7f649d600640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f648006be60 0x7f648006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.379+0000 7f649d600640 1 -- 172.21.15.96:0/1877342632 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f648c08ae80 con 0x7f64a014cb50 2024-04-24T23:58:55.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.379+0000 7f64a5a00640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f648006be60 0x7f648006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.380+0000 7f64a5a00640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f648006be60 0x7f648006e320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f64a006d990 tx=0x7f6494009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:55.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.383+0000 7f649d600640 1 -- 172.21.15.96:0/1877342632 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f648c01c310 con 0x7f64a014cb50 2024-04-24T23:58:55.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.578+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f64a00b4e00 con 0x7f64a014cb50 2024-04-24T23:58:55.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.578+0000 7f649d600640 1 -- 172.21.15.96:0/1877342632 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f648c059700 con 0x7f64a014cb50 2024-04-24T23:58:55.579 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f648006be60 msgr2=0x7f648006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f648006be60 0x7f648006e320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f64a006d990 tx=0x7f6494009040 comp rx=0 tx=0).stop 2024-04-24T23:58:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64a014cb50 msgr2=0x7f64a0161f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64a014cb50 0x7f64a0161f40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f648c00f5b0 tx=0x7f648c00fa70 comp rx=0 tx=0).stop 2024-04-24T23:58:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 shutdown_connections 2024-04-24T23:58:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64a009aa70 0x7f64a0153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f648006be60 0x7f648006e320 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64a014cb50 0x7f64a0161f40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 --2- 172.21.15.96:0/1877342632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64880052e0 0x7f64a013f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 >> 172.21.15.96:0/1877342632 conn(0x7f64a00b19c0 msgr2=0x7f64a015e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:55.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 shutdown_connections 2024-04-24T23:58:55.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.581+0000 7f64a8400640 1 -- 172.21.15.96:0/1877342632 wait complete. 2024-04-24T23:58:55.598 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:55.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.790+0000 7f08aac00640 1 Processor -- start 2024-04-24T23:58:55.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.790+0000 7f08aac00640 1 -- start start 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.791+0000 7f08aac00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f08a41446c0 0x7f08a406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.791+0000 7f08aac00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f08a415f160 0x7f08a4070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.791+0000 7f08aac00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a40b36f0 con 0x7f08a40b4790 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.791+0000 7f08aac00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f08a40b4300 con 0x7f08a41446c0 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.791+0000 7f08aac00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f08a40b39d0 con 0x7f08a415f160 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.791+0000 7f08a9800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f08a41446c0 0x7f08a406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.791+0000 7f08a9800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f08a41446c0 0x7f08a406e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59826/0 (socket says 172.21.15.96:59826) 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.791+0000 7f08a9800640 1 -- 172.21.15.96:0/3995707301 learned_addr learned my addr 172.21.15.96:0/3995707301 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.792+0000 7f08a9800640 1 -- 172.21.15.96:0/3995707301 >> v2:172.21.15.155:3300/0 conn(0x7f08a415f160 msgr2=0x7f08a4070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.792+0000 7f08a9800640 1 --2- 172.21.15.96:0/3995707301 >> v2:172.21.15.155:3300/0 conn(0x7f08a415f160 0x7f08a4070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.792+0000 7f08a9800640 1 -- 172.21.15.96:0/3995707301 >> v1:172.21.15.155:6789/0 conn(0x7f08a40b4790 legacy=0x7f08a415ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:55.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.792+0000 7f08a9800640 1 -- 172.21.15.96:0/3995707301 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a40b3cb0 con 0x7f08a41446c0 2024-04-24T23:58:55.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.793+0000 7f08a9800640 1 --2- 172.21.15.96:0/3995707301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a41446c0 0x7f08a406e3c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f08a40b4480 tx=0x7f089802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e644f22ad7dd7e1e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:55.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.793+0000 7f08a3e00640 1 -- 172.21.15.96:0/3995707301 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898037070 con 0x7f08a41446c0 2024-04-24T23:58:55.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.793+0000 7f08a3e00640 1 -- 172.21.15.96:0/3995707301 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089802ae10 con 0x7f08a41446c0 2024-04-24T23:58:55.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.793+0000 7f08a3e00640 1 -- 172.21.15.96:0/3995707301 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898032660 con 0x7f08a41446c0 2024-04-24T23:58:55.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.794+0000 7f08aac00640 1 -- 172.21.15.96:0/3995707301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a41446c0 msgr2=0x7f08a406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.794+0000 7f08aac00640 1 --2- 172.21.15.96:0/3995707301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a41446c0 0x7f08a406e3c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f08a40b4480 tx=0x7f089802a100 comp rx=0 tx=0).stop 2024-04-24T23:58:55.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.794+0000 7f08aac00640 1 -- 172.21.15.96:0/3995707301 shutdown_connections 2024-04-24T23:58:55.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.794+0000 7f08aac00640 1 --2- 172.21.15.96:0/3995707301 >> v2:172.21.15.155:3300/0 conn(0x7f08a415f160 0x7f08a4070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.794+0000 7f08aac00640 1 --2- 172.21.15.96:0/3995707301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a41446c0 0x7f08a406e3c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.794+0000 7f08aac00640 1 -- 172.21.15.96:0/3995707301 >> 172.21.15.96:0/3995707301 conn(0x7f08a40b18b0 msgr2=0x7f08a40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:55.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.794+0000 7f08aac00640 1 -- 172.21.15.96:0/3995707301 shutdown_connections 2024-04-24T23:58:55.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.794+0000 7f08aac00640 1 -- 172.21.15.96:0/3995707301 wait complete. 2024-04-24T23:58:55.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.796+0000 7f08aac00640 1 Processor -- start 2024-04-24T23:58:55.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.796+0000 7f08aac00640 1 -- start start 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08aac00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08a40b4790 0x7f08a4135470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08aac00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a41446c0 0x7f08a41e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08aac00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a415f160 0x7f08a40cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08aac00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f08a415f7b0 con 0x7f08a415f160 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08aac00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f08a4144aa0 con 0x7f08a41446c0 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08aac00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f08a406e900 con 0x7f08a40b4790 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08aa200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a415f160 0x7f08a40cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08aa200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a415f160 0x7f08a40cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59832/0 (socket says 172.21.15.96:59832) 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08aa200640 1 -- 172.21.15.96:0/1029646382 learned_addr learned my addr 172.21.15.96:0/1029646382 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.797+0000 7f08a9800640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08a40b4790 0x7f08a4135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08a8e00640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a41446c0 0x7f08a41e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08aa200640 1 -- 172.21.15.96:0/1029646382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08a40b4790 msgr2=0x7f08a4135470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08aa200640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08a40b4790 0x7f08a4135470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08aa200640 1 -- 172.21.15.96:0/1029646382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a41446c0 msgr2=0x7f08a41e48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:55.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08aa200640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a41446c0 0x7f08a41e48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:55.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08aa200640 1 -- 172.21.15.96:0/1029646382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a41359b0 con 0x7f08a415f160 2024-04-24T23:58:55.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08aa200640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a415f160 0x7f08a40cee80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f089c00b9e0 tx=0x7f089c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:55.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08a1600640 1 -- 172.21.15.96:0/1029646382 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c019070 con 0x7f08a415f160 2024-04-24T23:58:55.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08a1600640 1 -- 172.21.15.96:0/1029646382 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c00caa0 con 0x7f08a415f160 2024-04-24T23:58:55.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08a1600640 1 -- 172.21.15.96:0/1029646382 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c014440 con 0x7f08a415f160 2024-04-24T23:58:55.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.798+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a40cdde0 con 0x7f08a415f160 2024-04-24T23:58:55.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.799+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a40ce3a0 con 0x7f08a415f160 2024-04-24T23:58:55.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.800+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a40755d0 con 0x7f08a415f160 2024-04-24T23:58:55.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.801+0000 7f08a1600640 1 -- 172.21.15.96:0/1029646382 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f089c01c070 con 0x7f08a415f160 2024-04-24T23:58:55.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.802+0000 7f08a1600640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f088806be30 0x7f088806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:55.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.802+0000 7f08a1600640 1 -- 172.21.15.96:0/1029646382 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f089c08acd0 con 0x7f08a415f160 2024-04-24T23:58:55.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.802+0000 7f08a9800640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f088806be30 0x7f088806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:55.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.803+0000 7f08a9800640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f088806be30 0x7f088806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0898034000 tx=0x7f089802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:55.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:55.807+0000 7f08a1600640 1 -- 172.21.15.96:0/1029646382 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f089c0594c0 con 0x7f08a415f160 2024-04-24T23:58:56.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.005+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f08a40713e0 con 0x7f08a415f160 2024-04-24T23:58:56.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.006+0000 7f08a1600640 1 -- 172.21.15.96:0/1029646382 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f089c058dc0 con 0x7f08a415f160 2024-04-24T23:58:56.006 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:56.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.008+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f088806be30 msgr2=0x7f088806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:56.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.008+0000 7f08aac00640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f088806be30 0x7f088806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0898034000 tx=0x7f089802e000 comp rx=0 tx=0).stop 2024-04-24T23:58:56.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.008+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a415f160 msgr2=0x7f08a40cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:56.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.008+0000 7f08aac00640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a415f160 0x7f08a40cee80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f089c00b9e0 tx=0x7f089c00bea0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.008+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 shutdown_connections 2024-04-24T23:58:56.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.008+0000 7f08aac00640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f088806be30 0x7f088806e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.008+0000 7f08aac00640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a415f160 0x7f08a40cee80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.009+0000 7f08aac00640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a41446c0 0x7f08a41e48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.009+0000 7f08aac00640 1 --2- 172.21.15.96:0/1029646382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08a40b4790 0x7f08a4135470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.009+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 >> 172.21.15.96:0/1029646382 conn(0x7f08a40b18b0 msgr2=0x7f08a415b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:56.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.009+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 shutdown_connections 2024-04-24T23:58:56.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.009+0000 7f08aac00640 1 -- 172.21.15.96:0/1029646382 wait complete. 2024-04-24T23:58:56.028 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:58:56.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.228+0000 7f2affc00640 1 Processor -- start 2024-04-24T23:58:56.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.229+0000 7f2affc00640 1 -- start start 2024-04-24T23:58:56.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.230+0000 7f2affc00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2af815cbf0 0x7f2af806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:56.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.230+0000 7f2affc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af816c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:56.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.230+0000 7f2affc00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af80b4fe0 con 0x7f2af806d0b0 2024-04-24T23:58:56.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.230+0000 7f2affc00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2af806d5c0 con 0x7f2af815cbf0 2024-04-24T23:58:56.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.230+0000 7f2affc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2af806d8a0 con 0x7f2af8071500 2024-04-24T23:58:56.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.231+0000 7f2afdc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af816c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:56.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.231+0000 7f2afd200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2af815cbf0 0x7f2af806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:56.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.231+0000 7f2af7e00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f2af806d0b0 0x7f2af8070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:52250/0 (socket says 172.21.15.96:52250) 2024-04-24T23:58:56.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.231+0000 7f2afdc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af816c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:48496/0 (socket says 172.21.15.96:48496) 2024-04-24T23:58:56.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.231+0000 7f2af7e00640 1 -- 172.21.15.96:0/1925374591 learned_addr learned my addr 172.21.15.96:0/1925374591 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:56.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.232+0000 7f2afdc00640 1 -- 172.21.15.96:0/1925374591 >> v2:172.21.15.155:3300/0 conn(0x7f2af815cbf0 msgr2=0x7f2af806cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:56.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.232+0000 7f2afdc00640 1 --2- 172.21.15.96:0/1925374591 >> v2:172.21.15.155:3300/0 conn(0x7f2af815cbf0 0x7f2af806cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.232+0000 7f2afdc00640 1 -- 172.21.15.96:0/1925374591 >> v1:172.21.15.155:6789/0 conn(0x7f2af806d0b0 legacy=0x7f2af8070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:56.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.232+0000 7f2afdc00640 1 -- 172.21.15.96:0/1925374591 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af806db80 con 0x7f2af8071500 2024-04-24T23:58:56.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.233+0000 7f2afdc00640 1 --2- 172.21.15.96:0/1925374591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af816c5b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2af00097a0 tx=0x7f2af002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961a70d66b64c704 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:56.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.234+0000 7f2af7400640 1 -- 172.21.15.96:0/1925374591 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0037070 con 0x7f2af8071500 2024-04-24T23:58:56.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.234+0000 7f2af7400640 1 -- 172.21.15.96:0/1925374591 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af0032440 con 0x7f2af8071500 2024-04-24T23:58:56.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.234+0000 7f2af7400640 1 -- 172.21.15.96:0/1925374591 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0032810 con 0x7f2af8071500 2024-04-24T23:58:56.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.235+0000 7f2affc00640 1 -- 172.21.15.96:0/1925374591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 msgr2=0x7f2af816c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:56.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.235+0000 7f2affc00640 1 --2- 172.21.15.96:0/1925374591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af816c5b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2af00097a0 tx=0x7f2af002a180 comp rx=0 tx=0).stop 2024-04-24T23:58:56.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.235+0000 7f2affc00640 1 -- 172.21.15.96:0/1925374591 shutdown_connections 2024-04-24T23:58:56.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.235+0000 7f2affc00640 1 --2- 172.21.15.96:0/1925374591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af816c5b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.235+0000 7f2affc00640 1 --2- 172.21.15.96:0/1925374591 >> v2:172.21.15.155:3300/0 conn(0x7f2af815cbf0 0x7f2af806cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.235+0000 7f2affc00640 1 -- 172.21.15.96:0/1925374591 >> 172.21.15.96:0/1925374591 conn(0x7f2af80b19c0 msgr2=0x7f2af80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:56.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.235+0000 7f2affc00640 1 -- 172.21.15.96:0/1925374591 shutdown_connections 2024-04-24T23:58:56.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.235+0000 7f2affc00640 1 -- 172.21.15.96:0/1925374591 wait complete. 2024-04-24T23:58:56.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.237+0000 7f2affc00640 1 Processor -- start 2024-04-24T23:58:56.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.237+0000 7f2affc00640 1 -- start start 2024-04-24T23:58:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2affc00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af806d0b0 0x7f2af8157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2affc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af80cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2affc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af815cbf0 0x7f2af8159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2affc00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2af815cfd0 con 0x7f2af806d0b0 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2affc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2af806e660 con 0x7f2af815cbf0 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2affc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2af8162e30 con 0x7f2af8071500 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2afd200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af806d0b0 0x7f2af8157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2afd200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af806d0b0 0x7f2af8157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59846/0 (socket says 172.21.15.96:59846) 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2afd200640 1 -- 172.21.15.96:0/2083522149 learned_addr learned my addr 172.21.15.96:0/2083522149 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2af7e00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af80cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.238+0000 7f2afdc00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af815cbf0 0x7f2af8159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2afd200640 1 -- 172.21.15.96:0/2083522149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 msgr2=0x7f2af80cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2afd200640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af80cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2afd200640 1 -- 172.21.15.96:0/2083522149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af815cbf0 msgr2=0x7f2af8159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2afd200640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af815cbf0 0x7f2af8159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2afd200640 1 -- 172.21.15.96:0/2083522149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af809c150 con 0x7f2af806d0b0 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2afdc00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af815cbf0 0x7f2af8159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2afd200640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af806d0b0 0x7f2af8157480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009d10 tx=0x7f2ae800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2af4c00640 1 -- 172.21.15.96:0/2083522149 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8018020 con 0x7f2af806d0b0 2024-04-24T23:58:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2af4c00640 1 -- 172.21.15.96:0/2083522149 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae8014480 con 0x7f2af806d0b0 2024-04-24T23:58:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2af4c00640 1 -- 172.21.15.96:0/2083522149 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8014830 con 0x7f2af806d0b0 2024-04-24T23:58:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af809c430 con 0x7f2af806d0b0 2024-04-24T23:58:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.239+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af81579c0 con 0x7f2af806d0b0 2024-04-24T23:58:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.240+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af80689f0 con 0x7f2af806d0b0 2024-04-24T23:58:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.241+0000 7f2af4c00640 1 -- 172.21.15.96:0/2083522149 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ae8005d10 con 0x7f2af806d0b0 2024-04-24T23:58:56.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.242+0000 7f2af4c00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2ad806be30 0x7f2ad806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:56.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.242+0000 7f2af4c00640 1 -- 172.21.15.96:0/2083522149 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f2ae808bc50 con 0x7f2af806d0b0 2024-04-24T23:58:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.243+0000 7f2af7e00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2ad806be30 0x7f2ad806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.243+0000 7f2af7e00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2ad806be30 0x7f2ad806e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2af81fb860 tx=0x7f2ae4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:56.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.247+0000 7f2af4c00640 1 -- 172.21.15.96:0/2083522149 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2af80689f0 con 0x7f2af806d0b0 2024-04-24T23:58:56.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.462+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2af8069110 con 0x7f2af806d0b0 2024-04-24T23:58:56.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.463+0000 7f2af4c00640 1 -- 172.21.15.96:0/2083522149 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f2ae8091020 con 0x7f2af806d0b0 2024-04-24T23:58:56.463 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-24T23:58:56.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2ad806be30 msgr2=0x7f2ad806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2ad806be30 0x7f2ad806e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2af81fb860 tx=0x7f2ae4009040 comp rx=0 tx=0).stop 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af806d0b0 msgr2=0x7f2af8157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af806d0b0 0x7f2af8157480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009d10 tx=0x7f2ae800c490 comp rx=0 tx=0).stop 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 shutdown_connections 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af815cbf0 0x7f2af8159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2af8071500 0x7f2af80cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2ad806be30 0x7f2ad806e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 --2- 172.21.15.96:0/2083522149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af806d0b0 0x7f2af8157480 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 >> 172.21.15.96:0/2083522149 conn(0x7f2af80b19c0 msgr2=0x7f2af80b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.466+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 shutdown_connections 2024-04-24T23:58:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.467+0000 7f2affc00640 1 -- 172.21.15.96:0/2083522149 wait complete. 2024-04-24T23:58:56.487 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-24T23:58:56.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:56.487 DEBUG:teuthology.orchestra.run.smithi096:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-24T23:58:56.571 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-04-24T23:58:56.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:56.571 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-24T23:58:56.623 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:58:56.624 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:56.681 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:58:56.681 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:56.738 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:58:56.738 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:58:56.793 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:56.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.997+0000 7f0187200640 1 Processor -- start 2024-04-24T23:58:56.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.997+0000 7f0187200640 1 -- start start 2024-04-24T23:58:56.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.998+0000 7f0187200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f01881553f0 0x7f018815b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:56.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.999+0000 7f0187200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01880ce100 con 0x7f01880cdbd0 2024-04-24T23:58:56.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.999+0000 7f0187200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01880ce3e0 con 0x7f0188071470 2024-04-24T23:58:56.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.999+0000 7f0187200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f01880ce6c0 con 0x7f01881553f0 2024-04-24T23:58:57.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.999+0000 7f017d400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f01880cdbd0 0x7f0188070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59630/0 (socket says 172.21.15.96:59630) 2024-04-24T23:58:57.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.999+0000 7f017d400640 1 -- 172.21.15.96:0/777535340 learned_addr learned my addr 172.21.15.96:0/777535340 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:57.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:56.999+0000 7f0185e00640 1 --2- 172.21.15.96:0/777535340 >> v2:172.21.15.155:3300/0 conn(0x7f01881553f0 0x7f018815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256431763 0 0) 0x7f01880ce100 con 0x7f01880cdbd0 2024-04-24T23:58:57.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f016c003520 con 0x7f01880cdbd0 2024-04-24T23:58:57.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3952079703 0 0) 0x7f016c003520 con 0x7f01880cdbd0 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 >> v2:172.21.15.155:3300/0 conn(0x7f01881553f0 msgr2=0x7f018815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 --2- 172.21.15.96:0/777535340 >> v2:172.21.15.155:3300/0 conn(0x7f01881553f0 0x7f018815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 >> v1:172.21.15.155:6789/0 conn(0x7f0188071470 legacy=0x7f018806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01880ce9a0 con 0x7f01880cdbd0 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f0170001670 con 0x7f01880cdbd0 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 >> v1:172.21.15.96:6789/0 conn(0x7f01880cdbd0 legacy=0x7f0188070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f016c0039b0 0x7f016c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016c004800 0x7f016c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f016c0051c0 0x7f016c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f01880ce6c0 con 0x7f016c0051c0 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f016c00c060 con 0x7f016c0039b0 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f016c00c260 con 0x7f016c004800 2024-04-24T23:58:57.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.000+0000 7f0186800640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f016c0051c0 0x7f016c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.001+0000 7f0185e00640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f016c0039b0 0x7f016c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.001+0000 7f0186800640 1 -- 172.21.15.96:0/777535340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016c004800 msgr2=0x7f016c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:57.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.001+0000 7f0186800640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016c004800 0x7f016c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.001+0000 7f0186800640 1 -- 172.21.15.96:0/777535340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f016c0039b0 msgr2=0x7f016c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:57.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.001+0000 7f0186800640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f016c0039b0 0x7f016c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.001+0000 7f0186800640 1 -- 172.21.15.96:0/777535340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c003520 con 0x7f016c0051c0 2024-04-24T23:58:57.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.001+0000 7f0185e00640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f016c0039b0 0x7f016c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:57.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.002+0000 7f0186800640 1 -- 172.21.15.96:0/777535340 reap_dead start 2024-04-24T23:58:57.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.002+0000 7f0186800640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f016c0051c0 0x7f016c00b9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0180001a30 tx=0x7f016c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38542ee3dc54f6fc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:57.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.002+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180001a70 con 0x7f016c0051c0 2024-04-24T23:58:57.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.002+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0180003bb0 con 0x7f016c0051c0 2024-04-24T23:58:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.002+0000 7f0185400640 1 -- 172.21.15.96:0/777535340 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01800050d0 con 0x7f016c0051c0 2024-04-24T23:58:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.003+0000 7f0187200640 1 -- 172.21.15.96:0/777535340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f016c0051c0 msgr2=0x7f016c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.003+0000 7f0187200640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f016c0051c0 0x7f016c00b9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0180001a30 tx=0x7f016c005830 comp rx=0 tx=0).stop 2024-04-24T23:58:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.003+0000 7f0187200640 1 -- 172.21.15.96:0/777535340 shutdown_connections 2024-04-24T23:58:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.003+0000 7f0187200640 1 --2- 172.21.15.96:0/777535340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f016c0051c0 0x7f016c00b9c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.003+0000 7f0187200640 1 -- 172.21.15.96:0/777535340 >> 172.21.15.96:0/777535340 conn(0x7f01880b1f10 msgr2=0x7f01880cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.003+0000 7f0187200640 1 -- 172.21.15.96:0/777535340 shutdown_connections 2024-04-24T23:58:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.003+0000 7f0187200640 1 -- 172.21.15.96:0/777535340 wait complete. 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.005+0000 7f0187200640 1 Processor -- start 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.005+0000 7f0187200640 1 -- start start 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f0187200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016c0051c0 0x7f0188147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f0187200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018815e530 0x7f0188153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f0187200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018815e9b0 0x7f01881536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f0187200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0188155950 con 0x7f018815e530 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f0187200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01881557d0 con 0x7f018815e9b0 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f0187200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f018815b530 con 0x7f016c0051c0 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f017d400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018815e530 0x7f0188153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f017d400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018815e530 0x7f0188153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58122/0 (socket says 172.21.15.96:58122) 2024-04-24T23:58:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f017d400640 1 -- 172.21.15.96:0/1261676856 learned_addr learned my addr 172.21.15.96:0/1261676856 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.006+0000 7f0185e00640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016c0051c0 0x7f0188147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f0186800640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018815e9b0 0x7f01881536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f017d400640 1 -- 172.21.15.96:0/1261676856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016c0051c0 msgr2=0x7f0188147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f017d400640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016c0051c0 0x7f0188147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f017d400640 1 -- 172.21.15.96:0/1261676856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018815e9b0 msgr2=0x7f01881536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f017d400640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018815e9b0 0x7f01881536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f017d400640 1 -- 172.21.15.96:0/1261676856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01880acda0 con 0x7f018815e530 2024-04-24T23:58:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f0186800640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018815e9b0 0x7f01881536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f017d400640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018815e530 0x7f0188153190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f017000c700 tx=0x7f017000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:57.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f017ea00640 1 -- 172.21.15.96:0/1261676856 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170018070 con 0x7f018815e530 2024-04-24T23:58:57.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f017ea00640 1 -- 172.21.15.96:0/1261676856 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01700074e0 con 0x7f018815e530 2024-04-24T23:58:57.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f017ea00640 1 -- 172.21.15.96:0/1261676856 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170004a20 con 0x7f018815e530 2024-04-24T23:58:57.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01880ad080 con 0x7f018815e530 2024-04-24T23:58:57.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.007+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01880ad640 con 0x7f018815e530 2024-04-24T23:58:57.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.009+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01880756b0 con 0x7f018815e530 2024-04-24T23:58:57.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.009+0000 7f017ea00640 1 -- 172.21.15.96:0/1261676856 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f017001b070 con 0x7f018815e530 2024-04-24T23:58:57.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.010+0000 7f017ea00640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f016406be30 0x7f016406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.010+0000 7f017ea00640 1 -- 172.21.15.96:0/1261676856 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f017008a4d0 con 0x7f018815e530 2024-04-24T23:58:57.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.011+0000 7f0185e00640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f016406be30 0x7f016406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.011+0000 7f0185e00640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f016406be30 0x7f016406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0178009aa0 tx=0x7f0178008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:57.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.015+0000 7f017ea00640 1 -- 172.21.15.96:0/1261676856 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0170058d50 con 0x7f018815e530 2024-04-24T23:58:57.056 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:58:57.063 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:58:57.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.223+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01880d04c0 con 0x7f018815e530 2024-04-24T23:58:57.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.225+0000 7f017ea00640 1 -- 172.21.15.96:0/1261676856 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16851 (secure 0 0 0) 0x7f0170058650 con 0x7f018815e530 2024-04-24T23:58:57.226 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:57.226 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:48.255571+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:58:57.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f016406be30 msgr2=0x7f016406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f016406be30 0x7f016406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0178009aa0 tx=0x7f0178008040 comp rx=0 tx=0).stop 2024-04-24T23:58:57.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018815e530 msgr2=0x7f0188153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018815e530 0x7f0188153190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f017000c700 tx=0x7f017000cbc0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 shutdown_connections 2024-04-24T23:58:57.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f018815e9b0 0x7f01881536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f016406be30 0x7f016406e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018815e530 0x7f0188153190 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 --2- 172.21.15.96:0/1261676856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016c0051c0 0x7f0188147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 >> 172.21.15.96:0/1261676856 conn(0x7f01880b1f10 msgr2=0x7f0188159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:57.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 shutdown_connections 2024-04-24T23:58:57.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.228+0000 7f0187200640 1 -- 172.21.15.96:0/1261676856 wait complete. 2024-04-24T23:58:57.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:58:57.248 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:58:57.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.443+0000 7f6f29000640 1 Processor -- start 2024-04-24T23:58:57.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.443+0000 7f6f29000640 1 -- start start 2024-04-24T23:58:57.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.445+0000 7f6f29000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6f24156620 0x7f6f2415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.445+0000 7f6f29000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2406d100 con 0x7f6f2406edf0 2024-04-24T23:58:57.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.445+0000 7f6f29000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240acda0 con 0x7f6f240ae8e0 2024-04-24T23:58:57.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.445+0000 7f6f29000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6f240ad060 con 0x7f6f24156620 2024-04-24T23:58:57.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.445+0000 7f6f1be00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6f2406edf0 0x7f6f2406dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59646/0 (socket says 172.21.15.96:59646) 2024-04-24T23:58:57.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.445+0000 7f6f1be00640 1 -- 172.21.15.96:0/2120163205 learned_addr learned my addr 172.21.15.96:0/2120163205 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.446+0000 7f6f21e00640 1 --2- 172.21.15.96:0/2120163205 >> v2:172.21.15.155:3300/0 conn(0x7f6f24156620 0x7f6f2415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.446+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406840807 0 0) 0x7f6f2406d100 con 0x7f6f2406edf0 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.446+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f08003520 con 0x7f6f2406edf0 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.446+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3284684916 0 0) 0x7f6f08003520 con 0x7f6f2406edf0 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.446+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 >> v2:172.21.15.155:3300/0 conn(0x7f6f24156620 msgr2=0x7f6f2415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.446+0000 7f6f21400640 1 --2- 172.21.15.96:0/2120163205 >> v2:172.21.15.155:3300/0 conn(0x7f6f24156620 0x7f6f2415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.446+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 >> v1:172.21.15.155:6789/0 conn(0x7f6f240ae8e0 legacy=0x7f6f240aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2406d3a0 con 0x7f6f2406edf0 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f6f0c001670 con 0x7f6f2406edf0 2024-04-24T23:58:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 >> v1:172.21.15.96:6789/0 conn(0x7f6f2406edf0 legacy=0x7f6f2406dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21400640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f080039b0 0x7f6f08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21400640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21400640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f08005210 0x7f6f0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6f240ad060 con 0x7f6f08004800 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0800c160 con 0x7f6f08005210 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0800c360 con 0x7f6f080039b0 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f1be00640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f22800640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f08005210 0x7f6f0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.447+0000 7f6f21e00640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f080039b0 0x7f6f08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.448+0000 7f6f1be00640 1 -- 172.21.15.96:0/2120163205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f080039b0 msgr2=0x7f6f08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.448+0000 7f6f1be00640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f080039b0 0x7f6f08003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.448+0000 7f6f1be00640 1 -- 172.21.15.96:0/2120163205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f08005210 msgr2=0x7f6f0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.448+0000 7f6f1be00640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f08005210 0x7f6f0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.448+0000 7f6f1be00640 1 -- 172.21.15.96:0/2120163205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f08003520 con 0x7f6f08004800 2024-04-24T23:58:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.448+0000 7f6f22800640 1 -- 172.21.15.96:0/2120163205 reap_dead start 2024-04-24T23:58:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.449+0000 7f6f1be00640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00c190 tx=0x7f6f08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753e937b699094b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.449+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c007c60 con 0x7f6f08004800 2024-04-24T23:58:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.449+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c005af0 con 0x7f6f08004800 2024-04-24T23:58:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.449+0000 7f6f21400640 1 -- 172.21.15.96:0/2120163205 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c007070 con 0x7f6f08004800 2024-04-24T23:58:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.450+0000 7f6f29000640 1 -- 172.21.15.96:0/2120163205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f08004800 msgr2=0x7f6f08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.450+0000 7f6f29000640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00c190 tx=0x7f6f08005830 comp rx=0 tx=0).stop 2024-04-24T23:58:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.450+0000 7f6f29000640 1 -- 172.21.15.96:0/2120163205 shutdown_connections 2024-04-24T23:58:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.450+0000 7f6f29000640 1 --2- 172.21.15.96:0/2120163205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.450+0000 7f6f29000640 1 -- 172.21.15.96:0/2120163205 >> 172.21.15.96:0/2120163205 conn(0x7f6f240b19c0 msgr2=0x7f6f240b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:57.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.450+0000 7f6f29000640 1 -- 172.21.15.96:0/2120163205 shutdown_connections 2024-04-24T23:58:57.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.450+0000 7f6f29000640 1 -- 172.21.15.96:0/2120163205 wait complete. 2024-04-24T23:58:57.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.452+0000 7f6f29000640 1 Processor -- start 2024-04-24T23:58:57.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.452+0000 7f6f29000640 1 -- start start 2024-04-24T23:58:57.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.453+0000 7f6f29000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f08004800 0x7f6f2409b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.453+0000 7f6f29000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24153600 0x7f6f2414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.453+0000 7f6f29000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2409c740 0x7f6f2409cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.453+0000 7f6f29000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6f240ad4c0 con 0x7f6f24153600 2024-04-24T23:58:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.453+0000 7f6f29000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f240ad340 con 0x7f6f2409c740 2024-04-24T23:58:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.453+0000 7f6f29000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2415cf70 con 0x7f6f08004800 2024-04-24T23:58:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.453+0000 7f6f1be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24153600 0x7f6f2414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.454+0000 7f6f1be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24153600 0x7f6f2414f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58150/0 (socket says 172.21.15.96:58150) 2024-04-24T23:58:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.454+0000 7f6f1be00640 1 -- 172.21.15.96:0/185644270 learned_addr learned my addr 172.21.15.96:0/185644270 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:57.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.454+0000 7f6f22800640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2409c740 0x7f6f2409cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.454+0000 7f6f1be00640 1 -- 172.21.15.96:0/185644270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f08004800 msgr2=0x7f6f2409b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.454+0000 7f6f1be00640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f08004800 0x7f6f2409b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.454+0000 7f6f1be00640 1 -- 172.21.15.96:0/185644270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2409c740 msgr2=0x7f6f2409cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.454+0000 7f6f1be00640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2409c740 0x7f6f2409cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.454+0000 7f6f1be00640 1 -- 172.21.15.96:0/185644270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2409b9c0 con 0x7f6f24153600 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.454+0000 7f6f1be00640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24153600 0x7f6f2414f830 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00c190 tx=0x7f6f24072e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.455+0000 7f6f1a000640 1 -- 172.21.15.96:0/185644270 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c037040 con 0x7f6f24153600 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.455+0000 7f6f1a000640 1 -- 172.21.15.96:0/185644270 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c041070 con 0x7f6f24153600 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.455+0000 7f6f1a000640 1 -- 172.21.15.96:0/185644270 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0047e0 con 0x7f6f24153600 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.455+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2409c4e0 con 0x7f6f24153600 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.455+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2409bf20 con 0x7f6f24153600 2024-04-24T23:58:57.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.456+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f24069110 con 0x7f6f24153600 2024-04-24T23:58:57.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.457+0000 7f6f1a000640 1 -- 172.21.15.96:0/185644270 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f0c004980 con 0x7f6f24153600 2024-04-24T23:58:57.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.458+0000 7f6f1a000640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6f0006be60 0x7f6f0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.458+0000 7f6f1a000640 1 -- 172.21.15.96:0/185644270 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f6f0c0aabe0 con 0x7f6f24153600 2024-04-24T23:58:57.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.458+0000 7f6f21e00640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6f0006be60 0x7f6f0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.459+0000 7f6f21e00640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6f0006be60 0x7f6f0006e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6f24069890 tx=0x7f6f14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:57.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.463+0000 7f6f1a000640 1 -- 172.21.15.96:0/185644270 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6f2409b9c0 con 0x7f6f24153600 2024-04-24T23:58:57.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.662+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f2415f540 con 0x7f6f24153600 2024-04-24T23:58:57.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.663+0000 7f6f1a000640 1 -- 172.21.15.96:0/185644270 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f6f0c005040 con 0x7f6f24153600 2024-04-24T23:58:57.663 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:58:57.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6f0006be60 msgr2=0x7f6f0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6f0006be60 0x7f6f0006e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6f24069890 tx=0x7f6f14008040 comp rx=0 tx=0).stop 2024-04-24T23:58:57.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24153600 msgr2=0x7f6f2414f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24153600 0x7f6f2414f830 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00c190 tx=0x7f6f24072e80 comp rx=0 tx=0).stop 2024-04-24T23:58:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 shutdown_connections 2024-04-24T23:58:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2409c740 0x7f6f2409cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6f0006be60 0x7f6f0006e320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24153600 0x7f6f2414f830 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 --2- 172.21.15.96:0/185644270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f08004800 0x7f6f2409b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 >> 172.21.15.96:0/185644270 conn(0x7f6f240b19c0 msgr2=0x7f6f24071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 shutdown_connections 2024-04-24T23:58:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.666+0000 7f6f29000640 1 -- 172.21.15.96:0/185644270 wait complete. 2024-04-24T23:58:57.689 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:58:57.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.864+0000 7f9321000640 1 Processor -- start 2024-04-24T23:58:57.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.864+0000 7f9321000640 1 -- start start 2024-04-24T23:58:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.865+0000 7f9321000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f931c156620 0x7f931c15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.865+0000 7f9321000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f931c06edf0 0x7f931c06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.865+0000 7f9321000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c06d100 con 0x7f931c0ae8e0 2024-04-24T23:58:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.866+0000 7f9321000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f931c0acda0 con 0x7f931c06edf0 2024-04-24T23:58:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.866+0000 7f9321000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f931c0ad060 con 0x7f931c156620 2024-04-24T23:58:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.866+0000 7f9319400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f931c06edf0 0x7f931c06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.866+0000 7f9319400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f931c06edf0 0x7f931c06dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58160/0 (socket says 172.21.15.96:58160) 2024-04-24T23:58:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.866+0000 7f9319400640 1 -- 172.21.15.96:0/758433972 learned_addr learned my addr 172.21.15.96:0/758433972 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:57.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.866+0000 7f9319400640 1 -- 172.21.15.96:0/758433972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f931c156620 msgr2=0x7f931c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:57.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.866+0000 7f9319400640 1 --2- 172.21.15.96:0/758433972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f931c156620 0x7f931c15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.866+0000 7f9319400640 1 -- 172.21.15.96:0/758433972 >> v1:172.21.15.155:6789/0 conn(0x7f931c0ae8e0 legacy=0x7f931c0aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:57.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.866+0000 7f9319400640 1 -- 172.21.15.96:0/758433972 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c06d3a0 con 0x7f931c06edf0 2024-04-24T23:58:57.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.868+0000 7f9319400640 1 --2- 172.21.15.96:0/758433972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c06edf0 0x7f931c06dba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9308009870 tx=0x7f930802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ac60ea2d6d743a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:57.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.868+0000 7f9318a00640 1 -- 172.21.15.96:0/758433972 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308037070 con 0x7f931c06edf0 2024-04-24T23:58:57.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.868+0000 7f9318a00640 1 -- 172.21.15.96:0/758433972 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9308032440 con 0x7f931c06edf0 2024-04-24T23:58:57.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.868+0000 7f9318a00640 1 -- 172.21.15.96:0/758433972 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308032810 con 0x7f931c06edf0 2024-04-24T23:58:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.869+0000 7f9321000640 1 -- 172.21.15.96:0/758433972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c06edf0 msgr2=0x7f931c06dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.869+0000 7f9321000640 1 --2- 172.21.15.96:0/758433972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c06edf0 0x7f931c06dba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9308009870 tx=0x7f930802a210 comp rx=0 tx=0).stop 2024-04-24T23:58:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.869+0000 7f9321000640 1 -- 172.21.15.96:0/758433972 shutdown_connections 2024-04-24T23:58:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.869+0000 7f9321000640 1 --2- 172.21.15.96:0/758433972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c06edf0 0x7f931c06dba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.869+0000 7f9321000640 1 --2- 172.21.15.96:0/758433972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f931c156620 0x7f931c15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.869+0000 7f9321000640 1 -- 172.21.15.96:0/758433972 >> 172.21.15.96:0/758433972 conn(0x7f931c0b19c0 msgr2=0x7f931c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.869+0000 7f9321000640 1 -- 172.21.15.96:0/758433972 shutdown_connections 2024-04-24T23:58:57.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.869+0000 7f9321000640 1 -- 172.21.15.96:0/758433972 wait complete. 2024-04-24T23:58:57.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.870+0000 7f9321000640 1 Processor -- start 2024-04-24T23:58:57.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.871+0000 7f9321000640 1 -- start start 2024-04-24T23:58:57.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.871+0000 7f9321000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f931c06edf0 0x7f931c1446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.871+0000 7f9321000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c0ae8e0 0x7f931c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.871+0000 7f9321000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f931c156620 0x7f931c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.871+0000 7f9321000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f931c0ad340 con 0x7f931c0ae8e0 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.871+0000 7f9321000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f931c06e0e0 con 0x7f931c156620 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.871+0000 7f9321000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f931c0ad4c0 con 0x7f931c06edf0 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f9319400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c0ae8e0 0x7f931c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f9319400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c0ae8e0 0x7f931c15cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58166/0 (socket says 172.21.15.96:58166) 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f9319400640 1 -- 172.21.15.96:0/522025093 learned_addr learned my addr 172.21.15.96:0/522025093 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f931a800640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f931c156620 0x7f931c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f9319400640 1 -- 172.21.15.96:0/522025093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f931c06edf0 msgr2=0x7f931c1446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f9319400640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f931c06edf0 0x7f931c1446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f9319400640 1 -- 172.21.15.96:0/522025093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f931c156620 msgr2=0x7f931c15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f9319400640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f931c156620 0x7f931c15d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f9319400640 1 -- 172.21.15.96:0/522025093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c156cf0 con 0x7f931c0ae8e0 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.872+0000 7f931a800640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f931c156620 0x7f931c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:58:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.873+0000 7f9319400640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c0ae8e0 0x7f931c15cd60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9308009870 tx=0x7f93080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:57.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.873+0000 7f9312000640 1 -- 172.21.15.96:0/522025093 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308041070 con 0x7f931c0ae8e0 2024-04-24T23:58:57.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.873+0000 7f9312000640 1 -- 172.21.15.96:0/522025093 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930803c870 con 0x7f931c0ae8e0 2024-04-24T23:58:57.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.873+0000 7f9312000640 1 -- 172.21.15.96:0/522025093 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308037040 con 0x7f931c0ae8e0 2024-04-24T23:58:57.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.873+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c09d970 con 0x7f931c0ae8e0 2024-04-24T23:58:57.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.873+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c156fb0 con 0x7f931c0ae8e0 2024-04-24T23:58:57.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.874+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c069110 con 0x7f931c0ae8e0 2024-04-24T23:58:57.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.875+0000 7f9312000640 1 -- 172.21.15.96:0/522025093 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9308044070 con 0x7f931c0ae8e0 2024-04-24T23:58:57.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.876+0000 7f9312000640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f92fc06be80 0x7f92fc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:57.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.876+0000 7f9312000640 1 -- 172.21.15.96:0/522025093 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f93080abd30 con 0x7f931c0ae8e0 2024-04-24T23:58:57.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.876+0000 7f9319e00640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f92fc06be80 0x7f92fc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:57.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.877+0000 7f9319e00640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f92fc06be80 0x7f92fc06e340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f930c009670 tx=0x7f930c006bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:57.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:57.884+0000 7f9312000640 1 -- 172.21.15.96:0/522025093 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f930807a750 con 0x7f931c0ae8e0 2024-04-24T23:58:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.072+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f931c1607d0 con 0x7f931c0ae8e0 2024-04-24T23:58:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.073+0000 7f9312000640 1 -- 172.21.15.96:0/522025093 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f930807a050 con 0x7f931c0ae8e0 2024-04-24T23:58:58.073 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:58:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.075+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f92fc06be80 msgr2=0x7f92fc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.075+0000 7f9321000640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f92fc06be80 0x7f92fc06e340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f930c009670 tx=0x7f930c006bf0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.075+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c0ae8e0 msgr2=0x7f931c15cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.075+0000 7f9321000640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c0ae8e0 0x7f931c15cd60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9308009870 tx=0x7f93080046c0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.076+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 shutdown_connections 2024-04-24T23:58:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.076+0000 7f9321000640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f931c156620 0x7f931c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.076+0000 7f9321000640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f92fc06be80 0x7f92fc06e340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.076+0000 7f9321000640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f931c0ae8e0 0x7f931c15cd60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.076+0000 7f9321000640 1 --2- 172.21.15.96:0/522025093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f931c06edf0 0x7f931c1446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.076+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 >> 172.21.15.96:0/522025093 conn(0x7f931c0b19c0 msgr2=0x7f931c0af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:58.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.076+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 shutdown_connections 2024-04-24T23:58:58.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.076+0000 7f9321000640 1 -- 172.21.15.96:0/522025093 wait complete. 2024-04-24T23:58:58.092 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:58:58.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.284+0000 7ff889c00640 1 Processor -- start 2024-04-24T23:58:58.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.284+0000 7ff889c00640 1 -- start start 2024-04-24T23:58:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.285+0000 7ff889c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8840d18f0 0x7ff88406dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.285+0000 7ff889c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff88406e1c0 0x7ff88415edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.286+0000 7ff889c00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88415e8e0 con 0x7ff88415e350 2024-04-24T23:58:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.286+0000 7ff889c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff8840ae960 con 0x7ff8840d18f0 2024-04-24T23:58:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.286+0000 7ff889c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8840aec40 con 0x7ff88406e1c0 2024-04-24T23:58:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.286+0000 7ff882a00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff88415e350 0x7ff8840addb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59652/0 (socket says 172.21.15.96:59652) 2024-04-24T23:58:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.286+0000 7ff882a00640 1 -- 172.21.15.96:0/567542554 learned_addr learned my addr 172.21.15.96:0/567542554 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.286+0000 7ff882000640 1 --2- 172.21.15.96:0/567542554 >> v2:172.21.15.155:3300/0 conn(0x7ff8840d18f0 0x7ff88406dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.286+0000 7ff883400640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff88406e1c0 0x7ff88415edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.286+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613402941 0 0) 0x7ff88415e8e0 con 0x7ff88415e350 2024-04-24T23:58:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.286+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff868003520 con 0x7ff88415e350 2024-04-24T23:58:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4236781066 0 0) 0x7ff868003520 con 0x7ff88415e350 2024-04-24T23:58:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff88406e1c0 msgr2=0x7ff88415edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff88406e1c0 0x7ff88415edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 >> v2:172.21.15.155:3300/0 conn(0x7ff8840d18f0 msgr2=0x7ff88406dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 --2- 172.21.15.96:0/567542554 >> v2:172.21.15.155:3300/0 conn(0x7ff8840d18f0 0x7ff88406dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8840aef20 con 0x7ff88415e350 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7ff874001670 con 0x7ff88415e350 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 >> v1:172.21.15.96:6789/0 conn(0x7ff88415e350 legacy=0x7ff8840addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8680039b0 0x7ff868003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff88406e1c0 0x7ff868004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff868004d40 0x7ff8680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff8840ae960 con 0x7ff8680039b0 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8840aec40 con 0x7ff868004d40 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff86800b9c0 con 0x7ff88406e1c0 2024-04-24T23:58:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.287+0000 7ff882a00640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8680039b0 0x7ff868003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.288+0000 7ff882a00640 1 -- 172.21.15.96:0/567542554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff88406e1c0 msgr2=0x7ff868004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.288+0000 7ff882a00640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff88406e1c0 0x7ff868004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.288+0000 7ff882a00640 1 -- 172.21.15.96:0/567542554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff868004d40 msgr2=0x7ff8680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.288+0000 7ff882a00640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff868004d40 0x7ff8680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.288+0000 7ff882a00640 1 -- 172.21.15.96:0/567542554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff868003520 con 0x7ff8680039b0 2024-04-24T23:58:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.289+0000 7ff882a00640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8680039b0 0x7ff868003dd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c190 tx=0x7ff868005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc91d059bfc768b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.289+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874007c80 con 0x7ff8680039b0 2024-04-24T23:58:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.289+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff87402e070 con 0x7ff8680039b0 2024-04-24T23:58:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.289+0000 7ff881600640 1 -- 172.21.15.96:0/567542554 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874005d30 con 0x7ff8680039b0 2024-04-24T23:58:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.289+0000 7ff889c00640 1 -- 172.21.15.96:0/567542554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8680039b0 msgr2=0x7ff868003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.289+0000 7ff889c00640 1 --2- 172.21.15.96:0/567542554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8680039b0 0x7ff868003dd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c190 tx=0x7ff868005830 comp rx=0 tx=0).stop 2024-04-24T23:58:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.289+0000 7ff883400640 1 -- 172.21.15.96:0/567542554 reap_dead start 2024-04-24T23:58:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.290+0000 7ff889c00640 1 -- 172.21.15.96:0/567542554 shutdown_connections 2024-04-24T23:58:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.290+0000 7ff889c00640 1 -- 172.21.15.96:0/567542554 >> 172.21.15.96:0/567542554 conn(0x7ff8840d0e00 msgr2=0x7ff8840d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.290+0000 7ff889c00640 1 -- 172.21.15.96:0/567542554 shutdown_connections 2024-04-24T23:58:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.290+0000 7ff889c00640 1 -- 172.21.15.96:0/567542554 wait complete. 2024-04-24T23:58:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.292+0000 7ff889c00640 1 Processor -- start 2024-04-24T23:58:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.292+0000 7ff889c00640 1 -- start start 2024-04-24T23:58:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.293+0000 7ff889c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8680039b0 0x7ff884151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.293+0000 7ff889c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff88415c720 0x7ff88415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.293+0000 7ff889c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884156f90 0x7ff884157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.293+0000 7ff889c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff88415f190 con 0x7ff884156f90 2024-04-24T23:58:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.293+0000 7ff889c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff88415f010 con 0x7ff88415c720 2024-04-24T23:58:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.293+0000 7ff889c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff88415f310 con 0x7ff8680039b0 2024-04-24T23:58:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff883400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884156f90 0x7ff884157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff883400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884156f90 0x7ff884157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58190/0 (socket says 172.21.15.96:58190) 2024-04-24T23:58:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff883400640 1 -- 172.21.15.96:0/3857068614 learned_addr learned my addr 172.21.15.96:0/3857068614 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff882a00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8680039b0 0x7ff884151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff882000640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff88415c720 0x7ff88415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff883400640 1 -- 172.21.15.96:0/3857068614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8680039b0 msgr2=0x7ff884151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff883400640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8680039b0 0x7ff884151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff883400640 1 -- 172.21.15.96:0/3857068614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff88415c720 msgr2=0x7ff88415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff883400640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff88415c720 0x7ff88415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff883400640 1 -- 172.21.15.96:0/3857068614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8841626d0 con 0x7ff884156f90 2024-04-24T23:58:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.294+0000 7ff883400640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884156f90 0x7ff884157410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff884050520 tx=0x7ff87c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.295+0000 7ff87aa00640 1 -- 172.21.15.96:0/3857068614 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00bae0 con 0x7ff884156f90 2024-04-24T23:58:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.295+0000 7ff87aa00640 1 -- 172.21.15.96:0/3857068614 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff87c01a070 con 0x7ff884156f90 2024-04-24T23:58:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.295+0000 7ff87aa00640 1 -- 172.21.15.96:0/3857068614 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c014400 con 0x7ff884156f90 2024-04-24T23:58:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.295+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8841e7d60 con 0x7ff884156f90 2024-04-24T23:58:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.295+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8841e8320 con 0x7ff884156f90 2024-04-24T23:58:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.296+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff884162c10 con 0x7ff884156f90 2024-04-24T23:58:58.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.297+0000 7ff87aa00640 1 -- 172.21.15.96:0/3857068614 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff87c005d10 con 0x7ff884156f90 2024-04-24T23:58:58.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.298+0000 7ff87aa00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff86406be30 0x7ff86406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.298+0000 7ff87aa00640 1 -- 172.21.15.96:0/3857068614 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7ff87c08b000 con 0x7ff884156f90 2024-04-24T23:58:58.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.298+0000 7ff882a00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff86406be30 0x7ff86406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.299+0000 7ff882a00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff86406be30 0x7ff86406e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff874032000 tx=0x7ff874007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:58.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.306+0000 7ff87aa00640 1 -- 172.21.15.96:0/3857068614 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff884162c10 con 0x7ff884156f90 2024-04-24T23:58:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.510+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff8840681f0 con 0x7ff884156f90 2024-04-24T23:58:58.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.511+0000 7ff87aa00640 1 -- 172.21.15.96:0/3857068614 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7ff8841626d0 con 0x7ff884156f90 2024-04-24T23:58:58.511 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:58:58.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff86406be30 msgr2=0x7ff86406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff86406be30 0x7ff86406e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff874032000 tx=0x7ff874007000 comp rx=0 tx=0).stop 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884156f90 msgr2=0x7ff884157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884156f90 0x7ff884157410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff884050520 tx=0x7ff87c00b480 comp rx=0 tx=0).stop 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 shutdown_connections 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff86406be30 0x7ff86406e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884156f90 0x7ff884157410 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff88415c720 0x7ff88415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 --2- 172.21.15.96:0/3857068614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8680039b0 0x7ff884151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 >> 172.21.15.96:0/3857068614 conn(0x7ff8840d0e00 msgr2=0x7ff8840b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 shutdown_connections 2024-04-24T23:58:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.514+0000 7ff889c00640 1 -- 172.21.15.96:0/3857068614 wait complete. 2024-04-24T23:58:58.533 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:58:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.741+0000 7f912aa00640 1 Processor -- start 2024-04-24T23:58:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.741+0000 7f912aa00640 1 -- start start 2024-04-24T23:58:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f912aa00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f91240b4ec0 0x7f91240cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f912aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91240ccc20 0x7f9124070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f912aa00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912415fa90 con 0x7f912415f6b0 2024-04-24T23:58:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f912aa00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f91240b4a30 con 0x7f91240b4ec0 2024-04-24T23:58:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f912aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f91240b3e20 con 0x7f91240ccc20 2024-04-24T23:58:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f9129600640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f912415f6b0 0x7f91240ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59656/0 (socket says 172.21.15.96:59656) 2024-04-24T23:58:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f9129600640 1 -- 172.21.15.96:0/3886723320 learned_addr learned my addr 172.21.15.96:0/3886723320 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:58:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f9128c00640 1 --2- 172.21.15.96:0/3886723320 >> v2:172.21.15.96:3300/0 conn(0x7f91240b4ec0 0x7f91240cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f912a000640 1 --2- 172.21.15.96:0/3886723320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91240ccc20 0x7f9124070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f9123e00640 1 -- 172.21.15.96:0/3886723320 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290332950 0 0) 0x7f912415fa90 con 0x7f912415f6b0 2024-04-24T23:58:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.743+0000 7f9123e00640 1 -- 172.21.15.96:0/3886723320 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f910c003520 con 0x7f912415f6b0 2024-04-24T23:58:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.744+0000 7f9128c00640 1 -- 172.21.15.96:0/3886723320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91240ccc20 msgr2=0x7f9124070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.744+0000 7f9128c00640 1 --2- 172.21.15.96:0/3886723320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91240ccc20 0x7f9124070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.744+0000 7f9128c00640 1 -- 172.21.15.96:0/3886723320 >> v1:172.21.15.96:6789/0 conn(0x7f912415f6b0 legacy=0x7f91240ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.744+0000 7f9128c00640 1 -- 172.21.15.96:0/3886723320 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91240b4100 con 0x7f91240b4ec0 2024-04-24T23:58:58.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.745+0000 7f9128c00640 1 --2- 172.21.15.96:0/3886723320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 0x7f91240cc6e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f91100097a0 tx=0x7f911002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526de66b10aeb714 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:58.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.745+0000 7f9123e00640 1 -- 172.21.15.96:0/3886723320 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110037070 con 0x7f91240b4ec0 2024-04-24T23:58:58.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.745+0000 7f9123e00640 1 -- 172.21.15.96:0/3886723320 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9110032440 con 0x7f91240b4ec0 2024-04-24T23:58:58.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.745+0000 7f9123e00640 1 -- 172.21.15.96:0/3886723320 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110032810 con 0x7f91240b4ec0 2024-04-24T23:58:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.745+0000 7f912aa00640 1 -- 172.21.15.96:0/3886723320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 msgr2=0x7f91240cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.745+0000 7f912aa00640 1 --2- 172.21.15.96:0/3886723320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 0x7f91240cc6e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f91100097a0 tx=0x7f911002a180 comp rx=0 tx=0).stop 2024-04-24T23:58:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.746+0000 7f912aa00640 1 -- 172.21.15.96:0/3886723320 shutdown_connections 2024-04-24T23:58:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.746+0000 7f912aa00640 1 --2- 172.21.15.96:0/3886723320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91240ccc20 0x7f9124070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.746+0000 7f912aa00640 1 --2- 172.21.15.96:0/3886723320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 0x7f91240cc6e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.746+0000 7f912aa00640 1 -- 172.21.15.96:0/3886723320 >> 172.21.15.96:0/3886723320 conn(0x7f91240b1f10 msgr2=0x7f91240cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.746+0000 7f912aa00640 1 -- 172.21.15.96:0/3886723320 shutdown_connections 2024-04-24T23:58:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.746+0000 7f912aa00640 1 -- 172.21.15.96:0/3886723320 wait complete. 2024-04-24T23:58:58.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.747+0000 7f912aa00640 1 Processor -- start 2024-04-24T23:58:58.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.747+0000 7f912aa00640 1 -- start start 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.748+0000 7f912aa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 0x7f9124153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.748+0000 7f912aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91240ccc20 0x7f91240cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.748+0000 7f912aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f912415f6b0 0x7f91240addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.748+0000 7f912aa00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f91240cf1c0 con 0x7f91240b4ec0 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.748+0000 7f912aa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91240b46c0 con 0x7f91240ccc20 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.748+0000 7f912aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f91240b3a40 con 0x7f912415f6b0 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9129600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 0x7f9124153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9129600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 0x7f9124153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58216/0 (socket says 172.21.15.96:58216) 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9129600640 1 -- 172.21.15.96:0/2485646613 learned_addr learned my addr 172.21.15.96:0/2485646613 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9128c00640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91240ccc20 0x7f91240cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9129600640 1 -- 172.21.15.96:0/2485646613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f912415f6b0 msgr2=0x7f91240addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9129600640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f912415f6b0 0x7f91240addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9129600640 1 -- 172.21.15.96:0/2485646613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91240ccc20 msgr2=0x7f91240cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9129600640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91240ccc20 0x7f91240cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9129600640 1 -- 172.21.15.96:0/2485646613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91240c9420 con 0x7f91240b4ec0 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.749+0000 7f9129600640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 0x7f9124153680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f911800c3c0 tx=0x7f911800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.750+0000 7f9121600640 1 -- 172.21.15.96:0/2485646613 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118017070 con 0x7f91240b4ec0 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.750+0000 7f9121600640 1 -- 172.21.15.96:0/2485646613 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9118005ce0 con 0x7f91240b4ec0 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.750+0000 7f9121600640 1 -- 172.21.15.96:0/2485646613 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91180072f0 con 0x7f91240b4ec0 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.750+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91240c9700 con 0x7f91240b4ec0 2024-04-24T23:58:58.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.750+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91240c9cc0 con 0x7f91240b4ec0 2024-04-24T23:58:58.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.751+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912409b7d0 con 0x7f91240b4ec0 2024-04-24T23:58:58.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.752+0000 7f9121600640 1 -- 172.21.15.96:0/2485646613 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f911801a070 con 0x7f91240b4ec0 2024-04-24T23:58:58.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.753+0000 7f9121600640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f910406be30 0x7f910406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:58.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.753+0000 7f9121600640 1 -- 172.21.15.96:0/2485646613 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f911808a290 con 0x7f91240b4ec0 2024-04-24T23:58:58.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.753+0000 7f9128c00640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f910406be30 0x7f910406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:58.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.753+0000 7f9128c00640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f910406be30 0x7f910406e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9110034000 tx=0x7f911002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.757+0000 7f9121600640 1 -- 172.21.15.96:0/2485646613 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f912409b7d0 con 0x7f91240b4ec0 2024-04-24T23:58:58.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.969+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91240b1650 con 0x7f91240b4ec0 2024-04-24T23:58:58.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.970+0000 7f9121600640 1 -- 172.21.15.96:0/2485646613 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f9118058ba0 con 0x7f91240b4ec0 2024-04-24T23:58:58.970 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-24T23:58:58.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f910406be30 msgr2=0x7f910406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f910406be30 0x7f910406e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9110034000 tx=0x7f911002e000 comp rx=0 tx=0).stop 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 msgr2=0x7f9124153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 0x7f9124153680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f911800c3c0 tx=0x7f911800c880 comp rx=0 tx=0).stop 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 shutdown_connections 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f912415f6b0 0x7f91240addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91240ccc20 0x7f91240cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f910406be30 0x7f910406e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 --2- 172.21.15.96:0/2485646613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91240b4ec0 0x7f9124153680 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 >> 172.21.15.96:0/2485646613 conn(0x7f91240b1f10 msgr2=0x7f91240b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 shutdown_connections 2024-04-24T23:58:58.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:58.972+0000 7f912aa00640 1 -- 172.21.15.96:0/2485646613 wait complete. 2024-04-24T23:58:58.991 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-24T23:58:58.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:58.992 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-24T23:58:59.065 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-04-24T23:58:59.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:58:59.065 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-24T23:58:59.106 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-24T23:58:59.106 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:58:59.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.314+0000 7f151d800640 1 Processor -- start 2024-04-24T23:58:59.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.314+0000 7f151d800640 1 -- start start 2024-04-24T23:58:59.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.315+0000 7f151d800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f151815c230 0x7f1518071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.315+0000 7f151d800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15180acda0 0x7f15180aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f151d800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180aef50 0x7f15180722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f151d800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f151815c610 con 0x7f15180acda0 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f151d800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1518160b20 con 0x7f151815c230 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f151d800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f15180ad230 con 0x7f15180aef50 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f150e000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15180acda0 0x7f15180aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f150e000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15180acda0 0x7f15180aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58218/0 (socket says 172.21.15.96:58218) 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f150e000640 1 -- 172.21.15.96:0/1236744185 learned_addr learned my addr 172.21.15.96:0/1236744185 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f1516a00640 1 --2- 172.21.15.96:0/1236744185 >> v2:172.21.15.155:3300/0 conn(0x7f151815c230 0x7f1518071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f1517400640 1 --2- 172.21.15.96:0/1236744185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180aef50 0x7f15180722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f150e000640 1 -- 172.21.15.96:0/1236744185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180aef50 msgr2=0x7f15180722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f150e000640 1 --2- 172.21.15.96:0/1236744185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180aef50 0x7f15180722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f150e000640 1 -- 172.21.15.96:0/1236744185 >> v2:172.21.15.155:3300/0 conn(0x7f151815c230 msgr2=0x7f1518071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f150e000640 1 --2- 172.21.15.96:0/1236744185 >> v2:172.21.15.155:3300/0 conn(0x7f151815c230 0x7f1518071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.316+0000 7f150e000640 1 -- 172.21.15.96:0/1236744185 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151815fd60 con 0x7f15180acda0 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.317+0000 7f150e000640 1 --2- 172.21.15.96:0/1236744185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15180acda0 0x7f15180aea10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f151806c070 tx=0x7f150002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f006f35d708ef9df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.318+0000 7f1516000640 1 -- 172.21.15.96:0/1236744185 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500037070 con 0x7f15180acda0 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.318+0000 7f1516000640 1 -- 172.21.15.96:0/1236744185 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1500032440 con 0x7f15180acda0 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.318+0000 7f1516000640 1 -- 172.21.15.96:0/1236744185 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500032810 con 0x7f15180acda0 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.318+0000 7f151d800640 1 -- 172.21.15.96:0/1236744185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15180acda0 msgr2=0x7f15180aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.318+0000 7f151d800640 1 --2- 172.21.15.96:0/1236744185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15180acda0 0x7f15180aea10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f151806c070 tx=0x7f150002a1e0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.319+0000 7f151d800640 1 -- 172.21.15.96:0/1236744185 shutdown_connections 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.319+0000 7f151d800640 1 --2- 172.21.15.96:0/1236744185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180aef50 0x7f15180722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.319+0000 7f151d800640 1 --2- 172.21.15.96:0/1236744185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15180acda0 0x7f15180aea10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.319+0000 7f151d800640 1 --2- 172.21.15.96:0/1236744185 >> v2:172.21.15.155:3300/0 conn(0x7f151815c230 0x7f1518071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.319+0000 7f151d800640 1 -- 172.21.15.96:0/1236744185 >> 172.21.15.96:0/1236744185 conn(0x7f15180b19c0 msgr2=0x7f15180b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.319+0000 7f151d800640 1 -- 172.21.15.96:0/1236744185 shutdown_connections 2024-04-24T23:58:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.319+0000 7f151d800640 1 -- 172.21.15.96:0/1236744185 wait complete. 2024-04-24T23:58:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.320+0000 7f151d800640 1 Processor -- start 2024-04-24T23:58:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.320+0000 7f151d800640 1 -- start start 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.321+0000 7f151d800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180acda0 0x7f151809c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.321+0000 7f151d800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15180aef50 0x7f151815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.321+0000 7f151d800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f151815c230 0x7f15180b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.321+0000 7f151d800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1518160600 con 0x7f151815c230 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.321+0000 7f151d800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1518160320 con 0x7f15180aef50 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.321+0000 7f151d800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f15180af3e0 con 0x7f15180acda0 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1517400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f151815c230 0x7f15180b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1517400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f151815c230 0x7f15180b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58224/0 (socket says 172.21.15.96:58224) 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1517400640 1 -- 172.21.15.96:0/2390026506 learned_addr learned my addr 172.21.15.96:0/2390026506 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1516a00640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180acda0 0x7f151809c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1517400640 1 -- 172.21.15.96:0/2390026506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180acda0 msgr2=0x7f151809c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1517400640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180acda0 0x7f151809c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1517400640 1 -- 172.21.15.96:0/2390026506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15180aef50 msgr2=0x7f151815c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1517400640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15180aef50 0x7f151815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1517400640 1 -- 172.21.15.96:0/2390026506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151815ccd0 con 0x7f151815c230 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.322+0000 7f1517400640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f151815c230 0x7f15180b08e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1510007d40 tx=0x7f151000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.323+0000 7f150f400640 1 -- 172.21.15.96:0/2390026506 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510014420 con 0x7f151815c230 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.323+0000 7f150f400640 1 -- 172.21.15.96:0/2390026506 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1510019070 con 0x7f151815c230 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.323+0000 7f150f400640 1 -- 172.21.15.96:0/2390026506 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510014820 con 0x7f151815c230 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.323+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151815cf70 con 0x7f151815c230 2024-04-24T23:58:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.323+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151815d530 con 0x7f151815c230 2024-04-24T23:58:59.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.324+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1518069110 con 0x7f151815c230 2024-04-24T23:58:59.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.325+0000 7f150f400640 1 -- 172.21.15.96:0/2390026506 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15100149c0 con 0x7f151815c230 2024-04-24T23:58:59.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.326+0000 7f150f400640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14f406be30 0x7f14f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.326+0000 7f150f400640 1 -- 172.21.15.96:0/2390026506 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f151008b770 con 0x7f151815c230 2024-04-24T23:58:59.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.326+0000 7f1516a00640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14f406be30 0x7f14f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.327+0000 7f1516a00640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14f406be30 0x7f14f406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1508006fd0 tx=0x7f1508008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:59.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.330+0000 7f150f400640 1 -- 172.21.15.96:0/2390026506 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1510059ff0 con 0x7f151815c230 2024-04-24T23:58:59.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.569+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f151815a360 con 0x7f151815c230 2024-04-24T23:58:59.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.570+0000 7f150f400640 1 -- 172.21.15.96:0/2390026506 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5178 (secure 0 0 0) 0x7f15100598f0 con 0x7f151815c230 2024-04-24T23:58:59.570 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:58:59.571 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1694444006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1694444006},{"type":"v1","addr":"172.21.15.96:6837","nonce":1694444006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3646872561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6833","nonce":3646872561},{"type":"v1","addr":"172.21.15.155:6835","nonce":3646872561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/227257747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":227257747},{"type":"v1","addr":"172.21.15.96:6836","nonce":227257747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:58:05.205304+0000","modified":"2024-04-24T23:58:08.502172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6834/1986626476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1986626476},{"type":"v1","addr":"172.21.15.155:6834","nonce":1986626476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-24T23:58:59.571 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-04-24T23:58:59.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14f406be30 msgr2=0x7f14f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:59.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14f406be30 0x7f14f406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1508006fd0 tx=0x7f1508008040 comp rx=0 tx=0).stop 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f151815c230 msgr2=0x7f15180b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f151815c230 0x7f15180b08e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1510007d40 tx=0x7f151000e4b0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 shutdown_connections 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14f406be30 0x7f14f406e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f151815c230 0x7f15180b08e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15180aef50 0x7f151815c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 --2- 172.21.15.96:0/2390026506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15180acda0 0x7f151809c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 >> 172.21.15.96:0/2390026506 conn(0x7f15180b19c0 msgr2=0x7f15180cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 shutdown_connections 2024-04-24T23:58:59.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.573+0000 7f151d800640 1 -- 172.21.15.96:0/2390026506 wait complete. 2024-04-24T23:58:59.591 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:58:59.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.791+0000 7fb943200640 1 Processor -- start 2024-04-24T23:58:59.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.791+0000 7fb943200640 1 -- start start 2024-04-24T23:58:59.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.793+0000 7fb943200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9440b4ec0 0x7fb9440cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.793+0000 7fb943200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9440ccc20 0x7fb944070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.793+0000 7fb943200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94415fa90 con 0x7fb94415f6b0 2024-04-24T23:58:59.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.793+0000 7fb943200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb9440b4a30 con 0x7fb9440b4ec0 2024-04-24T23:58:59.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.793+0000 7fb943200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9440b3e20 con 0x7fb9440ccc20 2024-04-24T23:58:59.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.793+0000 7fb941400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9440b4ec0 0x7fb9440cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.794+0000 7fb942800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9440ccc20 0x7fb944070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.794+0000 7fb941400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9440b4ec0 0x7fb9440cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:35342/0 (socket says 172.21.15.96:35342) 2024-04-24T23:58:59.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.794+0000 7fb941400640 1 -- 172.21.15.96:0/3980354615 learned_addr learned my addr 172.21.15.96:0/3980354615 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:59.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.794+0000 7fb941400640 1 -- 172.21.15.96:0/3980354615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9440ccc20 msgr2=0x7fb944070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:58:59.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.794+0000 7fb941400640 1 --2- 172.21.15.96:0/3980354615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9440ccc20 0x7fb944070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.794+0000 7fb941400640 1 -- 172.21.15.96:0/3980354615 >> v1:172.21.15.155:6789/0 conn(0x7fb94415f6b0 legacy=0x7fb9440ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:59.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.794+0000 7fb941400640 1 -- 172.21.15.96:0/3980354615 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9440b4100 con 0x7fb9440b4ec0 2024-04-24T23:58:59.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.796+0000 7fb941400640 1 --2- 172.21.15.96:0/3980354615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9440b4ec0 0x7fb9440cc6e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb930009870 tx=0x7fb93002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1814683b67713e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:59.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.796+0000 7fb940a00640 1 -- 172.21.15.96:0/3980354615 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930037070 con 0x7fb9440b4ec0 2024-04-24T23:58:59.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.796+0000 7fb940a00640 1 -- 172.21.15.96:0/3980354615 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb930032440 con 0x7fb9440b4ec0 2024-04-24T23:58:59.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.797+0000 7fb940a00640 1 -- 172.21.15.96:0/3980354615 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930032810 con 0x7fb9440b4ec0 2024-04-24T23:58:59.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.797+0000 7fb943200640 1 -- 172.21.15.96:0/3980354615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9440b4ec0 msgr2=0x7fb9440cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:59.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.797+0000 7fb943200640 1 --2- 172.21.15.96:0/3980354615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9440b4ec0 0x7fb9440cc6e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb930009870 tx=0x7fb93002a270 comp rx=0 tx=0).stop 2024-04-24T23:58:59.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.797+0000 7fb943200640 1 -- 172.21.15.96:0/3980354615 shutdown_connections 2024-04-24T23:58:59.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.797+0000 7fb943200640 1 --2- 172.21.15.96:0/3980354615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9440ccc20 0x7fb944070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.797+0000 7fb943200640 1 --2- 172.21.15.96:0/3980354615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9440b4ec0 0x7fb9440cc6e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.797+0000 7fb943200640 1 -- 172.21.15.96:0/3980354615 >> 172.21.15.96:0/3980354615 conn(0x7fb9440b1f10 msgr2=0x7fb9440cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:58:59.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.797+0000 7fb943200640 1 -- 172.21.15.96:0/3980354615 shutdown_connections 2024-04-24T23:58:59.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.797+0000 7fb943200640 1 -- 172.21.15.96:0/3980354615 wait complete. 2024-04-24T23:58:59.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.799+0000 7fb943200640 1 Processor -- start 2024-04-24T23:58:59.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.799+0000 7fb943200640 1 -- start start 2024-04-24T23:58:59.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.800+0000 7fb943200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9440b4ec0 0x7fb944152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.800+0000 7fb943200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9440ccc20 0x7fb9441582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.800+0000 7fb943200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb94415f6b0 0x7fb9440ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.800+0000 7fb943200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb9440cf1c0 con 0x7fb9440b4ec0 2024-04-24T23:58:59.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.800+0000 7fb943200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb9440b46c0 con 0x7fb9440ccc20 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.800+0000 7fb943200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9440b3a40 con 0x7fb94415f6b0 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.800+0000 7fb941e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9440b4ec0 0x7fb944152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb941e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9440b4ec0 0x7fb944152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58232/0 (socket says 172.21.15.96:58232) 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb941e00640 1 -- 172.21.15.96:0/2160162172 learned_addr learned my addr 172.21.15.96:0/2160162172 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb941400640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9440ccc20 0x7fb9441582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb942800640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb94415f6b0 0x7fb9440ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb941e00640 1 -- 172.21.15.96:0/2160162172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb94415f6b0 msgr2=0x7fb9440ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb941e00640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb94415f6b0 0x7fb9440ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb941e00640 1 -- 172.21.15.96:0/2160162172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9440ccc20 msgr2=0x7fb9441582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb941e00640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9440ccc20 0x7fb9441582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb941e00640 1 -- 172.21.15.96:0/2160162172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94406ced0 con 0x7fb9440b4ec0 2024-04-24T23:58:59.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.801+0000 7fb941e00640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9440b4ec0 0x7fb944152b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb93400c3c0 tx=0x7fb93400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:59.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.802+0000 7fb93a000640 1 -- 172.21.15.96:0/2160162172 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9340052d0 con 0x7fb9440b4ec0 2024-04-24T23:58:59.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.802+0000 7fb93a000640 1 -- 172.21.15.96:0/2160162172 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb934005490 con 0x7fb9440b4ec0 2024-04-24T23:58:59.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.802+0000 7fb93a000640 1 -- 172.21.15.96:0/2160162172 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb934007260 con 0x7fb9440b4ec0 2024-04-24T23:58:59.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.802+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94406d1b0 con 0x7fb9440b4ec0 2024-04-24T23:58:59.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.802+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94415a170 con 0x7fb9440b4ec0 2024-04-24T23:58:59.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.803+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb944067e40 con 0x7fb9440b4ec0 2024-04-24T23:58:59.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.804+0000 7fb93a000640 1 -- 172.21.15.96:0/2160162172 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb934007400 con 0x7fb9440b4ec0 2024-04-24T23:58:59.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.805+0000 7fb93a000640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb92406be30 0x7fb92406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:58:59.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.805+0000 7fb93a000640 1 -- 172.21.15.96:0/2160162172 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fb93408a470 con 0x7fb9440b4ec0 2024-04-24T23:58:59.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.805+0000 7fb941400640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb92406be30 0x7fb92406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:58:59.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.806+0000 7fb941400640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb92406be30 0x7fb92406e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb930034000 tx=0x7fb93002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:58:59.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:58:59.809+0000 7fb93a000640 1 -- 172.21.15.96:0/2160162172 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb934058cf0 con 0x7fb9440b4ec0 2024-04-24T23:59:00.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.011+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb944068310 con 0x7fb9440b4ec0 2024-04-24T23:59:00.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.014+0000 7fb93a000640 1 -- 172.21.15.96:0/2160162172 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16851 (secure 0 0 0) 0x7fb944068310 con 0x7fb9440b4ec0 2024-04-24T23:59:00.015 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:00.015 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:48.255571+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.017+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb92406be30 msgr2=0x7fb92406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.017+0000 7fb943200640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb92406be30 0x7fb92406e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb930034000 tx=0x7fb93002e000 comp rx=0 tx=0).stop 2024-04-24T23:59:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.017+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9440b4ec0 msgr2=0x7fb944152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.017+0000 7fb943200640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9440b4ec0 0x7fb944152b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb93400c3c0 tx=0x7fb93400c880 comp rx=0 tx=0).stop 2024-04-24T23:59:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.018+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 shutdown_connections 2024-04-24T23:59:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.018+0000 7fb943200640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb94415f6b0 0x7fb9440ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.018+0000 7fb943200640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9440ccc20 0x7fb9441582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.018+0000 7fb943200640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fb92406be30 0x7fb92406e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.018+0000 7fb943200640 1 --2- 172.21.15.96:0/2160162172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9440b4ec0 0x7fb944152b50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.018+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 >> 172.21.15.96:0/2160162172 conn(0x7fb9440b1f10 msgr2=0x7fb94415d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:00.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.018+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 shutdown_connections 2024-04-24T23:59:00.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.018+0000 7fb943200640 1 -- 172.21.15.96:0/2160162172 wait complete. 2024-04-24T23:59:00.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:58:03.426234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:58:04.213419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:59:00.040 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:59:00.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.238+0000 7f4332e00640 1 Processor -- start 2024-04-24T23:59:00.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.238+0000 7f4332e00640 1 -- start start 2024-04-24T23:59:00.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.239+0000 7f4332e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f432c15b090 0x7f432c09db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f4332e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f432c06ec40 0x7f432c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f4332e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f432c0ad820 con 0x7f432c0b2cc0 2024-04-24T23:59:00.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f4332e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f432c0b3260 con 0x7f432c15b090 2024-04-24T23:59:00.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f4332e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f432c0b3540 con 0x7f432c06ec40 2024-04-24T23:59:00.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f432be00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f432c15b090 0x7f432c09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:00.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f432be00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f432c15b090 0x7f432c09db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58240/0 (socket says 172.21.15.96:58240) 2024-04-24T23:59:00.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f432be00640 1 -- 172.21.15.96:0/1068935278 learned_addr learned my addr 172.21.15.96:0/1068935278 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:00.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f432be00640 1 -- 172.21.15.96:0/1068935278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f432c06ec40 msgr2=0x7f432c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:00.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f432be00640 1 --2- 172.21.15.96:0/1068935278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f432c06ec40 0x7f432c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f432be00640 1 -- 172.21.15.96:0/1068935278 >> v1:172.21.15.155:6789/0 conn(0x7f432c0b2cc0 legacy=0x7f432c06e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:00.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.240+0000 7f432be00640 1 -- 172.21.15.96:0/1068935278 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432c0b3820 con 0x7f432c15b090 2024-04-24T23:59:00.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.241+0000 7f432be00640 1 --2- 172.21.15.96:0/1068935278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c15b090 0x7f432c09db30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f431c00bb10 tx=0x7f431c02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539fda36f8e09546 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:00.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.242+0000 7f432b400640 1 -- 172.21.15.96:0/1068935278 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c0325a0 con 0x7f432c15b090 2024-04-24T23:59:00.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.242+0000 7f432b400640 1 -- 172.21.15.96:0/1068935278 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f431c038070 con 0x7f432c15b090 2024-04-24T23:59:00.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.242+0000 7f432b400640 1 -- 172.21.15.96:0/1068935278 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c032960 con 0x7f432c15b090 2024-04-24T23:59:00.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.242+0000 7f4332e00640 1 -- 172.21.15.96:0/1068935278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c15b090 msgr2=0x7f432c09db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.242+0000 7f4332e00640 1 --2- 172.21.15.96:0/1068935278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c15b090 0x7f432c09db30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f431c00bb10 tx=0x7f431c02c8e0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.243+0000 7f4332e00640 1 -- 172.21.15.96:0/1068935278 shutdown_connections 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.243+0000 7f4332e00640 1 --2- 172.21.15.96:0/1068935278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f432c06ec40 0x7f432c0add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.243+0000 7f4332e00640 1 --2- 172.21.15.96:0/1068935278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c15b090 0x7f432c09db30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.243+0000 7f4332e00640 1 -- 172.21.15.96:0/1068935278 >> 172.21.15.96:0/1068935278 conn(0x7f432c0b19c0 msgr2=0x7f432c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.243+0000 7f4332e00640 1 -- 172.21.15.96:0/1068935278 shutdown_connections 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.243+0000 7f4332e00640 1 -- 172.21.15.96:0/1068935278 wait complete. 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.244+0000 7f4332e00640 1 Processor -- start 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.244+0000 7f4332e00640 1 -- start start 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.245+0000 7f4332e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f432c06ec40 0x7f432c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.245+0000 7f4332e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0b2cc0 0x7f432c09d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.245+0000 7f4332e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f432c15b090 0x7f432c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.245+0000 7f4332e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f432c15b470 con 0x7f432c0b2cc0 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.245+0000 7f4332e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f432c0b4f70 con 0x7f432c06ec40 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.245+0000 7f4332e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f432c070e10 con 0x7f432c15b090 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f4323e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0b2cc0 0x7f432c09d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f4323e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0b2cc0 0x7f432c09d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58256/0 (socket says 172.21.15.96:58256) 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f4323e00640 1 -- 172.21.15.96:0/1776331625 learned_addr learned my addr 172.21.15.96:0/1776331625 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f432be00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f432c06ec40 0x7f432c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f4323e00640 1 -- 172.21.15.96:0/1776331625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f432c15b090 msgr2=0x7f432c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f4323e00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f432c15b090 0x7f432c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f4323e00640 1 -- 172.21.15.96:0/1776331625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f432c06ec40 msgr2=0x7f432c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f4323e00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f432c06ec40 0x7f432c09aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f4323e00640 1 -- 172.21.15.96:0/1776331625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432c09b1e0 con 0x7f432c0b2cc0 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f432be00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f432c06ec40 0x7f432c09aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.246+0000 7f4323e00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0b2cc0 0x7f432c09d5e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f431400c440 tx=0x7f431400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.247+0000 7f4328c00640 1 -- 172.21.15.96:0/1776331625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314017070 con 0x7f432c0b2cc0 2024-04-24T23:59:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.247+0000 7f4328c00640 1 -- 172.21.15.96:0/1776331625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43140035f0 con 0x7f432c0b2cc0 2024-04-24T23:59:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.247+0000 7f4328c00640 1 -- 172.21.15.96:0/1776331625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43140039e0 con 0x7f432c0b2cc0 2024-04-24T23:59:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.247+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432c09b4c0 con 0x7f432c0b2cc0 2024-04-24T23:59:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.247+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f432c09ba80 con 0x7f432c0b2cc0 2024-04-24T23:59:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.248+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f432c0689c0 con 0x7f432c0b2cc0 2024-04-24T23:59:00.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.249+0000 7f4328c00640 1 -- 172.21.15.96:0/1776331625 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f431401a070 con 0x7f432c0b2cc0 2024-04-24T23:59:00.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.250+0000 7f4328c00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f430806be30 0x7f430806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.250+0000 7f4328c00640 1 -- 172.21.15.96:0/1776331625 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f431408a200 con 0x7f432c0b2cc0 2024-04-24T23:59:00.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.250+0000 7f432be00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f430806be30 0x7f430806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:00.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.251+0000 7f432be00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f430806be30 0x7f430806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f431c037000 tx=0x7f431c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:00.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.254+0000 7f4328c00640 1 -- 172.21.15.96:0/1776331625 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f432c0689c0 con 0x7f432c0b2cc0 2024-04-24T23:59:00.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.453+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f432c0b2630 con 0x7f432c0b2cc0 2024-04-24T23:59:00.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.454+0000 7f4328c00640 1 -- 172.21.15.96:0/1776331625 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f432c0b2630 con 0x7f432c0b2cc0 2024-04-24T23:59:00.454 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:59:00.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f430806be30 msgr2=0x7f430806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f430806be30 0x7f430806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f431c037000 tx=0x7f431c008040 comp rx=0 tx=0).stop 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0b2cc0 msgr2=0x7f432c09d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0b2cc0 0x7f432c09d5e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f431400c440 tx=0x7f431400c900 comp rx=0 tx=0).stop 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 shutdown_connections 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f432c15b090 0x7f432c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f430806be30 0x7f430806e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0b2cc0 0x7f432c09d5e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 --2- 172.21.15.96:0/1776331625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f432c06ec40 0x7f432c09aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 >> 172.21.15.96:0/1776331625 conn(0x7f432c0b19c0 msgr2=0x7f432c0b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 shutdown_connections 2024-04-24T23:59:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.457+0000 7f4332e00640 1 -- 172.21.15.96:0/1776331625 wait complete. 2024-04-24T23:59:00.476 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:59:00.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.681+0000 7f0197e00640 1 Processor -- start 2024-04-24T23:59:00.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.681+0000 7f0197e00640 1 -- start start 2024-04-24T23:59:00.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.683+0000 7f0197e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f019815c2b0 0x7f01980b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.683+0000 7f0197e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f019806b7d0 0x7f01980cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.683+0000 7f0197e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01980b51b0 con 0x7f01980af870 2024-04-24T23:59:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.683+0000 7f0197e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f01980af650 con 0x7f019806b7d0 2024-04-24T23:59:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.683+0000 7f0197e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f01980b5490 con 0x7f019815c2b0 2024-04-24T23:59:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.683+0000 7f0197400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f019806b7d0 0x7f01980cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.683+0000 7f0197400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f019806b7d0 0x7f01980cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58270/0 (socket says 172.21.15.96:58270) 2024-04-24T23:59:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.683+0000 7f0197400640 1 -- 172.21.15.96:0/2738137104 learned_addr learned my addr 172.21.15.96:0/2738137104 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.683+0000 7f0196000640 1 --1- 172.21.15.96:0/2738137104 >> v1:172.21.15.96:6789/0 conn(0x7f01980af870 0x7f019806b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59662/0 (socket says 172.21.15.96:59662) 2024-04-24T23:59:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.684+0000 7f0196a00640 1 --2- 172.21.15.96:0/2738137104 >> v2:172.21.15.155:3300/0 conn(0x7f019815c2b0 0x7f01980b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:00.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.684+0000 7f0197400640 1 -- 172.21.15.96:0/2738137104 >> v2:172.21.15.155:3300/0 conn(0x7f019815c2b0 msgr2=0x7f01980b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:00.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.684+0000 7f0197400640 1 --2- 172.21.15.96:0/2738137104 >> v2:172.21.15.155:3300/0 conn(0x7f019815c2b0 0x7f01980b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.684+0000 7f0197400640 1 -- 172.21.15.96:0/2738137104 >> v1:172.21.15.96:6789/0 conn(0x7f01980af870 legacy=0x7f019806b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.684+0000 7f0197400640 1 -- 172.21.15.96:0/2738137104 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01980b5770 con 0x7f019806b7d0 2024-04-24T23:59:00.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.685+0000 7f0197400640 1 --2- 172.21.15.96:0/2738137104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019806b7d0 0x7f01980cd6f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01980d1420 tx=0x7f019002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bb8f58f89251a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:00.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.685+0000 7f0195600640 1 -- 172.21.15.96:0/2738137104 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0190037070 con 0x7f019806b7d0 2024-04-24T23:59:00.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0195600640 1 -- 172.21.15.96:0/2738137104 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0190032440 con 0x7f019806b7d0 2024-04-24T23:59:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0195600640 1 -- 172.21.15.96:0/2738137104 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0190032810 con 0x7f019806b7d0 2024-04-24T23:59:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0197e00640 1 -- 172.21.15.96:0/2738137104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019806b7d0 msgr2=0x7f01980cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0197e00640 1 --2- 172.21.15.96:0/2738137104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019806b7d0 0x7f01980cd6f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01980d1420 tx=0x7f019002a270 comp rx=0 tx=0).stop 2024-04-24T23:59:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0197e00640 1 -- 172.21.15.96:0/2738137104 shutdown_connections 2024-04-24T23:59:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0197e00640 1 --2- 172.21.15.96:0/2738137104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019806b7d0 0x7f01980cd6f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0197e00640 1 --2- 172.21.15.96:0/2738137104 >> v2:172.21.15.155:3300/0 conn(0x7f019815c2b0 0x7f01980b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0197e00640 1 -- 172.21.15.96:0/2738137104 >> 172.21.15.96:0/2738137104 conn(0x7f01980b1e90 msgr2=0x7f01980b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0197e00640 1 -- 172.21.15.96:0/2738137104 shutdown_connections 2024-04-24T23:59:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.686+0000 7f0197e00640 1 -- 172.21.15.96:0/2738137104 wait complete. 2024-04-24T23:59:00.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.688+0000 7f0197e00640 1 Processor -- start 2024-04-24T23:59:00.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.688+0000 7f0197e00640 1 -- start start 2024-04-24T23:59:00.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.689+0000 7f0197e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f019806b7d0 0x7f01981578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.689+0000 7f0197e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01980af870 0x7f019815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.689+0000 7f0197e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019815c2b0 0x7f01980cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.689+0000 7f0197e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f01980ce5e0 con 0x7f019815c2b0 2024-04-24T23:59:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.689+0000 7f0197e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01980ce460 con 0x7f01980af870 2024-04-24T23:59:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.689+0000 7f0197e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01980ce760 con 0x7f019806b7d0 2024-04-24T23:59:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.689+0000 7f0197400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019815c2b0 0x7f01980cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.689+0000 7f0197400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019815c2b0 0x7f01980cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58272/0 (socket says 172.21.15.96:58272) 2024-04-24T23:59:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.689+0000 7f0197400640 1 -- 172.21.15.96:0/907888523 learned_addr learned my addr 172.21.15.96:0/907888523 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f0197400640 1 -- 172.21.15.96:0/907888523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f019806b7d0 msgr2=0x7f01981578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f0197400640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f019806b7d0 0x7f01981578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f0197400640 1 -- 172.21.15.96:0/907888523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01980af870 msgr2=0x7f019815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f0197400640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01980af870 0x7f019815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f0197400640 1 -- 172.21.15.96:0/907888523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019815cf90 con 0x7f019815c2b0 2024-04-24T23:59:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f0197400640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019815c2b0 0x7f01980cb820 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f01900090b0 tx=0x7f01900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f018ea00640 1 -- 172.21.15.96:0/907888523 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0190037040 con 0x7f019815c2b0 2024-04-24T23:59:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f018ea00640 1 -- 172.21.15.96:0/907888523 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0190042070 con 0x7f019815c2b0 2024-04-24T23:59:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f018ea00640 1 -- 172.21.15.96:0/907888523 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0190030900 con 0x7f019815c2b0 2024-04-24T23:59:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.690+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019815d270 con 0x7f019815c2b0 2024-04-24T23:59:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.691+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019815d830 con 0x7f019815c2b0 2024-04-24T23:59:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.692+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01980755d0 con 0x7f019815c2b0 2024-04-24T23:59:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.692+0000 7f018ea00640 1 -- 172.21.15.96:0/907888523 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0190030aa0 con 0x7f019815c2b0 2024-04-24T23:59:00.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.693+0000 7f018ea00640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f017406be30 0x7f017406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:00.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.693+0000 7f018ea00640 1 -- 172.21.15.96:0/907888523 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f01900ab8b0 con 0x7f019815c2b0 2024-04-24T23:59:00.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.694+0000 7f0196a00640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f017406be30 0x7f017406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:00.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.694+0000 7f0196a00640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f017406be30 0x7f017406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01880070b0 tx=0x7f0188007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:00.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.698+0000 7f018ea00640 1 -- 172.21.15.96:0/907888523 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f019007a130 con 0x7f019815c2b0 2024-04-24T23:59:00.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.898+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f019806b2d0 con 0x7f019815c2b0 2024-04-24T23:59:00.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.899+0000 7f018ea00640 1 -- 172.21.15.96:0/907888523 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f0190079a30 con 0x7f019815c2b0 2024-04-24T23:59:00.899 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:59:00.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f017406be30 msgr2=0x7f017406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f017406be30 0x7f017406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01880070b0 tx=0x7f0188007040 comp rx=0 tx=0).stop 2024-04-24T23:59:00.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019815c2b0 msgr2=0x7f01980cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019815c2b0 0x7f01980cb820 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f01900090b0 tx=0x7f01900046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 shutdown_connections 2024-04-24T23:59:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f017406be30 0x7f017406e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019815c2b0 0x7f01980cb820 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01980af870 0x7f019815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 --2- 172.21.15.96:0/907888523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f019806b7d0 0x7f01981578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 >> 172.21.15.96:0/907888523 conn(0x7f01980b1e90 msgr2=0x7f01980b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 shutdown_connections 2024-04-24T23:59:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:00.902+0000 7f0197e00640 1 -- 172.21.15.96:0/907888523 wait complete. 2024-04-24T23:59:00.921 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:59:01.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.118+0000 7f278a400640 1 Processor -- start 2024-04-24T23:59:01.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.118+0000 7f278a400640 1 -- start start 2024-04-24T23:59:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.119+0000 7f278a400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f27841446c0 0x7f278406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.119+0000 7f278a400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f278415f160 0x7f2784070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.119+0000 7f278a400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27840b36f0 con 0x7f27840b4790 2024-04-24T23:59:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.119+0000 7f278a400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f27840b4300 con 0x7f27841446c0 2024-04-24T23:59:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.119+0000 7f278a400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f27840b39d0 con 0x7f278415f160 2024-04-24T23:59:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.120+0000 7f2789000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f27841446c0 0x7f278406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.120+0000 7f2789000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f27841446c0 0x7f278406e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58282/0 (socket says 172.21.15.96:58282) 2024-04-24T23:59:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.120+0000 7f2789000640 1 -- 172.21.15.96:0/3318830933 learned_addr learned my addr 172.21.15.96:0/3318830933 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.120+0000 7f2789a00640 1 --2- 172.21.15.96:0/3318830933 >> v2:172.21.15.155:3300/0 conn(0x7f278415f160 0x7f2784070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.120+0000 7f2789000640 1 -- 172.21.15.96:0/3318830933 >> v2:172.21.15.155:3300/0 conn(0x7f278415f160 msgr2=0x7f2784070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.120+0000 7f2789000640 1 --2- 172.21.15.96:0/3318830933 >> v2:172.21.15.155:3300/0 conn(0x7f278415f160 0x7f2784070ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.120+0000 7f2789000640 1 -- 172.21.15.96:0/3318830933 >> v1:172.21.15.96:6789/0 conn(0x7f27840b4790 legacy=0x7f278415ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.120+0000 7f2789000640 1 -- 172.21.15.96:0/3318830933 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27840b3cb0 con 0x7f27841446c0 2024-04-24T23:59:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.120+0000 7f2783400640 1 -- 172.21.15.96:0/3318830933 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703914873 0 0) 0x7f27840b36f0 con 0x7f27840b4790 2024-04-24T23:59:01.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.121+0000 7f2789000640 1 --2- 172.21.15.96:0/3318830933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27841446c0 0x7f278406e3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f27840b4480 tx=0x7f277402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5713cfdd4f19ce72 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.122+0000 7f2783400640 1 -- 172.21.15.96:0/3318830933 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774036070 con 0x7f27841446c0 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.122+0000 7f2783400640 1 -- 172.21.15.96:0/3318830933 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2774031600 con 0x7f27841446c0 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.122+0000 7f2783400640 1 -- 172.21.15.96:0/3318830933 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27740319d0 con 0x7f27841446c0 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.122+0000 7f278a400640 1 -- 172.21.15.96:0/3318830933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27841446c0 msgr2=0x7f278406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.122+0000 7f278a400640 1 --2- 172.21.15.96:0/3318830933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27841446c0 0x7f278406e3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f27840b4480 tx=0x7f277402a610 comp rx=0 tx=0).stop 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.122+0000 7f278a400640 1 -- 172.21.15.96:0/3318830933 shutdown_connections 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.122+0000 7f278a400640 1 --2- 172.21.15.96:0/3318830933 >> v2:172.21.15.155:3300/0 conn(0x7f278415f160 0x7f2784070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.122+0000 7f278a400640 1 --2- 172.21.15.96:0/3318830933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27841446c0 0x7f278406e3c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.122+0000 7f278a400640 1 -- 172.21.15.96:0/3318830933 >> 172.21.15.96:0/3318830933 conn(0x7f27840b18b0 msgr2=0x7f27840b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.123+0000 7f278a400640 1 -- 172.21.15.96:0/3318830933 shutdown_connections 2024-04-24T23:59:01.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.123+0000 7f278a400640 1 -- 172.21.15.96:0/3318830933 wait complete. 2024-04-24T23:59:01.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.124+0000 7f278a400640 1 Processor -- start 2024-04-24T23:59:01.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.124+0000 7f278a400640 1 -- start start 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.125+0000 7f278a400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27840b4790 0x7f278415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.125+0000 7f278a400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27841446c0 0x7f278415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.125+0000 7f278a400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f278415f160 0x7f2784132c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.125+0000 7f278a400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f278415f7b0 con 0x7f27840b4790 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.125+0000 7f278a400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2784144aa0 con 0x7f27841446c0 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.125+0000 7f278a400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f278406e900 con 0x7f278415f160 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2789000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27840b4790 0x7f278415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2789000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27840b4790 0x7f278415a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58294/0 (socket says 172.21.15.96:58294) 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2789000640 1 -- 172.21.15.96:0/276272032 learned_addr learned my addr 172.21.15.96:0/276272032 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2783e00640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27841446c0 0x7f278415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2789000640 1 -- 172.21.15.96:0/276272032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f278415f160 msgr2=0x7f2784132c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2789000640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f278415f160 0x7f2784132c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2789000640 1 -- 172.21.15.96:0/276272032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27841446c0 msgr2=0x7f278415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2789000640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27841446c0 0x7f278415dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2789000640 1 -- 172.21.15.96:0/276272032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27840cd250 con 0x7f27840b4790 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2783e00640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27841446c0 0x7f278415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.126+0000 7f2789000640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27840b4790 0x7f278415a4a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2774034040 tx=0x7f2774004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.127+0000 7f2780c00640 1 -- 172.21.15.96:0/276272032 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774036050 con 0x7f27840b4790 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.127+0000 7f2780c00640 1 -- 172.21.15.96:0/276272032 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2774042070 con 0x7f27840b4790 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.127+0000 7f2780c00640 1 -- 172.21.15.96:0/276272032 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774007c50 con 0x7f27840b4790 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.127+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27840cd530 con 0x7f27840b4790 2024-04-24T23:59:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.127+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27840cdaf0 con 0x7f27840b4790 2024-04-24T23:59:01.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.128+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27840755d0 con 0x7f27840b4790 2024-04-24T23:59:01.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.129+0000 7f2780c00640 1 -- 172.21.15.96:0/276272032 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f277403d450 con 0x7f27840b4790 2024-04-24T23:59:01.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.130+0000 7f2780c00640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f276006be60 0x7f276006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.131+0000 7f2780c00640 1 -- 172.21.15.96:0/276272032 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f27740abb20 con 0x7f27840b4790 2024-04-24T23:59:01.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.131+0000 7f2783e00640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f276006be60 0x7f276006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.132+0000 7f2783e00640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f276006be60 0x7f276006e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f278413df20 tx=0x7f276c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:01.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.135+0000 7f2780c00640 1 -- 172.21.15.96:0/276272032 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f277404b020 con 0x7f27840b4790 2024-04-24T23:59:01.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.333+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2784165bc0 con 0x7f27840b4790 2024-04-24T23:59:01.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.334+0000 7f2780c00640 1 -- 172.21.15.96:0/276272032 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f2774079cc0 con 0x7f27840b4790 2024-04-24T23:59:01.334 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:59:01.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f276006be60 msgr2=0x7f276006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f276006be60 0x7f276006e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f278413df20 tx=0x7f276c009040 comp rx=0 tx=0).stop 2024-04-24T23:59:01.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27840b4790 msgr2=0x7f278415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27840b4790 0x7f278415a4a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2774034040 tx=0x7f2774004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 shutdown_connections 2024-04-24T23:59:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f278415f160 0x7f2784132c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27841446c0 0x7f278415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f276006be60 0x7f276006e320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 --2- 172.21.15.96:0/276272032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27840b4790 0x7f278415a4a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 >> 172.21.15.96:0/276272032 conn(0x7f27840b18b0 msgr2=0x7f27840b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 shutdown_connections 2024-04-24T23:59:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.337+0000 7f278a400640 1 -- 172.21.15.96:0/276272032 wait complete. 2024-04-24T23:59:01.356 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:59:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.555+0000 7fadb4c00640 1 Processor -- start 2024-04-24T23:59:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.555+0000 7fadb4c00640 1 -- start start 2024-04-24T23:59:01.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.557+0000 7fadb4c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fadb00af120 0x7fadb0071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.557+0000 7fadb4c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fadb00acda0 0x7fadb006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.557+0000 7fadb4c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb0160b20 con 0x7fadb015c230 2024-04-24T23:59:01.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.557+0000 7fadb4c00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fadb015c610 con 0x7fadb00acda0 2024-04-24T23:59:01.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.557+0000 7fadb4c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fadb015fd60 con 0x7fadb00af120 2024-04-24T23:59:01.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.557+0000 7fadae800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fadb00acda0 0x7fadb006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.557+0000 7fadae800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fadb00acda0 0x7fadb006cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58306/0 (socket says 172.21.15.96:58306) 2024-04-24T23:59:01.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.557+0000 7fadae800640 1 -- 172.21.15.96:0/1048767192 learned_addr learned my addr 172.21.15.96:0/1048767192 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:01.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.557+0000 7fadad400640 1 --2- 172.21.15.96:0/1048767192 >> v2:172.21.15.155:3300/0 conn(0x7fadb00af120 0x7fadb0071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.558+0000 7fadae800640 1 -- 172.21.15.96:0/1048767192 >> v2:172.21.15.155:3300/0 conn(0x7fadb00af120 msgr2=0x7fadb0071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:01.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.558+0000 7fadae800640 1 --2- 172.21.15.96:0/1048767192 >> v2:172.21.15.155:3300/0 conn(0x7fadb00af120 0x7fadb0071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.558+0000 7fadae800640 1 -- 172.21.15.96:0/1048767192 >> v1:172.21.15.155:6789/0 conn(0x7fadb015c230 legacy=0x7fadb00aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:01.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.558+0000 7fadae800640 1 -- 172.21.15.96:0/1048767192 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb0160040 con 0x7fadb00acda0 2024-04-24T23:59:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.559+0000 7fadae800640 1 --2- 172.21.15.96:0/1048767192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 0x7fadb006cb70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadb0073640 tx=0x7fada802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403780c5f6f1920e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.559+0000 7fadaca00640 1 -- 172.21.15.96:0/1048767192 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8036070 con 0x7fadb00acda0 2024-04-24T23:59:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.559+0000 7fadaca00640 1 -- 172.21.15.96:0/1048767192 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada8031600 con 0x7fadb00acda0 2024-04-24T23:59:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.559+0000 7fadaca00640 1 -- 172.21.15.96:0/1048767192 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada80319d0 con 0x7fadb00acda0 2024-04-24T23:59:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.560+0000 7fadb4c00640 1 -- 172.21.15.96:0/1048767192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 msgr2=0x7fadb006cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.560+0000 7fadb4c00640 1 --2- 172.21.15.96:0/1048767192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 0x7fadb006cb70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadb0073640 tx=0x7fada802a6f0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.560+0000 7fadb4c00640 1 -- 172.21.15.96:0/1048767192 shutdown_connections 2024-04-24T23:59:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.560+0000 7fadb4c00640 1 --2- 172.21.15.96:0/1048767192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 0x7fadb006cb70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.560+0000 7fadb4c00640 1 --2- 172.21.15.96:0/1048767192 >> v2:172.21.15.155:3300/0 conn(0x7fadb00af120 0x7fadb0071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.560+0000 7fadb4c00640 1 -- 172.21.15.96:0/1048767192 >> 172.21.15.96:0/1048767192 conn(0x7fadb00b19c0 msgr2=0x7fadb00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.560+0000 7fadb4c00640 1 -- 172.21.15.96:0/1048767192 shutdown_connections 2024-04-24T23:59:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.560+0000 7fadb4c00640 1 -- 172.21.15.96:0/1048767192 wait complete. 2024-04-24T23:59:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.562+0000 7fadb4c00640 1 Processor -- start 2024-04-24T23:59:01.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.562+0000 7fadb4c00640 1 -- start start 2024-04-24T23:59:01.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadb4c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 0x7fadb009c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadb4c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadb00af120 0x7fadb0153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadb4c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadb015c230 0x7fadb015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadb4c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fadb00ad1f0 con 0x7fadb00acda0 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadb4c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fadb0160600 con 0x7fadb015c230 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadb4c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fadb00ad4d0 con 0x7fadb00af120 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadade00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 0x7fadb009c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadade00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 0x7fadb009c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58308/0 (socket says 172.21.15.96:58308) 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadade00640 1 -- 172.21.15.96:0/1566595817 learned_addr learned my addr 172.21.15.96:0/1566595817 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadade00640 1 -- 172.21.15.96:0/1566595817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadb00af120 msgr2=0x7fadb0153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadade00640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadb00af120 0x7fadb0153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadade00640 1 -- 172.21.15.96:0/1566595817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadb015c230 msgr2=0x7fadb015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadae800640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadb015c230 0x7fadb015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadade00640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadb015c230 0x7fadb015ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.563+0000 7fadade00640 1 -- 172.21.15.96:0/1566595817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb009cd70 con 0x7fadb00acda0 2024-04-24T23:59:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.564+0000 7fadade00640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 0x7fadb009c830 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fada000b420 tx=0x7fada000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.564+0000 7fada6000640 1 -- 172.21.15.96:0/1566595817 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0011830 con 0x7fadb00acda0 2024-04-24T23:59:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.564+0000 7fada6000640 1 -- 172.21.15.96:0/1566595817 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada0016070 con 0x7fadb00acda0 2024-04-24T23:59:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.564+0000 7fada6000640 1 -- 172.21.15.96:0/1566595817 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0011c10 con 0x7fadb00acda0 2024-04-24T23:59:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.564+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb0153f60 con 0x7fadb00acda0 2024-04-24T23:59:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.564+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb009ba70 con 0x7fadb00acda0 2024-04-24T23:59:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.565+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb0069110 con 0x7fadb00acda0 2024-04-24T23:59:01.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.566+0000 7fada6000640 1 -- 172.21.15.96:0/1566595817 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fada001b460 con 0x7fadb00acda0 2024-04-24T23:59:01.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.568+0000 7fada6000640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9006be30 0x7fad9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:01.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.568+0000 7fada6000640 1 -- 172.21.15.96:0/1566595817 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fada008a990 con 0x7fadb00acda0 2024-04-24T23:59:01.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.568+0000 7fadad400640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9006be30 0x7fad9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:01.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.568+0000 7fadad400640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9006be30 0x7fad9006e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fadb006dec0 tx=0x7fad9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:01.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.572+0000 7fada6000640 1 -- 172.21.15.96:0/1566595817 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fada0020020 con 0x7fadb00acda0 2024-04-24T23:59:01.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.813+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadb0074f60 con 0x7fadb00acda0 2024-04-24T23:59:01.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.815+0000 7fada6000640 1 -- 172.21.15.96:0/1566595817 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5178 (secure 0 0 0) 0x7fada008a020 con 0x7fadb00acda0 2024-04-24T23:59:01.815 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:01.815 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1694444006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1694444006},{"type":"v1","addr":"172.21.15.96:6837","nonce":1694444006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3646872561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6833","nonce":3646872561},{"type":"v1","addr":"172.21.15.155:6835","nonce":3646872561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/227257747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":227257747},{"type":"v1","addr":"172.21.15.96:6836","nonce":227257747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:58:05.205304+0000","modified":"2024-04-24T23:58:08.502172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6834/1986626476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1986626476},{"type":"v1","addr":"172.21.15.155:6834","nonce":1986626476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-24T23:59:01.815 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-04-24T23:59:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.817+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9006be30 msgr2=0x7fad9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.817+0000 7fadb4c00640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9006be30 0x7fad9006e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fadb006dec0 tx=0x7fad9c008040 comp rx=0 tx=0).stop 2024-04-24T23:59:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.817+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 msgr2=0x7fadb009c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.817+0000 7fadb4c00640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 0x7fadb009c830 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fada000b420 tx=0x7fada000b8e0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.818+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 shutdown_connections 2024-04-24T23:59:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.818+0000 7fadb4c00640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadb015c230 0x7fadb015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.818+0000 7fadb4c00640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadb00af120 0x7fadb0153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.818+0000 7fadb4c00640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fad9006be30 0x7fad9006e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.818+0000 7fadb4c00640 1 --2- 172.21.15.96:0/1566595817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00acda0 0x7fadb009c830 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:01.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.818+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 >> 172.21.15.96:0/1566595817 conn(0x7fadb00b19c0 msgr2=0x7fadb00cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:01.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.818+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 shutdown_connections 2024-04-24T23:59:01.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:01.818+0000 7fadb4c00640 1 -- 172.21.15.96:0/1566595817 wait complete. 2024-04-24T23:59:01.839 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:02.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.041+0000 7f45bee00640 1 Processor -- start 2024-04-24T23:59:02.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.041+0000 7f45bee00640 1 -- start start 2024-04-24T23:59:02.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.042+0000 7f45bee00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80b4ec0 0x7f45b80cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.042+0000 7f45bee00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45b80ccc20 0x7f45b8070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.042+0000 7f45bee00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b815fa90 con 0x7f45b815f6b0 2024-04-24T23:59:02.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.042+0000 7f45bee00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f45b80b4a30 con 0x7f45b80ccc20 2024-04-24T23:59:02.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.042+0000 7f45bee00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f45b80b3e20 con 0x7f45b80b4ec0 2024-04-24T23:59:02.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.043+0000 7f45bda00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f45b815f6b0 0x7f45b80ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:60936/0 (socket says 172.21.15.96:60936) 2024-04-24T23:59:02.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.043+0000 7f45bda00640 1 -- 172.21.15.96:0/560747882 learned_addr learned my addr 172.21.15.96:0/560747882 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:02.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.043+0000 7f45bd000640 1 --2- 172.21.15.96:0/560747882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80b4ec0 0x7f45b80cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.043+0000 7f45be400640 1 --2- 172.21.15.96:0/560747882 >> v2:172.21.15.155:3300/0 conn(0x7f45b80ccc20 0x7f45b8070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.044+0000 7f45b7e00640 1 -- 172.21.15.96:0/560747882 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543260477 0 0) 0x7f45b815fa90 con 0x7f45b815f6b0 2024-04-24T23:59:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.044+0000 7f45b7e00640 1 -- 172.21.15.96:0/560747882 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a0003520 con 0x7f45b815f6b0 2024-04-24T23:59:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.044+0000 7f45bd000640 1 -- 172.21.15.96:0/560747882 >> v2:172.21.15.155:3300/0 conn(0x7f45b80ccc20 msgr2=0x7f45b8070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.044+0000 7f45bd000640 1 --2- 172.21.15.96:0/560747882 >> v2:172.21.15.155:3300/0 conn(0x7f45b80ccc20 0x7f45b8070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.044+0000 7f45bd000640 1 -- 172.21.15.96:0/560747882 >> v1:172.21.15.155:6789/0 conn(0x7f45b815f6b0 legacy=0x7f45b80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.044+0000 7f45bd000640 1 -- 172.21.15.96:0/560747882 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b80b4100 con 0x7f45b80b4ec0 2024-04-24T23:59:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.046+0000 7f45bd000640 1 --2- 172.21.15.96:0/560747882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80b4ec0 0x7f45b80cc6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45a40097a0 tx=0x7f45a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd23ca339cd4304c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.046+0000 7f45b7e00640 1 -- 172.21.15.96:0/560747882 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4037070 con 0x7f45b80b4ec0 2024-04-24T23:59:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.046+0000 7f45b7e00640 1 -- 172.21.15.96:0/560747882 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a4032440 con 0x7f45b80b4ec0 2024-04-24T23:59:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.046+0000 7f45b7e00640 1 -- 172.21.15.96:0/560747882 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4032810 con 0x7f45b80b4ec0 2024-04-24T23:59:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.047+0000 7f45bee00640 1 -- 172.21.15.96:0/560747882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80b4ec0 msgr2=0x7f45b80cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.047+0000 7f45bee00640 1 --2- 172.21.15.96:0/560747882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80b4ec0 0x7f45b80cc6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45a40097a0 tx=0x7f45a402a180 comp rx=0 tx=0).stop 2024-04-24T23:59:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.047+0000 7f45bee00640 1 -- 172.21.15.96:0/560747882 shutdown_connections 2024-04-24T23:59:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.047+0000 7f45bee00640 1 --2- 172.21.15.96:0/560747882 >> v2:172.21.15.155:3300/0 conn(0x7f45b80ccc20 0x7f45b8070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.047+0000 7f45bee00640 1 --2- 172.21.15.96:0/560747882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80b4ec0 0x7f45b80cc6e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.047+0000 7f45bee00640 1 -- 172.21.15.96:0/560747882 >> 172.21.15.96:0/560747882 conn(0x7f45b80b1f10 msgr2=0x7f45b80cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.047+0000 7f45bee00640 1 -- 172.21.15.96:0/560747882 shutdown_connections 2024-04-24T23:59:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.047+0000 7f45bee00640 1 -- 172.21.15.96:0/560747882 wait complete. 2024-04-24T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.049+0000 7f45bee00640 1 Processor -- start 2024-04-24T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.049+0000 7f45bee00640 1 -- start start 2024-04-24T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45bee00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b80b4ec0 0x7f45b806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45bee00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ccc20 0x7f45b80c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45bee00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45b815f6b0 0x7f45b80ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45bee00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80cf1c0 con 0x7f45b815f6b0 2024-04-24T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45bee00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80b46c0 con 0x7f45b80b4ec0 2024-04-24T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45bee00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f45b80b3a40 con 0x7f45b80ccc20 2024-04-24T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45be400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45b815f6b0 0x7f45b80ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45be400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45b815f6b0 0x7f45b80ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58320/0 (socket says 172.21.15.96:58320) 2024-04-24T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45be400640 1 -- 172.21.15.96:0/1106298845 learned_addr learned my addr 172.21.15.96:0/1106298845 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.050+0000 7f45bda00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b80b4ec0 0x7f45b806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45be400640 1 -- 172.21.15.96:0/1106298845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ccc20 msgr2=0x7f45b80c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45bd000640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ccc20 0x7f45b80c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45be400640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ccc20 0x7f45b80c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45be400640 1 -- 172.21.15.96:0/1106298845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b80b4ec0 msgr2=0x7f45b806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45be400640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b80b4ec0 0x7f45b806cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45be400640 1 -- 172.21.15.96:0/1106298845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b80c9eb0 con 0x7f45b815f6b0 2024-04-24T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45bda00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b80b4ec0 0x7f45b806cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45be400640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45b815f6b0 0x7f45b80ce320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009e30 tx=0x7f45b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45b5600640 1 -- 172.21.15.96:0/1106298845 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0018020 con 0x7f45b815f6b0 2024-04-24T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45b5600640 1 -- 172.21.15.96:0/1106298845 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b0014480 con 0x7f45b815f6b0 2024-04-24T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b806d0c0 con 0x7f45b815f6b0 2024-04-24T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.051+0000 7f45b5600640 1 -- 172.21.15.96:0/1106298845 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0014870 con 0x7f45b815f6b0 2024-04-24T23:59:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.052+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b806d680 con 0x7f45b815f6b0 2024-04-24T23:59:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.053+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b80756b0 con 0x7f45b815f6b0 2024-04-24T23:59:02.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.053+0000 7f45b5600640 1 -- 172.21.15.96:0/1106298845 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45b0005d10 con 0x7f45b815f6b0 2024-04-24T23:59:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.054+0000 7f45b5600640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f459806be30 0x7f459806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.054+0000 7f45b5600640 1 -- 172.21.15.96:0/1106298845 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f45b008bdf0 con 0x7f45b815f6b0 2024-04-24T23:59:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.055+0000 7f45bda00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f459806be30 0x7f459806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.055+0000 7f45bda00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f459806be30 0x7f459806e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0011e0 tx=0x7f45ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.059+0000 7f45b5600640 1 -- 172.21.15.96:0/1106298845 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f45b0022030 con 0x7f45b815f6b0 2024-04-24T23:59:02.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.257+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45b80ca450 con 0x7f45b815f6b0 2024-04-24T23:59:02.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.260+0000 7f45b5600640 1 -- 172.21.15.96:0/1106298845 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16851 (secure 0 0 0) 0x7f45b80c9eb0 con 0x7f45b815f6b0 2024-04-24T23:59:02.260 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:02.260 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:48.255571+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.262+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f459806be30 msgr2=0x7f459806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.262+0000 7f45bee00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f459806be30 0x7f459806e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0011e0 tx=0x7f45ac009040 comp rx=0 tx=0).stop 2024-04-24T23:59:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.262+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45b815f6b0 msgr2=0x7f45b80ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.262+0000 7f45bee00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45b815f6b0 0x7f45b80ce320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009e30 tx=0x7f45b000c490 comp rx=0 tx=0).stop 2024-04-24T23:59:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.263+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 shutdown_connections 2024-04-24T23:59:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.263+0000 7f45bee00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f459806be30 0x7f459806e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.263+0000 7f45bee00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45b815f6b0 0x7f45b80ce320 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.263+0000 7f45bee00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ccc20 0x7f45b80c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.263+0000 7f45bee00640 1 --2- 172.21.15.96:0/1106298845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b80b4ec0 0x7f45b806cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.263+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 >> 172.21.15.96:0/1106298845 conn(0x7f45b80b1f10 msgr2=0x7f45b8071800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:02.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.263+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 shutdown_connections 2024-04-24T23:59:02.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.263+0000 7f45bee00640 1 -- 172.21.15.96:0/1106298845 wait complete. 2024-04-24T23:59:02.282 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:59:02.282 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:59:02.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.481+0000 7f66d1c00640 1 Processor -- start 2024-04-24T23:59:02.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.481+0000 7f66d1c00640 1 -- start start 2024-04-24T23:59:02.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.483+0000 7f66d1c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66cc15e480 0x7f66cc0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.483+0000 7f66d1c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f66cc0b2be0 0x7f66cc072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.483+0000 7f66d1c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f66cc0cc6e0 0x7f66cc0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.483+0000 7f66d1c00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f66cc073060 con 0x7f66cc0cc6e0 2024-04-24T23:59:02.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.483+0000 7f66d1c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f66cc06cc10 con 0x7f66cc0b2be0 2024-04-24T23:59:02.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.483+0000 7f66d1c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f66cc06cef0 con 0x7f66cc15e480 2024-04-24T23:59:02.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.483+0000 7f66d1200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f66cc0cc6e0 0x7f66cc0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.483+0000 7f66d1200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f66cc0cc6e0 0x7f66cc0ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58334/0 (socket says 172.21.15.96:58334) 2024-04-24T23:59:02.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.483+0000 7f66d1200640 1 -- 172.21.15.96:0/4212048353 learned_addr learned my addr 172.21.15.96:0/4212048353 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:02.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.484+0000 7f66cb400640 1 --2- 172.21.15.96:0/4212048353 >> v2:172.21.15.155:3300/0 conn(0x7f66cc0b2be0 0x7f66cc072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.484+0000 7f66cbe00640 1 --2- 172.21.15.96:0/4212048353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66cc15e480 0x7f66cc0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.484+0000 7f66d1200640 1 -- 172.21.15.96:0/4212048353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66cc15e480 msgr2=0x7f66cc0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:02.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.484+0000 7f66d1200640 1 --2- 172.21.15.96:0/4212048353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66cc15e480 0x7f66cc0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.484+0000 7f66d1200640 1 -- 172.21.15.96:0/4212048353 >> v2:172.21.15.155:3300/0 conn(0x7f66cc0b2be0 msgr2=0x7f66cc072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:02.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.484+0000 7f66d1200640 1 --2- 172.21.15.96:0/4212048353 >> v2:172.21.15.155:3300/0 conn(0x7f66cc0b2be0 0x7f66cc072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.484+0000 7f66d1200640 1 -- 172.21.15.96:0/4212048353 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc06d1d0 con 0x7f66cc0cc6e0 2024-04-24T23:59:02.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.485+0000 7f66d1200640 1 --2- 172.21.15.96:0/4212048353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc0cc6e0 0x7f66cc0ccb70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f66cc06f270 tx=0x7f66c402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5a94719628d36 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:02.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.485+0000 7f66caa00640 1 -- 172.21.15.96:0/4212048353 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4036070 con 0x7f66cc0cc6e0 2024-04-24T23:59:02.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66caa00640 1 -- 172.21.15.96:0/4212048353 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c4031600 con 0x7f66cc0cc6e0 2024-04-24T23:59:02.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66caa00640 1 -- 172.21.15.96:0/4212048353 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c40319d0 con 0x7f66cc0cc6e0 2024-04-24T23:59:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66d1c00640 1 -- 172.21.15.96:0/4212048353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc0cc6e0 msgr2=0x7f66cc0ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66d1c00640 1 --2- 172.21.15.96:0/4212048353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc0cc6e0 0x7f66cc0ccb70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f66cc06f270 tx=0x7f66c402a610 comp rx=0 tx=0).stop 2024-04-24T23:59:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66d1c00640 1 -- 172.21.15.96:0/4212048353 shutdown_connections 2024-04-24T23:59:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66d1c00640 1 --2- 172.21.15.96:0/4212048353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc0cc6e0 0x7f66cc0ccb70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66d1c00640 1 --2- 172.21.15.96:0/4212048353 >> v2:172.21.15.155:3300/0 conn(0x7f66cc0b2be0 0x7f66cc072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66d1c00640 1 --2- 172.21.15.96:0/4212048353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66cc15e480 0x7f66cc0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66d1c00640 1 -- 172.21.15.96:0/4212048353 >> 172.21.15.96:0/4212048353 conn(0x7f66cc0b1f10 msgr2=0x7f66cc0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66d1c00640 1 -- 172.21.15.96:0/4212048353 shutdown_connections 2024-04-24T23:59:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.486+0000 7f66d1c00640 1 -- 172.21.15.96:0/4212048353 wait complete. 2024-04-24T23:59:02.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.488+0000 7f66d1c00640 1 Processor -- start 2024-04-24T23:59:02.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.488+0000 7f66d1c00640 1 -- start start 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.489+0000 7f66d1c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66cc0b2be0 0x7f66cc160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.489+0000 7f66d1c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66cc0cc6e0 0x7f66cc0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.489+0000 7f66d1c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc15e480 0x7f66cc0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.489+0000 7f66d1c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc06d9d0 con 0x7f66cc15e480 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.489+0000 7f66d1c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc072d50 con 0x7f66cc0cc6e0 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.489+0000 7f66d1c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f66cc06db50 con 0x7f66cc0b2be0 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66d1200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc15e480 0x7f66cc0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66d1200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc15e480 0x7f66cc0cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58338/0 (socket says 172.21.15.96:58338) 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66d1200640 1 -- 172.21.15.96:0/1723055375 learned_addr learned my addr 172.21.15.96:0/1723055375 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66d1200640 1 -- 172.21.15.96:0/1723055375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66cc0b2be0 msgr2=0x7f66cc160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66d1200640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66cc0b2be0 0x7f66cc160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66cb400640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66cc0cc6e0 0x7f66cc0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66d1200640 1 -- 172.21.15.96:0/1723055375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66cc0cc6e0 msgr2=0x7f66cc0cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66d1200640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66cc0cc6e0 0x7f66cc0cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66d1200640 1 -- 172.21.15.96:0/1723055375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc161190 con 0x7f66cc15e480 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.490+0000 7f66d1200640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc15e480 0x7f66cc0cbab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f66c4034040 tx=0x7f66c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.491+0000 7f66c3e00640 1 -- 172.21.15.96:0/1723055375 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4041020 con 0x7f66cc15e480 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.491+0000 7f66c3e00640 1 -- 172.21.15.96:0/1723055375 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c40077a0 con 0x7f66cc15e480 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.491+0000 7f66c3e00640 1 -- 172.21.15.96:0/1723055375 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4036040 con 0x7f66cc15e480 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.491+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66cc15f590 con 0x7f66cc15e480 2024-04-24T23:59:02.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.491+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66cc15fb50 con 0x7f66cc15e480 2024-04-24T23:59:02.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.492+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66cc067e40 con 0x7f66cc15e480 2024-04-24T23:59:02.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.493+0000 7f66c3e00640 1 -- 172.21.15.96:0/1723055375 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66c4044020 con 0x7f66cc15e480 2024-04-24T23:59:02.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.494+0000 7f66c3e00640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f66ac06be30 0x7f66ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.495+0000 7f66c3e00640 1 -- 172.21.15.96:0/1723055375 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f66c40abbf0 con 0x7f66cc15e480 2024-04-24T23:59:02.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.495+0000 7f66cbe00640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f66ac06be30 0x7f66ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.495+0000 7f66cbe00640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f66ac06be30 0x7f66ac06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f66bc006fd0 tx=0x7f66bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:02.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.499+0000 7f66c3e00640 1 -- 172.21.15.96:0/1723055375 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f66c404b030 con 0x7f66cc15e480 2024-04-24T23:59:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.732+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66cc0756b0 con 0x7f66cc15e480 2024-04-24T23:59:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.733+0000 7f66c3e00640 1 -- 172.21.15.96:0/1723055375 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5178 (secure 0 0 0) 0x7f66cc161190 con 0x7f66cc15e480 2024-04-24T23:59:02.733 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:02.734 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1694444006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1694444006},{"type":"v1","addr":"172.21.15.96:6837","nonce":1694444006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3646872561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6833","nonce":3646872561},{"type":"v1","addr":"172.21.15.155:6835","nonce":3646872561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/227257747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":227257747},{"type":"v1","addr":"172.21.15.96:6836","nonce":227257747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:58:05.205304+0000","modified":"2024-04-24T23:58:08.502172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6834/1986626476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1986626476},{"type":"v1","addr":"172.21.15.155:6834","nonce":1986626476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-24T23:59:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-04-24T23:59:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f66ac06be30 msgr2=0x7f66ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f66ac06be30 0x7f66ac06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f66bc006fd0 tx=0x7f66bc008040 comp rx=0 tx=0).stop 2024-04-24T23:59:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc15e480 msgr2=0x7f66cc0cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc15e480 0x7f66cc0cbab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f66c4034040 tx=0x7f66c4004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 shutdown_connections 2024-04-24T23:59:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f66ac06be30 0x7f66ac06e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66cc15e480 0x7f66cc0cbab0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66cc0cc6e0 0x7f66cc0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 --2- 172.21.15.96:0/1723055375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66cc0b2be0 0x7f66cc160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 >> 172.21.15.96:0/1723055375 conn(0x7f66cc0b1f10 msgr2=0x7f66cc06df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 shutdown_connections 2024-04-24T23:59:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.736+0000 7f66d1c00640 1 -- 172.21.15.96:0/1723055375 wait complete. 2024-04-24T23:59:02.755 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:59:02.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.953+0000 7fd379600640 1 Processor -- start 2024-04-24T23:59:02.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.953+0000 7fd379600640 1 -- start start 2024-04-24T23:59:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.955+0000 7fd379600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd37415cbf0 0x7fd37406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.955+0000 7fd379600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd374071500 0x7fd37416c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.955+0000 7fd379600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3740b4fe0 con 0x7fd37406d0b0 2024-04-24T23:59:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.955+0000 7fd379600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd37406d5c0 con 0x7fd37415cbf0 2024-04-24T23:59:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.955+0000 7fd379600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd37406d8a0 con 0x7fd374071500 2024-04-24T23:59:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.956+0000 7fd372a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd37415cbf0 0x7fd37406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.956+0000 7fd372a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd37415cbf0 0x7fd37406cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58346/0 (socket says 172.21.15.96:58346) 2024-04-24T23:59:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.956+0000 7fd372a00640 1 -- 172.21.15.96:0/3141320143 learned_addr learned my addr 172.21.15.96:0/3141320143 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.956+0000 7fd373400640 1 --2- 172.21.15.96:0/3141320143 >> v2:172.21.15.155:3300/0 conn(0x7fd374071500 0x7fd37416c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.956+0000 7fd372a00640 1 -- 172.21.15.96:0/3141320143 >> v2:172.21.15.155:3300/0 conn(0x7fd374071500 msgr2=0x7fd37416c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.956+0000 7fd372a00640 1 --2- 172.21.15.96:0/3141320143 >> v2:172.21.15.155:3300/0 conn(0x7fd374071500 0x7fd37416c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.956+0000 7fd372a00640 1 -- 172.21.15.96:0/3141320143 >> v1:172.21.15.155:6789/0 conn(0x7fd37406d0b0 legacy=0x7fd374070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.956+0000 7fd372a00640 1 -- 172.21.15.96:0/3141320143 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37406db80 con 0x7fd37415cbf0 2024-04-24T23:59:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.958+0000 7fd372a00640 1 --2- 172.21.15.96:0/3141320143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 0x7fd37406cb70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd37406bfb0 tx=0x7fd36402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bac6637f825fb4a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.958+0000 7fd372000640 1 -- 172.21.15.96:0/3141320143 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd364036070 con 0x7fd37415cbf0 2024-04-24T23:59:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.958+0000 7fd372000640 1 -- 172.21.15.96:0/3141320143 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd364031600 con 0x7fd37415cbf0 2024-04-24T23:59:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.958+0000 7fd372000640 1 -- 172.21.15.96:0/3141320143 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3640319d0 con 0x7fd37415cbf0 2024-04-24T23:59:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.959+0000 7fd379600640 1 -- 172.21.15.96:0/3141320143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 msgr2=0x7fd37406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.959+0000 7fd379600640 1 --2- 172.21.15.96:0/3141320143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 0x7fd37406cb70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd37406bfb0 tx=0x7fd36402a6f0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.959+0000 7fd379600640 1 -- 172.21.15.96:0/3141320143 shutdown_connections 2024-04-24T23:59:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.959+0000 7fd379600640 1 --2- 172.21.15.96:0/3141320143 >> v2:172.21.15.155:3300/0 conn(0x7fd374071500 0x7fd37416c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.959+0000 7fd379600640 1 --2- 172.21.15.96:0/3141320143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 0x7fd37406cb70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.959+0000 7fd379600640 1 -- 172.21.15.96:0/3141320143 >> 172.21.15.96:0/3141320143 conn(0x7fd3740b19c0 msgr2=0x7fd3740b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.959+0000 7fd379600640 1 -- 172.21.15.96:0/3141320143 shutdown_connections 2024-04-24T23:59:02.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.959+0000 7fd379600640 1 -- 172.21.15.96:0/3141320143 wait complete. 2024-04-24T23:59:02.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.961+0000 7fd379600640 1 Processor -- start 2024-04-24T23:59:02.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.961+0000 7fd379600640 1 -- start start 2024-04-24T23:59:02.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd379600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37406d0b0 0x7fd3741ee200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd379600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd374071500 0x7fd374147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd379600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 0x7fd374146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd379600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd37415cfd0 con 0x7fd37415cbf0 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd379600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd37406e660 con 0x7fd37406d0b0 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd379600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd374162e30 con 0x7fd374071500 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd373400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 0x7fd374146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd373400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 0x7fd374146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58350/0 (socket says 172.21.15.96:58350) 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd373400640 1 -- 172.21.15.96:0/3226480118 learned_addr learned my addr 172.21.15.96:0/3226480118 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd372a00640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37406d0b0 0x7fd3741ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd373400640 1 -- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd374071500 msgr2=0x7fd374147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd36a000640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd374071500 0x7fd374147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd373400640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd374071500 0x7fd374147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd373400640 1 -- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37406d0b0 msgr2=0x7fd3741ee200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd373400640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37406d0b0 0x7fd3741ee200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.962+0000 7fd373400640 1 -- 172.21.15.96:0/3226480118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd374146fd0 con 0x7fd37415cbf0 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.963+0000 7fd372a00640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37406d0b0 0x7fd3741ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.963+0000 7fd36a000640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd374071500 0x7fd374147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.963+0000 7fd373400640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 0x7fd374146a90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00d5b0 tx=0x7fd36c00da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.963+0000 7fd36b400640 1 -- 172.21.15.96:0/3226480118 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0125f0 con 0x7fd37415cbf0 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.963+0000 7fd36b400640 1 -- 172.21.15.96:0/3226480118 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c019070 con 0x7fd37415cbf0 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.963+0000 7fd36b400640 1 -- 172.21.15.96:0/3226480118 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0129f0 con 0x7fd37415cbf0 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.963+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd374147a70 con 0x7fd37415cbf0 2024-04-24T23:59:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.963+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd374148030 con 0x7fd37415cbf0 2024-04-24T23:59:02.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.964+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd374069110 con 0x7fd37415cbf0 2024-04-24T23:59:02.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.966+0000 7fd36b400640 1 -- 172.21.15.96:0/3226480118 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd36c012b90 con 0x7fd37415cbf0 2024-04-24T23:59:02.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.966+0000 7fd36b400640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd35006be30 0x7fd35006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:02.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.967+0000 7fd36b400640 1 -- 172.21.15.96:0/3226480118 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fd36c08b2d0 con 0x7fd37415cbf0 2024-04-24T23:59:02.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.967+0000 7fd372a00640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd35006be30 0x7fd35006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:02.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.967+0000 7fd372a00640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd35006be30 0x7fd35006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd364033000 tx=0x7fd364009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:02.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:02.971+0000 7fd36b400640 1 -- 172.21.15.96:0/3226480118 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd36c059bf0 con 0x7fd37415cbf0 2024-04-24T23:59:03.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.209+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd37406e8d0 con 0x7fd37415cbf0 2024-04-24T23:59:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.210+0000 7fd36b400640 1 -- 172.21.15.96:0/3226480118 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5178 (secure 0 0 0) 0x7fd36c0594f0 con 0x7fd37415cbf0 2024-04-24T23:59:03.211 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:03.211 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1694444006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1694444006},{"type":"v1","addr":"172.21.15.96:6837","nonce":1694444006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3646872561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6833","nonce":3646872561},{"type":"v1","addr":"172.21.15.155:6835","nonce":3646872561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/227257747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":227257747},{"type":"v1","addr":"172.21.15.96:6836","nonce":227257747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:58:05.205304+0000","modified":"2024-04-24T23:58:08.502172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6834/1986626476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1986626476},{"type":"v1","addr":"172.21.15.155:6834","nonce":1986626476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-04-24T23:59:03.211 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd35006be30 msgr2=0x7fd35006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd35006be30 0x7fd35006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd364033000 tx=0x7fd364009000 comp rx=0 tx=0).stop 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 msgr2=0x7fd374146a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 0x7fd374146a90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00d5b0 tx=0x7fd36c00da70 comp rx=0 tx=0).stop 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 shutdown_connections 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd35006be30 0x7fd35006e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37415cbf0 0x7fd374146a90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd374071500 0x7fd374147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 --2- 172.21.15.96:0/3226480118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37406d0b0 0x7fd3741ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 >> 172.21.15.96:0/3226480118 conn(0x7fd3740b19c0 msgr2=0x7fd3740b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 shutdown_connections 2024-04-24T23:59:03.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.213+0000 7fd379600640 1 -- 172.21.15.96:0/3226480118 wait complete. 2024-04-24T23:59:03.232 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:03.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.423+0000 7fbbd2200640 1 Processor -- start 2024-04-24T23:59:03.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.423+0000 7fbbd2200640 1 -- start start 2024-04-24T23:59:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.425+0000 7fbbd2200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc071470 0x7fbbcc15b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.425+0000 7fbbd2200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbcc0ce100 con 0x7fbbcc0cdbd0 2024-04-24T23:59:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.425+0000 7fbbd2200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbcc0ce3e0 con 0x7fbbcc1553f0 2024-04-24T23:59:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.425+0000 7fbbd2200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbbcc0ce6c0 con 0x7fbbcc071470 2024-04-24T23:59:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.425+0000 7fbbd1800640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbbcc0cdbd0 0x7fbbcc06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59680/0 (socket says 172.21.15.96:59680) 2024-04-24T23:59:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.425+0000 7fbbd1800640 1 -- 172.21.15.96:0/394691836 learned_addr learned my addr 172.21.15.96:0/394691836 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:03.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcbe00640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc071470 0x7fbbcc15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3198752947 0 0) 0x7fbbcc0ce100 con 0x7fbbcc0cdbd0 2024-04-24T23:59:03.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb4003520 con 0x7fbbcc0cdbd0 2024-04-24T23:59:03.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1541392012 0 0) 0x7fbbb4003520 con 0x7fbbcc0cdbd0 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc071470 msgr2=0x7fbbcc15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc071470 0x7fbbcc15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 >> v1:172.21.15.155:6789/0 conn(0x7fbbcc1553f0 legacy=0x7fbbcc070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbcc0ce9a0 con 0x7fbbcc0cdbd0 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fbbc4001a10 con 0x7fbbcc0cdbd0 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcbe00640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc071470 0x7fbbcc15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 >> v1:172.21.15.96:6789/0 conn(0x7fbbcc0cdbd0 legacy=0x7fbbcc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb40039e0 0x7fbbb4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc071470 0x7fbbb4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb4004d40 0x7fbbb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc0ce6c0 con 0x7fbbb4004d40 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb400bad0 con 0x7fbbb40039e0 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.426+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb400bcd0 con 0x7fbbcc071470 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.427+0000 7fbbd1800640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb4004d40 0x7fbbb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.427+0000 7fbbd0e00640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb40039e0 0x7fbbb4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.427+0000 7fbbd1800640 1 -- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc071470 msgr2=0x7fbbb4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:03.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.427+0000 7fbbd1800640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc071470 0x7fbbb4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.427+0000 7fbbd1800640 1 -- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb40039e0 msgr2=0x7fbbb4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:03.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.427+0000 7fbbd1800640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb40039e0 0x7fbbb4003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.427+0000 7fbbd1800640 1 -- 172.21.15.96:0/394691836 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb4003520 con 0x7fbbb4004d40 2024-04-24T23:59:03.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.428+0000 7fbbd1800640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb4004d40 0x7fbbb40051c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0cfca0 tx=0x7fbbb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56761118e8e21b83 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:03.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.428+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400a480 con 0x7fbbb4004d40 2024-04-24T23:59:03.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.428+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc4031070 con 0x7fbbb4004d40 2024-04-24T23:59:03.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.428+0000 7fbbcb400640 1 -- 172.21.15.96:0/394691836 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc402de60 con 0x7fbbb4004d40 2024-04-24T23:59:03.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.429+0000 7fbbd2200640 1 -- 172.21.15.96:0/394691836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb4004d40 msgr2=0x7fbbb40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.429+0000 7fbbd2200640 1 --2- 172.21.15.96:0/394691836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb4004d40 0x7fbbb40051c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0cfca0 tx=0x7fbbb4005830 comp rx=0 tx=0).stop 2024-04-24T23:59:03.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.429+0000 7fbbd1800640 1 -- 172.21.15.96:0/394691836 reap_dead start 2024-04-24T23:59:03.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.429+0000 7fbbd2200640 1 -- 172.21.15.96:0/394691836 shutdown_connections 2024-04-24T23:59:03.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.429+0000 7fbbd2200640 1 -- 172.21.15.96:0/394691836 >> 172.21.15.96:0/394691836 conn(0x7fbbcc0b1f10 msgr2=0x7fbbcc0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:03.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.429+0000 7fbbd2200640 1 -- 172.21.15.96:0/394691836 shutdown_connections 2024-04-24T23:59:03.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.429+0000 7fbbd2200640 1 -- 172.21.15.96:0/394691836 wait complete. 2024-04-24T23:59:03.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.431+0000 7fbbd2200640 1 Processor -- start 2024-04-24T23:59:03.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.431+0000 7fbbd2200640 1 -- start start 2024-04-24T23:59:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.432+0000 7fbbd2200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbcc148c50 0x7fbbcc09b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.432+0000 7fbbd2200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc149030 0x7fbbcc0c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.432+0000 7fbbd2200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbcc0c5650 0x7fbbcc159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.432+0000 7fbbd2200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc155950 con 0x7fbbcc148c50 2024-04-24T23:59:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.432+0000 7fbbd2200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc1557d0 con 0x7fbbcc0c5650 2024-04-24T23:59:03.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.432+0000 7fbbd2200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbbcc15b530 con 0x7fbbcc149030 2024-04-24T23:59:03.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.432+0000 7fbbd0e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbcc148c50 0x7fbbcc09b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.432+0000 7fbbd0e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbcc148c50 0x7fbbcc09b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58370/0 (socket says 172.21.15.96:58370) 2024-04-24T23:59:03.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.432+0000 7fbbd0e00640 1 -- 172.21.15.96:0/2856270736 learned_addr learned my addr 172.21.15.96:0/2856270736 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbd0e00640 1 -- 172.21.15.96:0/2856270736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc149030 msgr2=0x7fbbcc0c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbd0e00640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc149030 0x7fbbcc0c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbd0e00640 1 -- 172.21.15.96:0/2856270736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbcc0c5650 msgr2=0x7fbbcc159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbd0e00640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbcc0c5650 0x7fbbcc159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbd0e00640 1 -- 172.21.15.96:0/2856270736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbcc149610 con 0x7fbbcc148c50 2024-04-24T23:59:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbd0e00640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbcc148c50 0x7fbbcc09b370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000d570 tx=0x7fbbc000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbc8c00640 1 -- 172.21.15.96:0/2856270736 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0005480 con 0x7fbbcc148c50 2024-04-24T23:59:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbc8c00640 1 -- 172.21.15.96:0/2856270736 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc0017070 con 0x7fbbcc148c50 2024-04-24T23:59:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbcc1498f0 con 0x7fbbcc148c50 2024-04-24T23:59:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbc8c00640 1 -- 172.21.15.96:0/2856270736 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0003810 con 0x7fbbcc148c50 2024-04-24T23:59:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.433+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbcc149eb0 con 0x7fbbcc148c50 2024-04-24T23:59:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.434+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbcc0756b0 con 0x7fbbcc148c50 2024-04-24T23:59:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.435+0000 7fbbc8c00640 1 -- 172.21.15.96:0/2856270736 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbc00039b0 con 0x7fbbcc148c50 2024-04-24T23:59:03.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.436+0000 7fbbc8c00640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbbac06be60 0x7fbbac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.436+0000 7fbbc8c00640 1 -- 172.21.15.96:0/2856270736 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fbbc008ad10 con 0x7fbbcc148c50 2024-04-24T23:59:03.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.437+0000 7fbbcbe00640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbbac06be60 0x7fbbac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.437+0000 7fbbcbe00640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbbac06be60 0x7fbbac06e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc09b300 tx=0x7fbbb8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:03.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.441+0000 7fbbc8c00640 1 -- 172.21.15.96:0/2856270736 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbbc0019310 con 0x7fbbcc148c50 2024-04-24T23:59:03.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.642+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbcc0d0930 con 0x7fbbcc148c50 2024-04-24T23:59:03.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.644+0000 7fbbc8c00640 1 -- 172.21.15.96:0/2856270736 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16851 (secure 0 0 0) 0x7fbbc0059630 con 0x7fbbcc148c50 2024-04-24T23:59:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:03.645 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:58:48.255571+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:58:03.426234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:58:04.213419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.647+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbbac06be60 msgr2=0x7fbbac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.647+0000 7fbbd2200640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbbac06be60 0x7fbbac06e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc09b300 tx=0x7fbbb8008040 comp rx=0 tx=0).stop 2024-04-24T23:59:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.647+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbcc148c50 msgr2=0x7fbbcc09b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.647+0000 7fbbd2200640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbcc148c50 0x7fbbcc09b370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000d570 tx=0x7fbbc000da30 comp rx=0 tx=0).stop 2024-04-24T23:59:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.648+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 shutdown_connections 2024-04-24T23:59:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.648+0000 7fbbd2200640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbcc0c5650 0x7fbbcc159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.648+0000 7fbbd2200640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbcc149030 0x7fbbcc0c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.648+0000 7fbbd2200640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbbac06be60 0x7fbbac06e320 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.648+0000 7fbbd2200640 1 --2- 172.21.15.96:0/2856270736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbcc148c50 0x7fbbcc09b370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.648+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 >> 172.21.15.96:0/2856270736 conn(0x7fbbcc0b1f10 msgr2=0x7fbbcc1547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.648+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 shutdown_connections 2024-04-24T23:59:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.648+0000 7fbbd2200640 1 -- 172.21.15.96:0/2856270736 wait complete. 2024-04-24T23:59:03.667 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:59:03.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.866+0000 7f1f22e00640 1 Processor -- start 2024-04-24T23:59:03.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.866+0000 7f1f22e00640 1 -- start start 2024-04-24T23:59:03.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.868+0000 7f1f22e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c15e280 0x7f1f1c06bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.868+0000 7f1f22e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1f1c15e660 0x7f1f1c06ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.868+0000 7f1f22e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c06c9b0 con 0x7f1f1c067200 2024-04-24T23:59:03.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.868+0000 7f1f22e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1c06e990 con 0x7f1f1c15e660 2024-04-24T23:59:03.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.868+0000 7f1f22e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c06bc70 con 0x7f1f1c15e280 2024-04-24T23:59:03.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.868+0000 7f1f20e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1f1c067200 0x7f1f1c0715e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59688/0 (socket says 172.21.15.96:59688) 2024-04-24T23:59:03.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.868+0000 7f1f20e00640 1 -- 172.21.15.96:0/1108466003 learned_addr learned my addr 172.21.15.96:0/1108466003 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:03.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1be00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c15e280 0x7f1f1c06bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1b400640 1 --2- 172.21.15.96:0/1108466003 >> v2:172.21.15.155:3300/0 conn(0x7f1f1c15e660 0x7f1f1c06ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013164227 0 0) 0x7f1f1c06c9b0 con 0x7f1f1c067200 2024-04-24T23:59:03.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f00003520 con 0x7f1f1c067200 2024-04-24T23:59:03.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3107543018 0 0) 0x7f1f00003520 con 0x7f1f1c067200 2024-04-24T23:59:03.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c15e280 msgr2=0x7f1f1c06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:03.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c15e280 0x7f1f1c06bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 >> v2:172.21.15.155:3300/0 conn(0x7f1f1c15e660 msgr2=0x7f1f1c06ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 --2- 172.21.15.96:0/1108466003 >> v2:172.21.15.155:3300/0 conn(0x7f1f1c15e660 0x7f1f1c06ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c06e340 con 0x7f1f1c067200 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f1f14001670 con 0x7f1f1c067200 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 >> v1:172.21.15.96:6789/0 conn(0x7f1f1c067200 legacy=0x7f1f1c0715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f000039b0 0x7f1f00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.869+0000 7f1f1aa00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c15e280 0x7f1f00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1aa00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f00004d40 0x7f1f000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c06e990 con 0x7f1f000039b0 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c06bc70 con 0x7f1f00004d40 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0000b9c0 con 0x7f1f1c15e280 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1be00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f000039b0 0x7f1f00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f20e00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f00004d40 0x7f1f000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1be00640 1 -- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c15e280 msgr2=0x7f1f00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1be00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c15e280 0x7f1f00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1be00640 1 -- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f00004d40 msgr2=0x7f1f000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1be00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f00004d40 0x7f1f000051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.870+0000 7f1f1be00640 1 -- 172.21.15.96:0/1108466003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f00003520 con 0x7f1f000039b0 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.871+0000 7f1f1be00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f000039b0 0x7f1f00003dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009ac0 tx=0x7f1f00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a62060ce9701c20 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c036070 con 0x7f1f000039b0 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0c031400 con 0x7f1f000039b0 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f1aa00640 1 -- 172.21.15.96:0/1108466003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c009690 con 0x7f1f000039b0 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f22e00640 1 -- 172.21.15.96:0/1108466003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f000039b0 msgr2=0x7f1f00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f22e00640 1 --2- 172.21.15.96:0/1108466003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f000039b0 0x7f1f00003dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009ac0 tx=0x7f1f00005830 comp rx=0 tx=0).stop 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f20e00640 1 -- 172.21.15.96:0/1108466003 reap_dead start 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f22e00640 1 -- 172.21.15.96:0/1108466003 shutdown_connections 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f22e00640 1 -- 172.21.15.96:0/1108466003 >> 172.21.15.96:0/1108466003 conn(0x7f1f1c0d04f0 msgr2=0x7f1f1c0d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f22e00640 1 -- 172.21.15.96:0/1108466003 shutdown_connections 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.872+0000 7f1f22e00640 1 -- 172.21.15.96:0/1108466003 wait complete. 2024-04-24T23:59:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.874+0000 7f1f22e00640 1 Processor -- start 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.874+0000 7f1f22e00640 1 -- start start 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.875+0000 7f1f22e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f000039b0 0x7f1f1c15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.875+0000 7f1f22e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c151740 0x7f1f1c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.875+0000 7f1f22e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1c15c790 0x7f1f1c15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.875+0000 7f1f22e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c06f4e0 con 0x7f1f1c15c790 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.875+0000 7f1f22e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c06f360 con 0x7f1f000039b0 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.875+0000 7f1f22e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c071cf0 con 0x7f1f1c151740 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.875+0000 7f1f20e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1c15c790 0x7f1f1c15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.875+0000 7f1f20e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1c15c790 0x7f1f1c15cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58386/0 (socket says 172.21.15.96:58386) 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.875+0000 7f1f20e00640 1 -- 172.21.15.96:0/3925267300 learned_addr learned my addr 172.21.15.96:0/3925267300 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f20e00640 1 -- 172.21.15.96:0/3925267300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c151740 msgr2=0x7f1f1c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f20e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c151740 0x7f1f1c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f20e00640 1 -- 172.21.15.96:0/3925267300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f000039b0 msgr2=0x7f1f1c15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f1be00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f000039b0 0x7f1f1c15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f20e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f000039b0 0x7f1f1c15fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f20e00640 1 -- 172.21.15.96:0/3925267300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c15bb00 con 0x7f1f1c15c790 2024-04-24T23:59:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f20e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1c15c790 0x7f1f1c15cc10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c075080 tx=0x7f1f1400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f13e00640 1 -- 172.21.15.96:0/3925267300 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14007230 con 0x7f1f1c15c790 2024-04-24T23:59:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f13e00640 1 -- 172.21.15.96:0/3925267300 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f140073f0 con 0x7f1f1c15c790 2024-04-24T23:59:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f13e00640 1 -- 172.21.15.96:0/3925267300 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140047e0 con 0x7f1f1c15c790 2024-04-24T23:59:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.876+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c15bde0 con 0x7f1f1c15c790 2024-04-24T23:59:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.877+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c158b30 con 0x7f1f1c15c790 2024-04-24T23:59:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.878+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c069110 con 0x7f1f1c15c790 2024-04-24T23:59:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.879+0000 7f1f13e00640 1 -- 172.21.15.96:0/3925267300 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f1401b020 con 0x7f1f1c15c790 2024-04-24T23:59:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.880+0000 7f1f13e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1efc06be30 0x7f1efc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.880+0000 7f1f13e00640 1 -- 172.21.15.96:0/3925267300 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f1f1408a980 con 0x7f1f1c15c790 2024-04-24T23:59:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.880+0000 7f1f1be00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1efc06be30 0x7f1efc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.881+0000 7f1f1be00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1efc06be30 0x7f1efc06e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c033000 tx=0x7f1f0c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:03.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:03.884+0000 7f1f13e00640 1 -- 172.21.15.96:0/3925267300 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1f1401b310 con 0x7f1f1c15c790 2024-04-24T23:59:04.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.120+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1f1c06b820 con 0x7f1f1c15c790 2024-04-24T23:59:04.121 INFO:tasks.ceph.mon.a.smithi096.stderr:2024-04-24T23:59:04.121+0000 7f743ce00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:59:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.124+0000 7f1f13e00640 1 -- 172.21.15.96:0/3925267300 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f1f140592a0 con 0x7f1f1c15c790 2024-04-24T23:59:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:59:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1efc06be30 msgr2=0x7f1efc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1efc06be30 0x7f1efc06e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c033000 tx=0x7f1f0c008030 comp rx=0 tx=0).stop 2024-04-24T23:59:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1c15c790 msgr2=0x7f1f1c15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1c15c790 0x7f1f1c15cc10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c075080 tx=0x7f1f1400db80 comp rx=0 tx=0).stop 2024-04-24T23:59:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 shutdown_connections 2024-04-24T23:59:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1efc06be30 0x7f1efc06e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1c15c790 0x7f1f1c15cc10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f1c151740 0x7f1f1c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 --2- 172.21.15.96:0/3925267300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f000039b0 0x7f1f1c15fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 >> 172.21.15.96:0/3925267300 conn(0x7f1f1c0d04f0 msgr2=0x7f1f1c0b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:04.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 shutdown_connections 2024-04-24T23:59:04.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.128+0000 7f1f22e00640 1 -- 172.21.15.96:0/3925267300 wait complete. 2024-04-24T23:59:04.147 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:59:04.165 INFO:tasks.ceph.mds.b.smithi155.stderr: -8564> 2024-04-24T23:58:06.497+0000 7f6ac9e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:59:04.241 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-04-24T23:59:04.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.350+0000 7fddc1e00640 1 Processor -- start 2024-04-24T23:59:04.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.351+0000 7fddc1e00640 1 -- start start 2024-04-24T23:59:04.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.352+0000 7fddc1e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fddbc15cd10 0x7fddbc163610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:04.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.352+0000 7fddc1e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fddbc0b45a0 0x7fddbc0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:04.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.352+0000 7fddc1e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddbc0b3080 con 0x7fddbc0b4120 2024-04-24T23:59:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.352+0000 7fddc1e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fddbc0b3c90 con 0x7fddbc0b45a0 2024-04-24T23:59:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.352+0000 7fddc1e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fddbc163b50 con 0x7fddbc15cd10 2024-04-24T23:59:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.353+0000 7fddbb400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fddbc0b45a0 0x7fddbc0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.353+0000 7fddba000640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fddbc0b4120 0x7fddbc06cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59692/0 (socket says 172.21.15.96:59692) 2024-04-24T23:59:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.353+0000 7fddba000640 1 -- 172.21.15.96:0/1023724994 learned_addr learned my addr 172.21.15.96:0/1023724994 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.353+0000 7fddbaa00640 1 --2- 172.21.15.96:0/1023724994 >> v2:172.21.15.155:3300/0 conn(0x7fddbc15cd10 0x7fddbc163610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.353+0000 7fddbb400640 1 -- 172.21.15.96:0/1023724994 >> v2:172.21.15.155:3300/0 conn(0x7fddbc15cd10 msgr2=0x7fddbc163610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.353+0000 7fddbb400640 1 --2- 172.21.15.96:0/1023724994 >> v2:172.21.15.155:3300/0 conn(0x7fddbc15cd10 0x7fddbc163610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.353+0000 7fddbb400640 1 -- 172.21.15.96:0/1023724994 >> v1:172.21.15.96:6789/0 conn(0x7fddbc0b4120 legacy=0x7fddbc06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.353+0000 7fddbb400640 1 -- 172.21.15.96:0/1023724994 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc0b3360 con 0x7fddbc0b45a0 2024-04-24T23:59:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.353+0000 7fddb9600640 1 -- 172.21.15.96:0/1023724994 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8612135 0 0) 0x7fddbc0b3080 con 0x7fddbc0b4120 2024-04-24T23:59:04.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.354+0000 7fddbb400640 1 --2- 172.21.15.96:0/1023724994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 0x7fddbc0acda0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fddbc06c950 tx=0x7fddb402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40305936cba1f5b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:04.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.355+0000 7fddb9600640 1 -- 172.21.15.96:0/1023724994 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4037070 con 0x7fddbc0b45a0 2024-04-24T23:59:04.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.355+0000 7fddb9600640 1 -- 172.21.15.96:0/1023724994 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb4032440 con 0x7fddbc0b45a0 2024-04-24T23:59:04.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.355+0000 7fddb9600640 1 -- 172.21.15.96:0/1023724994 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4032810 con 0x7fddbc0b45a0 2024-04-24T23:59:04.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.355+0000 7fddc1e00640 1 -- 172.21.15.96:0/1023724994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 msgr2=0x7fddbc0acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:04.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.355+0000 7fddc1e00640 1 --2- 172.21.15.96:0/1023724994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 0x7fddbc0acda0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fddbc06c950 tx=0x7fddb402a1a0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.355+0000 7fddc1e00640 1 -- 172.21.15.96:0/1023724994 shutdown_connections 2024-04-24T23:59:04.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.355+0000 7fddc1e00640 1 --2- 172.21.15.96:0/1023724994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 0x7fddbc0acda0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.355+0000 7fddc1e00640 1 --2- 172.21.15.96:0/1023724994 >> v2:172.21.15.155:3300/0 conn(0x7fddbc15cd10 0x7fddbc163610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.355+0000 7fddc1e00640 1 -- 172.21.15.96:0/1023724994 >> 172.21.15.96:0/1023724994 conn(0x7fddbc0b19c0 msgr2=0x7fddbc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:04.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.356+0000 7fddc1e00640 1 -- 172.21.15.96:0/1023724994 shutdown_connections 2024-04-24T23:59:04.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.356+0000 7fddc1e00640 1 -- 172.21.15.96:0/1023724994 wait complete. 2024-04-24T23:59:04.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.357+0000 7fddc1e00640 1 Processor -- start 2024-04-24T23:59:04.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.357+0000 7fddc1e00640 1 -- start start 2024-04-24T23:59:04.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.358+0000 7fddc1e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddbc0b4120 0x7fddbc155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:04.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.358+0000 7fddc1e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 0x7fddbc1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:04.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.358+0000 7fddc1e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddbc15cd10 0x7fddbc1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:04.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.358+0000 7fddc1e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc06ee90 con 0x7fddbc0b45a0 2024-04-24T23:59:04.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.358+0000 7fddc1e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc0b3920 con 0x7fddbc15cd10 2024-04-24T23:59:04.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.358+0000 7fddc1e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fddbc06f010 con 0x7fddbc0b4120 2024-04-24T23:59:04.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddba000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 0x7fddbc1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:04.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddba000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 0x7fddbc1592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58402/0 (socket says 172.21.15.96:58402) 2024-04-24T23:59:04.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddba000640 1 -- 172.21.15.96:0/231089147 learned_addr learned my addr 172.21.15.96:0/231089147 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:04.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddbaa00640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddbc0b4120 0x7fddbc155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddbb400640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddbc15cd10 0x7fddbc1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddba000640 1 -- 172.21.15.96:0/231089147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddbc0b4120 msgr2=0x7fddbc155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddba000640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddbc0b4120 0x7fddbc155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddba000640 1 -- 172.21.15.96:0/231089147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddbc15cd10 msgr2=0x7fddbc1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddba000640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddbc15cd10 0x7fddbc1597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.359+0000 7fddba000640 1 -- 172.21.15.96:0/231089147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc156330 con 0x7fddbc0b45a0 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.360+0000 7fddba000640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 0x7fddbc1592b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdda400c890 tx=0x7fdda400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.360+0000 7fddb3400640 1 -- 172.21.15.96:0/231089147 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4018070 con 0x7fddbc0b45a0 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.360+0000 7fddb3400640 1 -- 172.21.15.96:0/231089147 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda400a640 con 0x7fddbc0b45a0 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.360+0000 7fddb3400640 1 -- 172.21.15.96:0/231089147 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda400aa30 con 0x7fddbc0b45a0 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.360+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc164720 con 0x7fddbc0b45a0 2024-04-24T23:59:04.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.360+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc164ce0 con 0x7fddbc0b45a0 2024-04-24T23:59:04.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.361+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc069110 con 0x7fddbc0b45a0 2024-04-24T23:59:04.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.362+0000 7fddb3400640 1 -- 172.21.15.96:0/231089147 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdda401b070 con 0x7fddbc0b45a0 2024-04-24T23:59:04.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.363+0000 7fddb3400640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdd9806be60 0x7fdd9806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:04.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.363+0000 7fddb3400640 1 -- 172.21.15.96:0/231089147 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5940+0+0 (secure 0 0 0) 0x7fdda408a6e0 con 0x7fddbc0b45a0 2024-04-24T23:59:04.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.363+0000 7fddbaa00640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdd9806be60 0x7fdd9806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:04.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.364+0000 7fddbaa00640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdd9806be60 0x7fdd9806e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fddac006fd0 tx=0x7fddac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:04.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.369+0000 7fddb3400640 1 -- 172.21.15.96:0/231089147 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdda4058e70 con 0x7fddbc0b45a0 2024-04-24T23:59:04.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:04.614+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fddbc0b4e00 con 0x7fddbc0b45a0 2024-04-24T23:59:05.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.135+0000 7fddb3400640 1 -- 172.21.15.96:0/231089147 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fdda4058770 con 0x7fddbc0b45a0 2024-04-24T23:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdd9806be60 msgr2=0x7fdd9806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdd9806be60 0x7fdd9806e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fddac006fd0 tx=0x7fddac008040 comp rx=0 tx=0).stop 2024-04-24T23:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 msgr2=0x7fddbc1592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 0x7fddbc1592b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdda400c890 tx=0x7fdda400cd50 comp rx=0 tx=0).stop 2024-04-24T23:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 shutdown_connections 2024-04-24T23:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddbc15cd10 0x7fddbc1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdd9806be60 0x7fdd9806e320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0b45a0 0x7fddbc1592b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 --2- 172.21.15.96:0/231089147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddbc0b4120 0x7fddbc155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 >> 172.21.15.96:0/231089147 conn(0x7fddbc0b19c0 msgr2=0x7fddbc0b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 shutdown_connections 2024-04-24T23:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.138+0000 7fddc1e00640 1 -- 172.21.15.96:0/231089147 wait complete. 2024-04-24T23:59:05.158 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:59:05.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.366+0000 7fe80aa00640 1 Processor -- start 2024-04-24T23:59:05.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.366+0000 7fe80aa00640 1 -- start start 2024-04-24T23:59:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.367+0000 7fe80aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8040aebb0 0x7fe804154f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.367+0000 7fe80aa00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe804072bd0 con 0x7fe80415f3f0 2024-04-24T23:59:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.368+0000 7fe80aa00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8040b4a90 con 0x7fe8040727f0 2024-04-24T23:59:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.368+0000 7fe80aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe8040af040 con 0x7fe8040aebb0 2024-04-24T23:59:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.368+0000 7fe803400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe80415f3f0 0x7fe8040ae4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59694/0 (socket says 172.21.15.96:59694) 2024-04-24T23:59:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.368+0000 7fe803400640 1 -- 172.21.15.96:0/1891752701 learned_addr learned my addr 172.21.15.96:0/1891752701 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.368+0000 7fe808a00640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8040aebb0 0x7fe804154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.368+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615422706 0 0) 0x7fe804072bd0 con 0x7fe80415f3f0 2024-04-24T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.368+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7e8003520 con 0x7fe80415f3f0 2024-04-24T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 609811246 0 0) 0x7fe7e8003520 con 0x7fe80415f3f0 2024-04-24T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8040aebb0 msgr2=0x7fe804154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8040aebb0 0x7fe804154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 >> v1:172.21.15.155:6789/0 conn(0x7fe8040727f0 legacy=0x7fe80415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8040af260 con 0x7fe80415f3f0 2024-04-24T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fe7f00019f0 con 0x7fe80415f3f0 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 >> v1:172.21.15.96:6789/0 conn(0x7fe80415f3f0 legacy=0x7fe8040ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7e80039e0 0x7fe7e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7e8004800 0x7fe7e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8040aebb0 0x7fe7e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe8040af040 con 0x7fe7e8004800 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e800dc80 con 0x7fe7e80039e0 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e800de80 con 0x7fe8040aebb0 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.369+0000 7fe803400640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7e8004800 0x7fe7e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.370+0000 7fe803400640 1 -- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8040aebb0 msgr2=0x7fe7e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.370+0000 7fe803400640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8040aebb0 0x7fe7e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.370+0000 7fe803e00640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7e80039e0 0x7fe7e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.370+0000 7fe803400640 1 -- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7e80039e0 msgr2=0x7fe7e8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.370+0000 7fe803400640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7e80039e0 0x7fe7e8003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.370+0000 7fe803400640 1 -- 172.21.15.96:0/1891752701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e8003520 con 0x7fe7e8004800 2024-04-24T23:59:05.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.371+0000 7fe803400640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7e8004800 0x7fe7e8004c80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000a830 tx=0x7fe7e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd988cff9e4335cb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:05.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.371+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000a480 con 0x7fe7e8004800 2024-04-24T23:59:05.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.371+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f002f070 con 0x7fe7e8004800 2024-04-24T23:59:05.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.371+0000 7fe802a00640 1 -- 172.21.15.96:0/1891752701 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f002bcb0 con 0x7fe7e8004800 2024-04-24T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.371+0000 7fe80aa00640 1 -- 172.21.15.96:0/1891752701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7e8004800 msgr2=0x7fe7e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.371+0000 7fe80aa00640 1 --2- 172.21.15.96:0/1891752701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7e8004800 0x7fe7e8004c80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000a830 tx=0x7fe7e8005830 comp rx=0 tx=0).stop 2024-04-24T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.371+0000 7fe808a00640 1 -- 172.21.15.96:0/1891752701 reap_dead start 2024-04-24T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.372+0000 7fe80aa00640 1 -- 172.21.15.96:0/1891752701 shutdown_connections 2024-04-24T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.372+0000 7fe80aa00640 1 -- 172.21.15.96:0/1891752701 >> 172.21.15.96:0/1891752701 conn(0x7fe8040b19c0 msgr2=0x7fe8040b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.372+0000 7fe80aa00640 1 -- 172.21.15.96:0/1891752701 shutdown_connections 2024-04-24T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.372+0000 7fe80aa00640 1 -- 172.21.15.96:0/1891752701 wait complete. 2024-04-24T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.373+0000 7fe80aa00640 1 Processor -- start 2024-04-24T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.374+0000 7fe80aa00640 1 -- start start 2024-04-24T23:59:05.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.374+0000 7fe80aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7e8004800 0x7fe8040b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.374+0000 7fe80aa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe804151eb0 0x7fe80409bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.374+0000 7fe80aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe804149850 0x7fe804149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.374+0000 7fe80aa00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe8040b3280 con 0x7fe804151eb0 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.374+0000 7fe80aa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe8040b2fa0 con 0x7fe804149850 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.374+0000 7fe80aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe8040b3560 con 0x7fe7e8004800 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe803400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe804151eb0 0x7fe80409bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe803400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe804151eb0 0x7fe80409bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58428/0 (socket says 172.21.15.96:58428) 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe803400640 1 -- 172.21.15.96:0/3476341005 learned_addr learned my addr 172.21.15.96:0/3476341005 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe803e00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7e8004800 0x7fe8040b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe808a00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe804149850 0x7fe804149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe803400640 1 -- 172.21.15.96:0/3476341005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7e8004800 msgr2=0x7fe8040b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe803400640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7e8004800 0x7fe8040b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe803400640 1 -- 172.21.15.96:0/3476341005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe804149850 msgr2=0x7fe804149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe803400640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe804149850 0x7fe804149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe803400640 1 -- 172.21.15.96:0/3476341005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80409c830 con 0x7fe804151eb0 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.375+0000 7fe808a00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe804149850 0x7fe804149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.376+0000 7fe803400640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe804151eb0 0x7fe80409bec0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0001cf0 tx=0x7fe80415c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.376+0000 7fe7fbe00640 1 -- 172.21.15.96:0/3476341005 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0044070 con 0x7fe804151eb0 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.376+0000 7fe7fbe00640 1 -- 172.21.15.96:0/3476341005 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f0004d60 con 0x7fe804151eb0 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.376+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80409cb10 con 0x7fe804151eb0 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.376+0000 7fe7fbe00640 1 -- 172.21.15.96:0/3476341005 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000a480 con 0x7fe804151eb0 2024-04-24T23:59:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.376+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80409d0d0 con 0x7fe804151eb0 2024-04-24T23:59:05.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.377+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe804069110 con 0x7fe804151eb0 2024-04-24T23:59:05.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.378+0000 7fe7fbe00640 1 -- 172.21.15.96:0/3476341005 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe7f0047070 con 0x7fe804151eb0 2024-04-24T23:59:05.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.379+0000 7fe7fbe00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7e406be30 0x7fe7e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:05.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.379+0000 7fe7fbe00640 1 -- 172.21.15.96:0/3476341005 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5940+0+0 (secure 0 0 0) 0x7fe7f00ab1f0 con 0x7fe804151eb0 2024-04-24T23:59:05.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.380+0000 7fe803e00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7e406be30 0x7fe7e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:05.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.380+0000 7fe803e00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7e406be30 0x7fe7e406e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4001710 tx=0x7fe7f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:05.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.384+0000 7fe7fbe00640 1 -- 172.21.15.96:0/3476341005 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe7f0079a10 con 0x7fe804151eb0 2024-04-24T23:59:05.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:05.585+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe80406ecb0 con 0x7fe804151eb0 2024-04-24T23:59:06.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.397+0000 7fe7fbe00640 1 -- 172.21.15.96:0/3476341005 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7fe7f0079310 con 0x7fe804151eb0 2024-04-24T23:59:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:59:06.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7e406be30 msgr2=0x7fe7e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:06.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7e406be30 0x7fe7e406e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4001710 tx=0x7fe7f4009040 comp rx=0 tx=0).stop 2024-04-24T23:59:06.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe804151eb0 msgr2=0x7fe80409bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:06.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe804151eb0 0x7fe80409bec0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0001cf0 tx=0x7fe80415c700 comp rx=0 tx=0).stop 2024-04-24T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 shutdown_connections 2024-04-24T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe804149850 0x7fe804149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7e406be30 0x7fe7e406e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe804151eb0 0x7fe80409bec0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 --2- 172.21.15.96:0/3476341005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7e8004800 0x7fe8040b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 >> 172.21.15.96:0/3476341005 conn(0x7fe8040b19c0 msgr2=0x7fe804071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.403+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 shutdown_connections 2024-04-24T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.404+0000 7fe80aa00640 1 -- 172.21.15.96:0/3476341005 wait complete. 2024-04-24T23:59:06.431 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:59:06.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.623+0000 7fc15c000640 1 Processor -- start 2024-04-24T23:59:06.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.623+0000 7fc15c000640 1 -- start start 2024-04-24T23:59:06.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.624+0000 7fc15c000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15415f3f0 0x7fc1540ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.624+0000 7fc15c000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc154072bd0 con 0x7fc1540727f0 2024-04-24T23:59:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.624+0000 7fc15c000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1540b4a90 con 0x7fc1540ae9e0 2024-04-24T23:59:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.624+0000 7fc15c000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc1540af260 con 0x7fc15415f3f0 2024-04-24T23:59:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.625+0000 7fc159600640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc1540727f0 0x7fc15415ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59704/0 (socket says 172.21.15.96:59704) 2024-04-24T23:59:06.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.625+0000 7fc159600640 1 -- 172.21.15.96:0/2502618204 learned_addr learned my addr 172.21.15.96:0/2502618204 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.625+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635451688 0 0) 0x7fc154072bd0 con 0x7fc1540727f0 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.625+0000 7fc158c00640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15415f3f0 0x7fc1540ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.625+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc13c005730 con 0x7fc1540727f0 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2508679875 0 0) 0x7fc13c005730 con 0x7fc1540727f0 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15415f3f0 msgr2=0x7fc1540ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15415f3f0 0x7fc1540ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 >> v1:172.21.15.155:6789/0 conn(0x7fc1540ae9e0 legacy=0x7fc154154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1540b2cc0 con 0x7fc1540727f0 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fc148001670 con 0x7fc1540727f0 2024-04-24T23:59:06.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 >> v1:172.21.15.96:6789/0 conn(0x7fc1540727f0 legacy=0x7fc15415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc13c006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c006a10 0x7fc13c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15415f3f0 0x7fc13c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540af260 con 0x7fc13c005bf0 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c00dcb0 con 0x7fc13c006a10 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc13c00deb0 con 0x7fc15415f3f0 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc159600640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc13c006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc158c00640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c006a10 0x7fc13c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc159600640 1 -- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15415f3f0 msgr2=0x7fc13c0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.626+0000 7fc159600640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15415f3f0 0x7fc13c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.627+0000 7fc159600640 1 -- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c006a10 msgr2=0x7fc13c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.627+0000 7fc159600640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c006a10 0x7fc13c006e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.627+0000 7fc159600640 1 -- 172.21.15.96:0/2502618204 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c005730 con 0x7fc13c005bf0 2024-04-24T23:59:06.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.628+0000 7fc159600640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc13c006010 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc14800c0e0 tx=0x7fc13c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c3d156c0bc7aa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.628+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148007c40 con 0x7fc13c005bf0 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.628+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc148005af0 con 0x7fc13c005bf0 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.628+0000 7fc153e00640 1 -- 172.21.15.96:0/2502618204 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148007070 con 0x7fc13c005bf0 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.628+0000 7fc15c000640 1 -- 172.21.15.96:0/2502618204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 msgr2=0x7fc13c006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.628+0000 7fc15c000640 1 --2- 172.21.15.96:0/2502618204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc13c006010 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc14800c0e0 tx=0x7fc13c007a40 comp rx=0 tx=0).stop 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.629+0000 7fc15a000640 1 -- 172.21.15.96:0/2502618204 reap_dead start 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.629+0000 7fc15c000640 1 -- 172.21.15.96:0/2502618204 shutdown_connections 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.629+0000 7fc15c000640 1 -- 172.21.15.96:0/2502618204 >> 172.21.15.96:0/2502618204 conn(0x7fc1540b19c0 msgr2=0x7fc1540b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.629+0000 7fc15c000640 1 -- 172.21.15.96:0/2502618204 shutdown_connections 2024-04-24T23:59:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.629+0000 7fc15c000640 1 -- 172.21.15.96:0/2502618204 wait complete. 2024-04-24T23:59:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.630+0000 7fc15c000640 1 Processor -- start 2024-04-24T23:59:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.631+0000 7fc15c000640 1 -- start start 2024-04-24T23:59:06.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.631+0000 7fc15c000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc15414b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:06.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.631+0000 7fc15c000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15409aa70 0x7fc15409c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc15c000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15409aef0 0x7fc15409cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc15c000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540b3560 con 0x7fc13c005bf0 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc15c000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540b3280 con 0x7fc15409aa70 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc15c000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc1540aee70 con 0x7fc15409aef0 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc159600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc15414b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc159600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc15414b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58446/0 (socket says 172.21.15.96:58446) 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc159600640 1 -- 172.21.15.96:0/1832586843 learned_addr learned my addr 172.21.15.96:0/1832586843 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc159600640 1 -- 172.21.15.96:0/1832586843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15409aef0 msgr2=0x7fc15409cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc159600640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15409aef0 0x7fc15409cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc159600640 1 -- 172.21.15.96:0/1832586843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15409aa70 msgr2=0x7fc15409c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc158c00640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15409aa70 0x7fc15409c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc159600640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15409aa70 0x7fc15409c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:06.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.632+0000 7fc159600640 1 -- 172.21.15.96:0/1832586843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15409df00 con 0x7fc13c005bf0 2024-04-24T23:59:06.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.633+0000 7fc159600640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc15414b830 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc14800c0e0 tx=0x7fc15415c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:06.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.633+0000 7fc151600640 1 -- 172.21.15.96:0/1832586843 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1480015b0 con 0x7fc13c005bf0 2024-04-24T23:59:06.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.633+0000 7fc151600640 1 -- 172.21.15.96:0/1832586843 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc148042070 con 0x7fc13c005bf0 2024-04-24T23:59:06.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.633+0000 7fc151600640 1 -- 172.21.15.96:0/1832586843 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148007290 con 0x7fc13c005bf0 2024-04-24T23:59:06.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.633+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15409d660 con 0x7fc13c005bf0 2024-04-24T23:59:06.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.633+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15409dc20 con 0x7fc13c005bf0 2024-04-24T23:59:06.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.634+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc154069110 con 0x7fc13c005bf0 2024-04-24T23:59:06.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.635+0000 7fc151600640 1 -- 172.21.15.96:0/1832586843 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc148007430 con 0x7fc13c005bf0 2024-04-24T23:59:06.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.636+0000 7fc151600640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc13406beb0 0x7fc13406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:06.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.636+0000 7fc151600640 1 -- 172.21.15.96:0/1832586843 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5502+0+0 (secure 0 0 0) 0x7fc1480aadb0 con 0x7fc13c005bf0 2024-04-24T23:59:06.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.636+0000 7fc158c00640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc13406beb0 0x7fc13406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:06.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.637+0000 7fc158c00640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc13406beb0 0x7fc13406e370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc1541f78a0 tx=0x7fc140008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:06.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.641+0000 7fc151600640 1 -- 172.21.15.96:0/1832586843 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc1480af070 con 0x7fc13c005bf0 2024-04-24T23:59:06.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:06.841+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc15406ecb0 con 0x7fc13c005bf0 2024-04-24T23:59:07.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.409+0000 7fc151600640 1 -- 172.21.15.96:0/1832586843 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7fc148030380 con 0x7fc13c005bf0 2024-04-24T23:59:07.411 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2024-04-24T23:59:07.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.413+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc13406beb0 msgr2=0x7fc13406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:07.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.413+0000 7fc15c000640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc13406beb0 0x7fc13406e370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc1541f78a0 tx=0x7fc140008040 comp rx=0 tx=0).stop 2024-04-24T23:59:07.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.413+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 msgr2=0x7fc15414b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:07.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.413+0000 7fc15c000640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc15414b830 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc14800c0e0 tx=0x7fc15415c700 comp rx=0 tx=0).stop 2024-04-24T23:59:07.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.414+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 shutdown_connections 2024-04-24T23:59:07.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.414+0000 7fc15c000640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc15409aef0 0x7fc15409cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:07.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.414+0000 7fc15c000640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15409aa70 0x7fc15409c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:07.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.414+0000 7fc15c000640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc13406beb0 0x7fc13406e370 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:07.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.414+0000 7fc15c000640 1 --2- 172.21.15.96:0/1832586843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c005bf0 0x7fc15414b830 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:07.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.414+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 >> 172.21.15.96:0/1832586843 conn(0x7fc1540b19c0 msgr2=0x7fc154070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:07.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.418+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 shutdown_connections 2024-04-24T23:59:07.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.418+0000 7fc15c000640 1 -- 172.21.15.96:0/1832586843 wait complete. 2024-04-24T23:59:07.442 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T23:59:07.442 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-24T23:59:07.443 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T23:59:07.443 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:59:07.443 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-24T23:59:07.443 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-24T23:59:07.444 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-24T23:59:07.444 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:59:07.444 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T23:59:07.444 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-24T23:59:07.444 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T23:59:07.445 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:59:07.445 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-24T23:59:07.445 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-24T23:59:07.445 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-24T23:59:07.445 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:59:07.462 INFO:tasks.ceph.mds.c:Stopped 2024-04-24T23:59:07.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-24T23:59:07.464 INFO:tasks.ceph.mds.d:Stopped 2024-04-24T23:59:07.465 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-24T23:59:07.466 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T23:59:07.467 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T23:59:07.468 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T23:59:07.469 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T23:59:07.514 INFO:tasks.ceph.mds.d:Started 2024-04-24T23:59:07.515 DEBUG:teuthology.parallel:result is None 2024-04-24T23:59:07.516 INFO:tasks.ceph.mds.c:Started 2024-04-24T23:59:07.517 DEBUG:teuthology.parallel:result is None 2024-04-24T23:59:07.520 INFO:tasks.ceph.mds.b:Started 2024-04-24T23:59:07.520 DEBUG:teuthology.parallel:result is None 2024-04-24T23:59:07.526 INFO:tasks.ceph.mds.a:Started 2024-04-24T23:59:07.527 DEBUG:teuthology.parallel:result is None 2024-04-24T23:59:07.527 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-24T23:59:07.664 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-04-24T23:59:07.668 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-04-24T23:59:07.670 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-04-24T23:59:07.673 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-04-24T23:59:07.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.706+0000 7f7dcf000640 1 Processor -- start 2024-04-24T23:59:07.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.706+0000 7f7dcf000640 1 -- start start 2024-04-24T23:59:07.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.707+0000 7f7dcf000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7dc815f6b0 0x7f7dc80ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:07.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.707+0000 7f7dcf000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc80b4ec0 0x7f7dc80cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:07.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.707+0000 7f7dcf000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dc815fa90 con 0x7f7dc80ccc20 2024-04-24T23:59:07.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.707+0000 7f7dcf000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7dc80b4a30 con 0x7f7dc815f6b0 2024-04-24T23:59:07.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.707+0000 7f7dcf000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc80b3e20 con 0x7f7dc80b4ec0 2024-04-24T23:59:07.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dce600640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7dc80ccc20 0x7f7dc815fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37912/0 (socket says 172.21.15.96:37912) 2024-04-24T23:59:07.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dce600640 1 -- 172.21.15.96:0/4010658238 learned_addr learned my addr 172.21.15.96:0/4010658238 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:07.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dcd200640 1 --2- 172.21.15.96:0/4010658238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc80b4ec0 0x7f7dc80cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:07.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dcdc00640 1 --2- 172.21.15.96:0/4010658238 >> v2:172.21.15.155:3300/0 conn(0x7f7dc815f6b0 0x7f7dc80ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:07.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dc7e00640 1 -- 172.21.15.96:0/4010658238 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769151218 0 0) 0x7f7dc815fa90 con 0x7f7dc80ccc20 2024-04-24T23:59:07.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dc7e00640 1 -- 172.21.15.96:0/4010658238 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db0003520 con 0x7f7dc80ccc20 2024-04-24T23:59:07.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dcd200640 1 -- 172.21.15.96:0/4010658238 >> v2:172.21.15.155:3300/0 conn(0x7f7dc815f6b0 msgr2=0x7f7dc80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:07.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dcd200640 1 --2- 172.21.15.96:0/4010658238 >> v2:172.21.15.155:3300/0 conn(0x7f7dc815f6b0 0x7f7dc80ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:07.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dcd200640 1 -- 172.21.15.96:0/4010658238 >> v1:172.21.15.96:6789/0 conn(0x7f7dc80ccc20 legacy=0x7f7dc815fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:07.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.708+0000 7f7dcd200640 1 -- 172.21.15.96:0/4010658238 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc80b4100 con 0x7f7dc80b4ec0 2024-04-24T23:59:07.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.710+0000 7f7dcd200640 1 --2- 172.21.15.96:0/4010658238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc80b4ec0 0x7f7dc80cc6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097a0 tx=0x7f7db402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a75f3202981e7518 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:07.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.710+0000 7f7dc7e00640 1 -- 172.21.15.96:0/4010658238 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4037070 con 0x7f7dc80b4ec0 2024-04-24T23:59:07.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.710+0000 7f7dc7e00640 1 -- 172.21.15.96:0/4010658238 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db4032440 con 0x7f7dc80b4ec0 2024-04-24T23:59:07.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.710+0000 7f7dc7e00640 1 -- 172.21.15.96:0/4010658238 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4032810 con 0x7f7dc80b4ec0 2024-04-24T23:59:07.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.711+0000 7f7dcf000640 1 -- 172.21.15.96:0/4010658238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc80b4ec0 msgr2=0x7f7dc80cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:07.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.711+0000 7f7dcf000640 1 --2- 172.21.15.96:0/4010658238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc80b4ec0 0x7f7dc80cc6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097a0 tx=0x7f7db402a180 comp rx=0 tx=0).stop 2024-04-24T23:59:07.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.711+0000 7f7dcf000640 1 -- 172.21.15.96:0/4010658238 shutdown_connections 2024-04-24T23:59:07.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.711+0000 7f7dcf000640 1 --2- 172.21.15.96:0/4010658238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc80b4ec0 0x7f7dc80cc6e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:07.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.711+0000 7f7dcf000640 1 --2- 172.21.15.96:0/4010658238 >> v2:172.21.15.155:3300/0 conn(0x7f7dc815f6b0 0x7f7dc80ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:07.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.711+0000 7f7dcf000640 1 -- 172.21.15.96:0/4010658238 >> 172.21.15.96:0/4010658238 conn(0x7f7dc80b1f10 msgr2=0x7f7dc80cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:07.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.711+0000 7f7dcf000640 1 -- 172.21.15.96:0/4010658238 shutdown_connections 2024-04-24T23:59:07.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.711+0000 7f7dcf000640 1 -- 172.21.15.96:0/4010658238 wait complete. 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.713+0000 7f7dcf000640 1 Processor -- start 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.713+0000 7f7dcf000640 1 -- start start 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcf000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc80b4ec0 0x7f7dc81f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcf000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc80ccc20 0x7f7dc806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcf000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc815f6b0 0x7f7dc80c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcf000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc80ceb20 con 0x7f7dc80ccc20 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcf000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc80b46c0 con 0x7f7dc80b4ec0 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcf000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc80cf1c0 con 0x7f7dc815f6b0 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcd200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc80ccc20 0x7f7dc806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcd200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc80ccc20 0x7f7dc806e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37154/0 (socket says 172.21.15.96:37154) 2024-04-24T23:59:07.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcd200640 1 -- 172.21.15.96:0/3291124653 learned_addr learned my addr 172.21.15.96:0/3291124653 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcdc00640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc80b4ec0 0x7f7dc81f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dce600640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc815f6b0 0x7f7dc80c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcd200640 1 -- 172.21.15.96:0/3291124653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc815f6b0 msgr2=0x7f7dc80c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcd200640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc815f6b0 0x7f7dc80c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcd200640 1 -- 172.21.15.96:0/3291124653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc80b4ec0 msgr2=0x7f7dc81f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcd200640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc80b4ec0 0x7f7dc81f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.714+0000 7f7dcd200640 1 -- 172.21.15.96:0/3291124653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc81f56f0 con 0x7f7dc80ccc20 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.715+0000 7f7dcd200640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc80ccc20 0x7f7dc806e5f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7db4035040 tx=0x7f7db40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.715+0000 7f7dc5600640 1 -- 172.21.15.96:0/3291124653 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4041030 con 0x7f7dc80ccc20 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.715+0000 7f7dc5600640 1 -- 172.21.15.96:0/3291124653 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db403d4e0 con 0x7f7dc80ccc20 2024-04-24T23:59:07.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.715+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc81f4e50 con 0x7f7dc80ccc20 2024-04-24T23:59:07.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.715+0000 7f7dc5600640 1 -- 172.21.15.96:0/3291124653 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4037040 con 0x7f7dc80ccc20 2024-04-24T23:59:07.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.715+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc81f5410 con 0x7f7dc80ccc20 2024-04-24T23:59:07.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.717+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc8067e40 con 0x7f7dc80ccc20 2024-04-24T23:59:07.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.718+0000 7f7dc5600640 1 -- 172.21.15.96:0/3291124653 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7db4044070 con 0x7f7dc80ccc20 2024-04-24T23:59:07.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.718+0000 7f7dc5600640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7da806be30 0x7f7da806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:07.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.718+0000 7f7dc5600640 1 -- 172.21.15.96:0/3291124653 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f7db40ab1b0 con 0x7f7dc80ccc20 2024-04-24T23:59:07.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.719+0000 7f7dcdc00640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7da806be30 0x7f7da806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:07.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.720+0000 7f7dcdc00640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7da806be30 0x7f7da806e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80cbc90 tx=0x7f7dbc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:07.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.723+0000 7f7dc5600640 1 -- 172.21.15.96:0/3291124653 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7db4079dd0 con 0x7f7dc80ccc20 2024-04-24T23:59:07.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:07.934+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7dc80cd740 con 0x7f7dc80ccc20 2024-04-24T23:59:08.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.430+0000 7f7dc5600640 1 -- 172.21.15.96:0/3291124653 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f7db40796d0 con 0x7f7dc80ccc20 2024-04-24T23:59:08.430 INFO:teuthology.orchestra.run.smithi096.stderr: removed all blocklist entries 2024-04-24T23:59:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.433+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7da806be30 msgr2=0x7f7da806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.433+0000 7f7dcf000640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7da806be30 0x7f7da806e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80cbc90 tx=0x7f7dbc009190 comp rx=0 tx=0).stop 2024-04-24T23:59:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.433+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc80ccc20 msgr2=0x7f7dc806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.433+0000 7f7dcf000640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc80ccc20 0x7f7dc806e5f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7db4035040 tx=0x7f7db40046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.434+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 shutdown_connections 2024-04-24T23:59:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.434+0000 7f7dcf000640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc815f6b0 0x7f7dc80c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.434+0000 7f7dcf000640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7da806be30 0x7f7da806e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.434+0000 7f7dcf000640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc80ccc20 0x7f7dc806e5f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.434+0000 7f7dcf000640 1 --2- 172.21.15.96:0/3291124653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc80b4ec0 0x7f7dc81f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.434+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 >> 172.21.15.96:0/3291124653 conn(0x7f7dc80b1f10 msgr2=0x7f7dc8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:08.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.434+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 shutdown_connections 2024-04-24T23:59:08.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.434+0000 7f7dcf000640 1 -- 172.21.15.96:0/3291124653 wait complete. 2024-04-24T23:59:08.454 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-24T23:59:08.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.628+0000 7f3e20e00640 1 Processor -- start 2024-04-24T23:59:08.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.628+0000 7f3e20e00640 1 -- start start 2024-04-24T23:59:08.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.629+0000 7f3e20e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c15b220 0x7f3e1c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:08.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.630+0000 7f3e20e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c0713d0 con 0x7f3e1c15f800 2024-04-24T23:59:08.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.630+0000 7f3e20e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c0ae4d0 con 0x7f3e1c15ec70 2024-04-24T23:59:08.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.630+0000 7f3e20e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c0aee00 con 0x7f3e1c15b220 2024-04-24T23:59:08.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.630+0000 7f3e1a800640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3e1c15f800 0x7f3e1c0b2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37920/0 (socket says 172.21.15.96:37920) 2024-04-24T23:59:08.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.630+0000 7f3e1a800640 1 -- 172.21.15.96:0/697984025 learned_addr learned my addr 172.21.15.96:0/697984025 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:08.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.630+0000 7f3e19e00640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c15b220 0x7f3e1c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:08.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.630+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263857136 0 0) 0x7f3e1c0713d0 con 0x7f3e1c15f800 2024-04-24T23:59:08.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e00005730 con 0x7f3e1c15f800 2024-04-24T23:59:08.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937101101 0 0) 0x7f3e1c0ae4d0 con 0x7f3e1c15ec70 2024-04-24T23:59:08.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e1c0713d0 con 0x7f3e1c15ec70 2024-04-24T23:59:08.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3855393595 0 0) 0x7f3e00005730 con 0x7f3e1c15f800 2024-04-24T23:59:08.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c15b220 msgr2=0x7f3e1c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c15b220 0x7f3e1c070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 >> v1:172.21.15.155:6789/0 conn(0x7f3e1c15ec70 legacy=0x7f3e1c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c0ae7b0 con 0x7f3e1c15f800 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f3e14001670 con 0x7f3e1c15f800 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 >> v1:172.21.15.96:6789/0 conn(0x7f3e1c15f800 legacy=0x7f3e1c0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c15b220 0x7f3e00005d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e000062e0 0x7f3e00006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e00006f50 0x7f3e000073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c0aee00 con 0x7f3e000062e0 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0000dcb0 con 0x7f3e00006f50 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0000deb0 con 0x7f3e1c15b220 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.631+0000 7f3e11400640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e000062e0 0x7f3e00006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.632+0000 7f3e19e00640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c15b220 0x7f3e00005d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:08.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.632+0000 7f3e1a800640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e00006f50 0x7f3e000073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:08.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.632+0000 7f3e11400640 1 -- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c15b220 msgr2=0x7f3e00005d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:08.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.632+0000 7f3e11400640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c15b220 0x7f3e00005d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.632+0000 7f3e11400640 1 -- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e00006f50 msgr2=0x7f3e000073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:08.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.632+0000 7f3e11400640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e00006f50 0x7f3e000073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.632+0000 7f3e11400640 1 -- 172.21.15.96:0/697984025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e00005730 con 0x7f3e000062e0 2024-04-24T23:59:08.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.632+0000 7f3e19e00640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c15b220 0x7f3e00005d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:08.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.633+0000 7f3e11400640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e000062e0 0x7f3e00006a10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3e040018d0 tx=0x7f3e00007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8b978044e2a5ae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:08.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.633+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040014f0 con 0x7f3e000062e0 2024-04-24T23:59:08.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.633+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e040052d0 con 0x7f3e000062e0 2024-04-24T23:59:08.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.633+0000 7f3e19400640 1 -- 172.21.15.96:0/697984025 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0402aca0 con 0x7f3e000062e0 2024-04-24T23:59:08.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.634+0000 7f3e20e00640 1 -- 172.21.15.96:0/697984025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e000062e0 msgr2=0x7f3e00006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:08.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.634+0000 7f3e20e00640 1 --2- 172.21.15.96:0/697984025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e000062e0 0x7f3e00006a10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3e040018d0 tx=0x7f3e00007a40 comp rx=0 tx=0).stop 2024-04-24T23:59:08.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.634+0000 7f3e1a800640 1 -- 172.21.15.96:0/697984025 reap_dead start 2024-04-24T23:59:08.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.634+0000 7f3e20e00640 1 -- 172.21.15.96:0/697984025 shutdown_connections 2024-04-24T23:59:08.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.634+0000 7f3e20e00640 1 -- 172.21.15.96:0/697984025 >> 172.21.15.96:0/697984025 conn(0x7f3e1c0b19c0 msgr2=0x7f3e1c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:08.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.634+0000 7f3e20e00640 1 -- 172.21.15.96:0/697984025 shutdown_connections 2024-04-24T23:59:08.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.634+0000 7f3e20e00640 1 -- 172.21.15.96:0/697984025 wait complete. 2024-04-24T23:59:08.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.636+0000 7f3e20e00640 1 Processor -- start 2024-04-24T23:59:08.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.636+0000 7f3e20e00640 1 -- start start 2024-04-24T23:59:08.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e20e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e000062e0 0x7f3e1c09b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:08.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e20e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c14d4c0 0x7f3e1c14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:08.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e20e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e1c154e00 0x7f3e1c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e20e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c06ed10 con 0x7f3e1c154e00 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e20e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c06eb90 con 0x7f3e000062e0 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e20e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c070df0 con 0x7f3e1c14d4c0 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e1a800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e1c154e00 0x7f3e1c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e1a800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e1c154e00 0x7f3e1c155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37162/0 (socket says 172.21.15.96:37162) 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e1a800640 1 -- 172.21.15.96:0/3882379590 learned_addr learned my addr 172.21.15.96:0/3882379590 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e11400640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c14d4c0 0x7f3e1c14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.637+0000 7f3e19e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e000062e0 0x7f3e1c09b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e1a800640 1 -- 172.21.15.96:0/3882379590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c14d4c0 msgr2=0x7f3e1c14d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e1a800640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c14d4c0 0x7f3e1c14d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e1a800640 1 -- 172.21.15.96:0/3882379590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e000062e0 msgr2=0x7f3e1c09b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e1a800640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e000062e0 0x7f3e1c09b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e1a800640 1 -- 172.21.15.96:0/3882379590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c155b70 con 0x7f3e1c154e00 2024-04-24T23:59:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e19e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e000062e0 0x7f3e1c09b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e1a800640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e1c154e00 0x7f3e1c155280 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c15fd10 tx=0x7f3e1400e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e12a00640 1 -- 172.21.15.96:0/3882379590 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14019070 con 0x7f3e1c154e00 2024-04-24T23:59:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e12a00640 1 -- 172.21.15.96:0/3882379590 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e14010510 con 0x7f3e1c154e00 2024-04-24T23:59:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e12a00640 1 -- 172.21.15.96:0/3882379590 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14010920 con 0x7f3e1c154e00 2024-04-24T23:59:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c155e50 con 0x7f3e1c154e00 2024-04-24T23:59:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.638+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c156410 con 0x7f3e1c154e00 2024-04-24T23:59:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.639+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c069110 con 0x7f3e1c154e00 2024-04-24T23:59:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.640+0000 7f3e12a00640 1 -- 172.21.15.96:0/3882379590 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e14010ac0 con 0x7f3e1c154e00 2024-04-24T23:59:08.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.641+0000 7f3e12a00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3df806be60 0x7f3df806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:08.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.641+0000 7f3e12a00640 1 -- 172.21.15.96:0/3882379590 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f3e1408a160 con 0x7f3e1c154e00 2024-04-24T23:59:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.642+0000 7f3e19e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3df806be60 0x7f3df806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.642+0000 7f3e19e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3df806be60 0x7f3df806e320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c011420 tx=0x7f3e0c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:08.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.646+0000 7f3e12a00640 1 -- 172.21.15.96:0/3882379590 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e14058e50 con 0x7f3e1c154e00 2024-04-24T23:59:08.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.934+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3e1c06cd90 con 0x7f3e1c154e00 2024-04-24T23:59:08.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.935+0000 7f3e12a00640 1 -- 172.21.15.96:0/3882379590 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f3e14058750 con 0x7f3e1c154e00 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_dump": [ 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.a", 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBMnClmF/jwJBAAmGfIIb43eyPbE+r3ohORJQ==", 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.935 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.b", 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBNnClmfcwuAhAAJSbgV/+L/+mVc5zO8FEtfQ==", 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.c", 2024-04-24T23:59:08.936 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBMnClmgViHMRAAc35ovhN/crf8yS69YqFoGA==", 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.d", 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBNnClmLxdbEBAA0CVvb3VRLAa2ACTXZ1r4MQ==", 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-04-24T23:59:08.937 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.0", 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBRnClmjoHRDxAAFqTu+Jr6Dqflzm+2wPFTNg==", 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.1", 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBUnClmt6pRKxAAgDgQYbqfvEwtaFTjx4nF8g==", 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.2", 2024-04-24T23:59:08.939 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBXnClm81adOBAAtSqQ0aJcfugi6bysL3l0bw==", 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.3", 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBbnClmh+4dFxAAT9yF+cMijpFCNWnEDeVUZw==", 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.940 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.4", 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBhnClmtQHsNhAASylddRopDyWb25vOETk/SA==", 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.5", 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBlnClmEC42FRAAv4ct19yMQnOw2N8HFPNZFw==", 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.941 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.6", 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBonClmWCL4LhAA46sPqIX8an3HwZBcsoWCnw==", 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.7", 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBsnClmvkgcDBAAdFzpyHzg2ZPpDJtNqYwU9w==", 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.0", 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBNnClmJTIAHRAAQWQYHUYotRYXVJCsgrfvDg==", 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-04-24T23:59:08.943 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.1", 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBNnClmmI6/LxAAQdvALs9pDsxJzGxcbnzzgw==", 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.2", 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBNnClmJrYSJhAAmzwMW00q2QB+6i6PaGvj6A==", 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.3", 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBNnClm6993ORAAxz/wGaGODYnNkYFMceoU/Q==", 2024-04-24T23:59:08.945 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.admin", 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBLnClmPj1KJxAARHh7nTDQ/DmENZo2dbD3VQ==", 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-04-24T23:59:08.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-mds", 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQB1nClmty82AhAAXTQOBE8mOgGURyM6qFGaAA==", 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-mds" 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-mgr", 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQB1nClmbzk2AhAAAUINpD/gmXhmQXtBVSZZyg==", 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.947 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-osd", 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQB1nClmGEI2AhAAnJC58sn4nL0A9yTAA/g+bA==", 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-osd" 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-rbd", 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQB1nClmlko2AhAAxIjnOrl1EHjjKz9CErqzOw==", 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQB1nClmC1M2AhAARyw8yX7qIVxv77gewurNNQ==", 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-rgw", 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQB1nClmm1s2AhAAhoA7Mm0mxMWTITCHcPpqDA==", 2024-04-24T23:59:08.949 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mgr.x", 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBMnClm/dinGhAAQQTuWQasKu6Nwi/jWmBD2A==", 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile mgr", 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:08.950 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mgr.y", 2024-04-24T23:59:08.951 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQBMnClm2ppOEhAALB8T24BRkDb/4b30+tBYgg==", 2024-04-24T23:59:08.951 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-04-24T23:59:08.951 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2024-04-24T23:59:08.951 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile mgr", 2024-04-24T23:59:08.951 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-04-24T23:59:08.951 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.951 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:08.951 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:08.951 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3df806be60 msgr2=0x7f3df806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3df806be60 0x7f3df806e320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c011420 tx=0x7f3e0c00b040 comp rx=0 tx=0).stop 2024-04-24T23:59:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e1c154e00 msgr2=0x7f3e1c155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e1c154e00 0x7f3e1c155280 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c15fd10 tx=0x7f3e1400e890 comp rx=0 tx=0).stop 2024-04-24T23:59:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 shutdown_connections 2024-04-24T23:59:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3df806be60 0x7f3df806e320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e1c154e00 0x7f3e1c155280 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e1c14d4c0 0x7f3e1c14d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 --2- 172.21.15.96:0/3882379590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e000062e0 0x7f3e1c09b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 >> 172.21.15.96:0/3882379590 conn(0x7f3e1c0b19c0 msgr2=0x7f3e1c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 shutdown_connections 2024-04-24T23:59:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:08.938+0000 7f3e20e00640 1 -- 172.21.15.96:0/3882379590 wait complete. 2024-04-24T23:59:08.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-24T23:59:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.152+0000 7f4965400640 1 Processor -- start 2024-04-24T23:59:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.152+0000 7f4965400640 1 -- start start 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.154+0000 7f4965400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49600b4ec0 0x7f49600cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.154+0000 7f4965400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f49600ccc20 0x7f4960070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.154+0000 7f4965400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f496015fa90 con 0x7f496015f6b0 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.154+0000 7f4965400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f49600b4a30 con 0x7f49600ccc20 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.154+0000 7f4965400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f49600b3e20 con 0x7f49600b4ec0 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.154+0000 7f4964a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f49600ccc20 0x7f4960070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.154+0000 7f4964a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f49600ccc20 0x7f4960070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37164/0 (socket says 172.21.15.96:37164) 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.154+0000 7f4964a00640 1 -- 172.21.15.96:0/2171573933 learned_addr learned my addr 172.21.15.96:0/2171573933 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.154+0000 7f495f400640 1 --2- 172.21.15.96:0/2171573933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49600b4ec0 0x7f49600cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.155+0000 7f4964a00640 1 -- 172.21.15.96:0/2171573933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49600b4ec0 msgr2=0x7f49600cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.155+0000 7f4964a00640 1 --2- 172.21.15.96:0/2171573933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49600b4ec0 0x7f49600cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.155+0000 7f4964a00640 1 -- 172.21.15.96:0/2171573933 >> v1:172.21.15.155:6789/0 conn(0x7f496015f6b0 legacy=0x7f49600ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.155+0000 7f4964a00640 1 -- 172.21.15.96:0/2171573933 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49600b4100 con 0x7f49600ccc20 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.156+0000 7f4964a00640 1 --2- 172.21.15.96:0/2171573933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600ccc20 0x7f4960070d60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f494c009870 tx=0x7f494c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e689b0e69956d4bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.156+0000 7f495ea00640 1 -- 172.21.15.96:0/2171573933 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c037070 con 0x7f49600ccc20 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.156+0000 7f495ea00640 1 -- 172.21.15.96:0/2171573933 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c032440 con 0x7f49600ccc20 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.156+0000 7f495ea00640 1 -- 172.21.15.96:0/2171573933 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c032810 con 0x7f49600ccc20 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.156+0000 7f4965400640 1 -- 172.21.15.96:0/2171573933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600ccc20 msgr2=0x7f4960070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.157+0000 7f4965400640 1 --2- 172.21.15.96:0/2171573933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600ccc20 0x7f4960070d60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f494c009870 tx=0x7f494c02a210 comp rx=0 tx=0).stop 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.157+0000 7f4965400640 1 -- 172.21.15.96:0/2171573933 shutdown_connections 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.157+0000 7f4965400640 1 --2- 172.21.15.96:0/2171573933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600ccc20 0x7f4960070d60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.157+0000 7f4965400640 1 --2- 172.21.15.96:0/2171573933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49600b4ec0 0x7f49600cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.157+0000 7f4965400640 1 -- 172.21.15.96:0/2171573933 >> 172.21.15.96:0/2171573933 conn(0x7f49600b1f10 msgr2=0x7f49600cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.157+0000 7f4965400640 1 -- 172.21.15.96:0/2171573933 shutdown_connections 2024-04-24T23:59:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.157+0000 7f4965400640 1 -- 172.21.15.96:0/2171573933 wait complete. 2024-04-24T23:59:09.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.158+0000 7f4965400640 1 Processor -- start 2024-04-24T23:59:09.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.159+0000 7f4965400640 1 -- start start 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.159+0000 7f4965400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600b4ec0 0x7f49600c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.159+0000 7f4965400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49600ccc20 0x7f4960152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.159+0000 7f4965400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f496015f6b0 0x7f49600ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.159+0000 7f4965400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f49600cf1c0 con 0x7f49600b4ec0 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.159+0000 7f4965400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49600b46c0 con 0x7f49600ccc20 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.159+0000 7f4965400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f49600b3a40 con 0x7f496015f6b0 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600b4ec0 0x7f49600c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600b4ec0 0x7f49600c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37166/0 (socket says 172.21.15.96:37166) 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495fe00640 1 -- 172.21.15.96:0/1725696084 learned_addr learned my addr 172.21.15.96:0/1725696084 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f4964a00640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f496015f6b0 0x7f49600ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495f400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49600ccc20 0x7f4960152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495fe00640 1 -- 172.21.15.96:0/1725696084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f496015f6b0 msgr2=0x7f49600ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495fe00640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f496015f6b0 0x7f49600ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495fe00640 1 -- 172.21.15.96:0/1725696084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49600ccc20 msgr2=0x7f4960152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495fe00640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49600ccc20 0x7f4960152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495fe00640 1 -- 172.21.15.96:0/1725696084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49600acfb0 con 0x7f49600b4ec0 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.160+0000 7f495f400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49600ccc20 0x7f4960152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.161+0000 7f495fe00640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600b4ec0 0x7f49600c9950 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f495800ba50 tx=0x7f495800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.161+0000 7f4957e00640 1 -- 172.21.15.96:0/1725696084 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4958019070 con 0x7f49600b4ec0 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.161+0000 7f4957e00640 1 -- 172.21.15.96:0/1725696084 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495800cc20 con 0x7f49600b4ec0 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.161+0000 7f4957e00640 1 -- 172.21.15.96:0/1725696084 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4958014680 con 0x7f49600b4ec0 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.161+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49600ad290 con 0x7f49600b4ec0 2024-04-24T23:59:09.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.161+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49600c9e90 con 0x7f49600b4ec0 2024-04-24T23:59:09.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.162+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4960067e40 con 0x7f49600b4ec0 2024-04-24T23:59:09.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.163+0000 7f4957e00640 1 -- 172.21.15.96:0/1725696084 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f495801c070 con 0x7f49600b4ec0 2024-04-24T23:59:09.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.164+0000 7f4957e00640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f494006be30 0x7f494006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.164+0000 7f4957e00640 1 -- 172.21.15.96:0/1725696084 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f495808a860 con 0x7f49600b4ec0 2024-04-24T23:59:09.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.164+0000 7f495f400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f494006be30 0x7f494006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.165+0000 7f495f400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f494006be30 0x7f494006e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49600cc3a0 tx=0x7f4950008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:09.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.169+0000 7f4957e00640 1 -- 172.21.15.96:0/1725696084 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4958058f00 con 0x7f49600b4ec0 2024-04-24T23:59:09.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.421+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f49600756b0 con 0x7f49600b4ec0 2024-04-24T23:59:09.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.433+0000 7f4957e00640 1 -- 172.21.15.96:0/1725696084 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f495805d200 con 0x7f49600b4ec0 2024-04-24T23:59:09.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f494006be30 msgr2=0x7f494006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f494006be30 0x7f494006e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49600cc3a0 tx=0x7f4950008040 comp rx=0 tx=0).stop 2024-04-24T23:59:09.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600b4ec0 msgr2=0x7f49600c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600b4ec0 0x7f49600c9950 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f495800ba50 tx=0x7f495800bf10 comp rx=0 tx=0).stop 2024-04-24T23:59:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 shutdown_connections 2024-04-24T23:59:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f496015f6b0 0x7f49600ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49600ccc20 0x7f4960152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f494006be30 0x7f494006e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 --2- 172.21.15.96:0/1725696084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600b4ec0 0x7f49600c9950 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 >> 172.21.15.96:0/1725696084 conn(0x7f49600b1f10 msgr2=0x7f49600af750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 shutdown_connections 2024-04-24T23:59:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.436+0000 7f4965400640 1 -- 172.21.15.96:0/1725696084 wait complete. 2024-04-24T23:59:09.456 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-24T23:59:09.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.643+0000 7fd27a200640 1 Processor -- start 2024-04-24T23:59:09.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.643+0000 7fd27a200640 1 -- start start 2024-04-24T23:59:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.645+0000 7fd27a200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd27415b220 0x7fd274070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.645+0000 7fd27a200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd27415f800 0x7fd2740b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.645+0000 7fd27a200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2740713d0 con 0x7fd27415ec70 2024-04-24T23:59:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.645+0000 7fd27a200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd2740aee00 con 0x7fd27415f800 2024-04-24T23:59:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.645+0000 7fd27a200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd2740ae4d0 con 0x7fd27415b220 2024-04-24T23:59:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.645+0000 7fd273e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd27415f800 0x7fd2740b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.645+0000 7fd273e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd27415f800 0x7fd2740b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37172/0 (socket says 172.21.15.96:37172) 2024-04-24T23:59:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.645+0000 7fd273e00640 1 -- 172.21.15.96:0/1125696118 learned_addr learned my addr 172.21.15.96:0/1125696118 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.646+0000 7fd273400640 1 --2- 172.21.15.96:0/1125696118 >> v2:172.21.15.155:3300/0 conn(0x7fd27415b220 0x7fd274070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.646+0000 7fd273e00640 1 -- 172.21.15.96:0/1125696118 >> v2:172.21.15.155:3300/0 conn(0x7fd27415b220 msgr2=0x7fd274070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:09.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.646+0000 7fd273e00640 1 --2- 172.21.15.96:0/1125696118 >> v2:172.21.15.155:3300/0 conn(0x7fd27415b220 0x7fd274070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.646+0000 7fd273e00640 1 -- 172.21.15.96:0/1125696118 >> v1:172.21.15.155:6789/0 conn(0x7fd27415ec70 legacy=0x7fd27415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:09.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.646+0000 7fd273e00640 1 -- 172.21.15.96:0/1125696118 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2740ae7b0 con 0x7fd27415f800 2024-04-24T23:59:09.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.647+0000 7fd273e00640 1 --2- 172.21.15.96:0/1125696118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415f800 0x7fd2740b2cc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd2740b27d0 tx=0x7fd26c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469c7c6c7ce8cbe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:09.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.647+0000 7fd272a00640 1 -- 172.21.15.96:0/1125696118 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c037070 con 0x7fd27415f800 2024-04-24T23:59:09.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.647+0000 7fd272a00640 1 -- 172.21.15.96:0/1125696118 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd26c032440 con 0x7fd27415f800 2024-04-24T23:59:09.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.647+0000 7fd272a00640 1 -- 172.21.15.96:0/1125696118 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c032810 con 0x7fd27415f800 2024-04-24T23:59:09.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.648+0000 7fd27a200640 1 -- 172.21.15.96:0/1125696118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415f800 msgr2=0x7fd2740b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.648+0000 7fd27a200640 1 --2- 172.21.15.96:0/1125696118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415f800 0x7fd2740b2cc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd2740b27d0 tx=0x7fd26c02a230 comp rx=0 tx=0).stop 2024-04-24T23:59:09.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.648+0000 7fd27a200640 1 -- 172.21.15.96:0/1125696118 shutdown_connections 2024-04-24T23:59:09.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.648+0000 7fd27a200640 1 --2- 172.21.15.96:0/1125696118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415f800 0x7fd2740b2cc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.648+0000 7fd27a200640 1 --2- 172.21.15.96:0/1125696118 >> v2:172.21.15.155:3300/0 conn(0x7fd27415b220 0x7fd274070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.648+0000 7fd27a200640 1 -- 172.21.15.96:0/1125696118 >> 172.21.15.96:0/1125696118 conn(0x7fd2740b19c0 msgr2=0x7fd2740b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:09.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.648+0000 7fd27a200640 1 -- 172.21.15.96:0/1125696118 shutdown_connections 2024-04-24T23:59:09.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.648+0000 7fd27a200640 1 -- 172.21.15.96:0/1125696118 wait complete. 2024-04-24T23:59:09.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.650+0000 7fd27a200640 1 Processor -- start 2024-04-24T23:59:09.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.650+0000 7fd27a200640 1 -- start start 2024-04-24T23:59:09.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd27a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27415b220 0x7fd274147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd27a200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415ec70 0x7fd2740b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd27a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27415f800 0x7fd2740b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd27a200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd27406ed10 con 0x7fd27415ec70 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd27a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd27406eb90 con 0x7fd27415b220 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd27a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd2740b3200 con 0x7fd27415f800 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd26aa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415ec70 0x7fd2740b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd26aa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415ec70 0x7fd2740b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37188/0 (socket says 172.21.15.96:37188) 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd26aa00640 1 -- 172.21.15.96:0/4052148712 learned_addr learned my addr 172.21.15.96:0/4052148712 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd273e00640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27415f800 0x7fd2740b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd273400640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27415b220 0x7fd274147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd26aa00640 1 -- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27415f800 msgr2=0x7fd2740b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd26aa00640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27415f800 0x7fd2740b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd26aa00640 1 -- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27415b220 msgr2=0x7fd274147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd26aa00640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27415b220 0x7fd274147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd26aa00640 1 -- 172.21.15.96:0/4052148712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd274147da0 con 0x7fd27415ec70 2024-04-24T23:59:09.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd273400640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27415b220 0x7fd274147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:09.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.651+0000 7fd273e00640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27415f800 0x7fd2740b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:09.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.652+0000 7fd26aa00640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415ec70 0x7fd2740b3e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00c410 tx=0x7fd25c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:09.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.652+0000 7fd26be00640 1 -- 172.21.15.96:0/4052148712 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c017070 con 0x7fd27415ec70 2024-04-24T23:59:09.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.652+0000 7fd26be00640 1 -- 172.21.15.96:0/4052148712 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25c0035f0 con 0x7fd27415ec70 2024-04-24T23:59:09.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.652+0000 7fd26be00640 1 -- 172.21.15.96:0/4052148712 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c003a20 con 0x7fd27415ec70 2024-04-24T23:59:09.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.652+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2741f59a0 con 0x7fd27415ec70 2024-04-24T23:59:09.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.652+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2741f5f60 con 0x7fd27415ec70 2024-04-24T23:59:09.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.653+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2741f6570 con 0x7fd27415ec70 2024-04-24T23:59:09.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.654+0000 7fd26be00640 1 -- 172.21.15.96:0/4052148712 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd25c01a070 con 0x7fd27415ec70 2024-04-24T23:59:09.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.655+0000 7fd26be00640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd25006be60 0x7fd25006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:09.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.655+0000 7fd26be00640 1 -- 172.21.15.96:0/4052148712 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd25c089fe0 con 0x7fd27415ec70 2024-04-24T23:59:09.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.655+0000 7fd273400640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd25006be60 0x7fd25006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:09.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.656+0000 7fd273400640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd25006be60 0x7fd25006e320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd264007f50 tx=0x7fd2640074a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:09.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.659+0000 7fd26be00640 1 -- 172.21.15.96:0/4052148712 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd25c058c40 con 0x7fd27415ec70 2024-04-24T23:59:09.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.911+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fd274069110 con 0x7fd27415ec70 2024-04-24T23:59:09.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.915+0000 7fd26be00640 1 -- 172.21.15.96:0/4052148712 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7fd25c0010c0 con 0x7fd27415ec70 2024-04-24T23:59:09.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd25006be60 msgr2=0x7fd25006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd25006be60 0x7fd25006e320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd264007f50 tx=0x7fd2640074a0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415ec70 msgr2=0x7fd2740b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:09.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415ec70 0x7fd2740b3e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00c410 tx=0x7fd25c00c8d0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 shutdown_connections 2024-04-24T23:59:09.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27415f800 0x7fd2740b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd25006be60 0x7fd25006e320 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd27415ec70 0x7fd2740b3e40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 --2- 172.21.15.96:0/4052148712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27415b220 0x7fd274147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:09.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.918+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 >> 172.21.15.96:0/4052148712 conn(0x7fd2740b19c0 msgr2=0x7fd274159cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:09.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.919+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 shutdown_connections 2024-04-24T23:59:09.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:09.919+0000 7fd27a200640 1 -- 172.21.15.96:0/4052148712 wait complete. 2024-04-24T23:59:09.937 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-24T23:59:10.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.136+0000 7f1359800640 1 Processor -- start 2024-04-24T23:59:10.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.136+0000 7f1359800640 1 -- start start 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.138+0000 7f1359800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 0x7f135406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.138+0000 7f1359800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f135406d0b0 0x7f1354070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.138+0000 7f1359800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13540b4fe0 con 0x7f1354071330 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.138+0000 7f1359800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f1354071780 con 0x7f135406d0b0 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.138+0000 7f1359800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f135406d5c0 con 0x7f135415cbf0 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.138+0000 7f134a000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f135406d0b0 0x7f1354070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.138+0000 7f134a000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f135406d0b0 0x7f1354070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37198/0 (socket says 172.21.15.96:37198) 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.138+0000 7f134a000640 1 -- 172.21.15.96:0/3598073408 learned_addr learned my addr 172.21.15.96:0/3598073408 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.139+0000 7f1352a00640 1 --2- 172.21.15.96:0/3598073408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 0x7f135406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.139+0000 7f134a000640 1 -- 172.21.15.96:0/3598073408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 msgr2=0x7f135406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.139+0000 7f134a000640 1 --2- 172.21.15.96:0/3598073408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 0x7f135406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.139+0000 7f134a000640 1 -- 172.21.15.96:0/3598073408 >> v1:172.21.15.155:6789/0 conn(0x7f1354071330 legacy=0x7f1354166220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.139+0000 7f134a000640 1 -- 172.21.15.96:0/3598073408 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135406d8a0 con 0x7f135406d0b0 2024-04-24T23:59:10.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.139+0000 7f1352a00640 1 --2- 172.21.15.96:0/3598073408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 0x7f135406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:10.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.140+0000 7f134a000640 1 --2- 172.21.15.96:0/3598073408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f135406d0b0 0x7f1354070df0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f133c009870 tx=0x7f133c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e698c5bc555c1b03 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:10.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.140+0000 7f1352000640 1 -- 172.21.15.96:0/3598073408 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c037070 con 0x7f135406d0b0 2024-04-24T23:59:10.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.140+0000 7f1352000640 1 -- 172.21.15.96:0/3598073408 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133c032440 con 0x7f135406d0b0 2024-04-24T23:59:10.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.140+0000 7f1352000640 1 -- 172.21.15.96:0/3598073408 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c032810 con 0x7f135406d0b0 2024-04-24T23:59:10.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.141+0000 7f1359800640 1 -- 172.21.15.96:0/3598073408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f135406d0b0 msgr2=0x7f1354070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.141+0000 7f1359800640 1 --2- 172.21.15.96:0/3598073408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f135406d0b0 0x7f1354070df0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f133c009870 tx=0x7f133c02a210 comp rx=0 tx=0).stop 2024-04-24T23:59:10.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.141+0000 7f1359800640 1 -- 172.21.15.96:0/3598073408 shutdown_connections 2024-04-24T23:59:10.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.141+0000 7f1359800640 1 --2- 172.21.15.96:0/3598073408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f135406d0b0 0x7f1354070df0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.141+0000 7f1359800640 1 --2- 172.21.15.96:0/3598073408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 0x7f135406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.141+0000 7f1359800640 1 -- 172.21.15.96:0/3598073408 >> 172.21.15.96:0/3598073408 conn(0x7f13540b19c0 msgr2=0x7f13540b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:10.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.141+0000 7f1359800640 1 -- 172.21.15.96:0/3598073408 shutdown_connections 2024-04-24T23:59:10.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.141+0000 7f1359800640 1 -- 172.21.15.96:0/3598073408 wait complete. 2024-04-24T23:59:10.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.143+0000 7f1359800640 1 Processor -- start 2024-04-24T23:59:10.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.143+0000 7f1359800640 1 -- start start 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f1359800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f135406d0b0 0x7f135415b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f1359800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1354071330 0x7f13540aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f1359800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 0x7f135409bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f1359800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f135406e660 con 0x7f1354071330 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f1359800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f135406de60 con 0x7f135406d0b0 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f1359800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f135415cfd0 con 0x7f135415cbf0 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f134a000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1354071330 0x7f13540aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f134a000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1354071330 0x7f13540aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37204/0 (socket says 172.21.15.96:37204) 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f134a000640 1 -- 172.21.15.96:0/3149081362 learned_addr learned my addr 172.21.15.96:0/3149081362 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f1352a00640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f135406d0b0 0x7f135415b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.144+0000 7f1353400640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 0x7f135409bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f134a000640 1 -- 172.21.15.96:0/3149081362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 msgr2=0x7f135409bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f134a000640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 0x7f135409bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f134a000640 1 -- 172.21.15.96:0/3149081362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f135406d0b0 msgr2=0x7f135415b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f134a000640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f135406d0b0 0x7f135415b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f134a000640 1 -- 172.21.15.96:0/3149081362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13540ae380 con 0x7f1354071330 2024-04-24T23:59:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f134a000640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1354071330 0x7f13540aeb40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f133c009870 tx=0x7f133c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:10.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f134b400640 1 -- 172.21.15.96:0/3149081362 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c041020 con 0x7f1354071330 2024-04-24T23:59:10.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f134b400640 1 -- 172.21.15.96:0/3149081362 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133c030970 con 0x7f1354071330 2024-04-24T23:59:10.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f134b400640 1 -- 172.21.15.96:0/3149081362 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c037040 con 0x7f1354071330 2024-04-24T23:59:10.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13540ae660 con 0x7f1354071330 2024-04-24T23:59:10.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.145+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135415b160 con 0x7f1354071330 2024-04-24T23:59:10.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.147+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1354069110 con 0x7f1354071330 2024-04-24T23:59:10.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.147+0000 7f134b400640 1 -- 172.21.15.96:0/3149081362 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f133c044020 con 0x7f1354071330 2024-04-24T23:59:10.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.148+0000 7f134b400640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f133006be30 0x7f133006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.148+0000 7f134b400640 1 -- 172.21.15.96:0/3149081362 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f133c0ab540 con 0x7f1354071330 2024-04-24T23:59:10.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.149+0000 7f1352a00640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f133006be30 0x7f133006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.149+0000 7f1352a00640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f133006be30 0x7f133006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f13540b0e70 tx=0x7f1344008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:10.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.153+0000 7f134b400640 1 -- 172.21.15.96:0/3149081362 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f133c04b030 con 0x7f1354071330 2024-04-24T23:59:10.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.405+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f135406e8d0 con 0x7f1354071330 2024-04-24T23:59:10.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.408+0000 7f134b400640 1 -- 172.21.15.96:0/3149081362 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f13540b4fe0 con 0x7f1354071330 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.411+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f133006be30 msgr2=0x7f133006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.411+0000 7f1359800640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f133006be30 0x7f133006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f13540b0e70 tx=0x7f1344008040 comp rx=0 tx=0).stop 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.411+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1354071330 msgr2=0x7f13540aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.411+0000 7f1359800640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1354071330 0x7f13540aeb40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f133c009870 tx=0x7f133c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.412+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 shutdown_connections 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.412+0000 7f1359800640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f135415cbf0 0x7f135409bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.412+0000 7f1359800640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f133006be30 0x7f133006e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.412+0000 7f1359800640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1354071330 0x7f13540aeb40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.412+0000 7f1359800640 1 --2- 172.21.15.96:0/3149081362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f135406d0b0 0x7f135415b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.412+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 >> 172.21.15.96:0/3149081362 conn(0x7f13540b19c0 msgr2=0x7f13540af910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:10.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.412+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 shutdown_connections 2024-04-24T23:59:10.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.412+0000 7f1359800640 1 -- 172.21.15.96:0/3149081362 wait complete. 2024-04-24T23:59:10.430 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-24T23:59:10.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.623+0000 7f6c48000640 1 Processor -- start 2024-04-24T23:59:10.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.623+0000 7f6c48000640 1 -- start start 2024-04-24T23:59:10.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.625+0000 7f6c48000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6c400af120 0x7f6c40071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.625+0000 7f6c48000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400acda0 0x7f6c4006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.625+0000 7f6c48000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c40160b20 con 0x7f6c4015c230 2024-04-24T23:59:10.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.625+0000 7f6c48000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4015c610 con 0x7f6c400af120 2024-04-24T23:59:10.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.625+0000 7f6c48000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6c400ad230 con 0x7f6c400acda0 2024-04-24T23:59:10.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.625+0000 7f6c45600640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6c4015c230 0x7f6c400aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37926/0 (socket says 172.21.15.96:37926) 2024-04-24T23:59:10.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.625+0000 7f6c45600640 1 -- 172.21.15.96:0/3597580290 learned_addr learned my addr 172.21.15.96:0/3597580290 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:10.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.625+0000 7f6c44c00640 1 --2- 172.21.15.96:0/3597580290 >> v2:172.21.15.96:3300/0 conn(0x7f6c400af120 0x7f6c40071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.626+0000 7f6c3fe00640 1 -- 172.21.15.96:0/3597580290 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870361382 0 0) 0x7f6c40160b20 con 0x7f6c4015c230 2024-04-24T23:59:10.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.626+0000 7f6c46000640 1 --2- 172.21.15.96:0/3597580290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400acda0 0x7f6c4006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.626+0000 7f6c3fe00640 1 -- 172.21.15.96:0/3597580290 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c28003520 con 0x7f6c4015c230 2024-04-24T23:59:10.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.626+0000 7f6c44c00640 1 -- 172.21.15.96:0/3597580290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400acda0 msgr2=0x7f6c4006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:10.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.626+0000 7f6c44c00640 1 --2- 172.21.15.96:0/3597580290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400acda0 0x7f6c4006cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.626+0000 7f6c44c00640 1 -- 172.21.15.96:0/3597580290 >> v1:172.21.15.96:6789/0 conn(0x7f6c4015c230 legacy=0x7f6c400aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.626+0000 7f6c44c00640 1 -- 172.21.15.96:0/3597580290 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4015fd60 con 0x7f6c400af120 2024-04-24T23:59:10.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.627+0000 7f6c44c00640 1 --2- 172.21.15.96:0/3597580290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400af120 0x7f6c40071800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0097a0 tx=0x7f6c2c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7052e848e8103a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:10.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.627+0000 7f6c3fe00640 1 -- 172.21.15.96:0/3597580290 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c037070 con 0x7f6c400af120 2024-04-24T23:59:10.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.627+0000 7f6c3fe00640 1 -- 172.21.15.96:0/3597580290 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2c032440 con 0x7f6c400af120 2024-04-24T23:59:10.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.627+0000 7f6c3fe00640 1 -- 172.21.15.96:0/3597580290 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c032810 con 0x7f6c400af120 2024-04-24T23:59:10.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.628+0000 7f6c48000640 1 -- 172.21.15.96:0/3597580290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400af120 msgr2=0x7f6c40071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.628+0000 7f6c48000640 1 --2- 172.21.15.96:0/3597580290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400af120 0x7f6c40071800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0097a0 tx=0x7f6c2c02a180 comp rx=0 tx=0).stop 2024-04-24T23:59:10.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.628+0000 7f6c48000640 1 -- 172.21.15.96:0/3597580290 shutdown_connections 2024-04-24T23:59:10.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.628+0000 7f6c48000640 1 --2- 172.21.15.96:0/3597580290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400acda0 0x7f6c4006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.628+0000 7f6c48000640 1 --2- 172.21.15.96:0/3597580290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400af120 0x7f6c40071800 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.628+0000 7f6c48000640 1 -- 172.21.15.96:0/3597580290 >> 172.21.15.96:0/3597580290 conn(0x7f6c400b19c0 msgr2=0x7f6c400b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:10.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.628+0000 7f6c48000640 1 -- 172.21.15.96:0/3597580290 shutdown_connections 2024-04-24T23:59:10.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.628+0000 7f6c48000640 1 -- 172.21.15.96:0/3597580290 wait complete. 2024-04-24T23:59:10.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.630+0000 7f6c48000640 1 Processor -- start 2024-04-24T23:59:10.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.630+0000 7f6c48000640 1 -- start start 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c48000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c400acda0 0x7f6c4009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c48000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400af120 0x7f6c4014e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c48000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4015c230 0x7f6c400c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c48000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40160600 con 0x7f6c4015c230 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c48000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40160320 con 0x7f6c400acda0 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c48000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6c400ad4d0 con 0x7f6c400af120 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c46000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4015c230 0x7f6c400c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c44c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400af120 0x7f6c4014e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c46000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4015c230 0x7f6c400c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37228/0 (socket says 172.21.15.96:37228) 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c46000640 1 -- 172.21.15.96:0/1795924545 learned_addr learned my addr 172.21.15.96:0/1795924545 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.631+0000 7f6c45600640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c400acda0 0x7f6c4009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c46000640 1 -- 172.21.15.96:0/1795924545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400af120 msgr2=0x7f6c4014e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c46000640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400af120 0x7f6c4014e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c46000640 1 -- 172.21.15.96:0/1795924545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c400acda0 msgr2=0x7f6c4009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c46000640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c400acda0 0x7f6c4009aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c46000640 1 -- 172.21.15.96:0/1795924545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4009b050 con 0x7f6c4015c230 2024-04-24T23:59:10.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c46000640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4015c230 0x7f6c400c9ac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6c38007dc0 tx=0x7f6c3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c3d600640 1 -- 172.21.15.96:0/1795924545 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38014420 con 0x7f6c4015c230 2024-04-24T23:59:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c3d600640 1 -- 172.21.15.96:0/1795924545 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c38019070 con 0x7f6c4015c230 2024-04-24T23:59:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c3d600640 1 -- 172.21.15.96:0/1795924545 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38014820 con 0x7f6c4015c230 2024-04-24T23:59:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4009b330 con 0x7f6c4015c230 2024-04-24T23:59:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.632+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4009b8f0 con 0x7f6c4015c230 2024-04-24T23:59:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.634+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c40069110 con 0x7f6c4015c230 2024-04-24T23:59:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.634+0000 7f6c3d600640 1 -- 172.21.15.96:0/1795924545 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c380149c0 con 0x7f6c4015c230 2024-04-24T23:59:10.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.635+0000 7f6c3d600640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6c2006be30 0x7f6c2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:10.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.635+0000 7f6c3d600640 1 -- 172.21.15.96:0/1795924545 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f6c3808b330 con 0x7f6c4015c230 2024-04-24T23:59:10.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.636+0000 7f6c45600640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6c2006be30 0x7f6c2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:10.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.636+0000 7f6c45600640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6c2006be30 0x7f6c2006e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c34005880 tx=0x7f6c34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:10.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.640+0000 7f6c3d600640 1 -- 172.21.15.96:0/1795924545 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6c38059f90 con 0x7f6c4015c230 2024-04-24T23:59:10.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.903+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f6c400cf710 con 0x7f6c4015c230 2024-04-24T23:59:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.908+0000 7f6c3d600640 1 -- 172.21.15.96:0/1795924545 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f6c38059890 con 0x7f6c4015c230 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6c2006be30 msgr2=0x7f6c2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6c2006be30 0x7f6c2006e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c34005880 tx=0x7f6c34009040 comp rx=0 tx=0).stop 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4015c230 msgr2=0x7f6c400c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4015c230 0x7f6c400c9ac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6c38007dc0 tx=0x7f6c3800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 shutdown_connections 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6c2006be30 0x7f6c2006e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4015c230 0x7f6c400c9ac0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c400af120 0x7f6c4014e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 --2- 172.21.15.96:0/1795924545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c400acda0 0x7f6c4009aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 >> 172.21.15.96:0/1795924545 conn(0x7f6c400b19c0 msgr2=0x7f6c4006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:10.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 shutdown_connections 2024-04-24T23:59:10.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:10.910+0000 7f6c48000640 1 -- 172.21.15.96:0/1795924545 wait complete. 2024-04-24T23:59:10.929 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-24T23:59:11.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.126+0000 7f7a82e00640 1 Processor -- start 2024-04-24T23:59:11.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.127+0000 7f7a82e00640 1 -- start start 2024-04-24T23:59:11.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.128+0000 7f7a82e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7a7c1553f0 0x7f7a7c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.129+0000 7f7a82e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7a7c071470 0x7f7a7c0cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.129+0000 7f7a82e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7c0ce100 con 0x7f7a7c0cdbd0 2024-04-24T23:59:11.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.129+0000 7f7a82e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7c0cf6e0 con 0x7f7a7c1553f0 2024-04-24T23:59:11.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.129+0000 7f7a82e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7c0ce3e0 con 0x7f7a7c071470 2024-04-24T23:59:11.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.129+0000 7f7a81a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7a7c1553f0 0x7f7a7c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.129+0000 7f7a81a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7a7c1553f0 0x7f7a7c15b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37230/0 (socket says 172.21.15.96:37230) 2024-04-24T23:59:11.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.129+0000 7f7a81a00640 1 -- 172.21.15.96:0/3436583380 learned_addr learned my addr 172.21.15.96:0/3436583380 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:11.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.129+0000 7f7a82400640 1 --2- 172.21.15.96:0/3436583380 >> v2:172.21.15.155:3300/0 conn(0x7f7a7c071470 0x7f7a7c0cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.130+0000 7f7a81a00640 1 -- 172.21.15.96:0/3436583380 >> v2:172.21.15.155:3300/0 conn(0x7f7a7c071470 msgr2=0x7f7a7c0cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:11.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.130+0000 7f7a81a00640 1 --2- 172.21.15.96:0/3436583380 >> v2:172.21.15.155:3300/0 conn(0x7f7a7c071470 0x7f7a7c0cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.130+0000 7f7a81a00640 1 -- 172.21.15.96:0/3436583380 >> v1:172.21.15.155:6789/0 conn(0x7f7a7c0cdbd0 legacy=0x7f7a7c070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:11.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.130+0000 7f7a81a00640 1 -- 172.21.15.96:0/3436583380 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c0ce6c0 con 0x7f7a7c1553f0 2024-04-24T23:59:11.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.131+0000 7f7a81a00640 1 --2- 172.21.15.96:0/3436583380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c1553f0 0x7f7a7c15b530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0731e0 tx=0x7f7a7002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbb4478202efaba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:11.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.131+0000 7f7a7be00640 1 -- 172.21.15.96:0/3436583380 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70036070 con 0x7f7a7c1553f0 2024-04-24T23:59:11.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.131+0000 7f7a7be00640 1 -- 172.21.15.96:0/3436583380 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a70031600 con 0x7f7a7c1553f0 2024-04-24T23:59:11.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.132+0000 7f7a7be00640 1 -- 172.21.15.96:0/3436583380 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a700319d0 con 0x7f7a7c1553f0 2024-04-24T23:59:11.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.132+0000 7f7a82e00640 1 -- 172.21.15.96:0/3436583380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c1553f0 msgr2=0x7f7a7c15b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.132+0000 7f7a82e00640 1 --2- 172.21.15.96:0/3436583380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c1553f0 0x7f7a7c15b530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0731e0 tx=0x7f7a7002a6f0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.132+0000 7f7a82e00640 1 -- 172.21.15.96:0/3436583380 shutdown_connections 2024-04-24T23:59:11.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.132+0000 7f7a82e00640 1 --2- 172.21.15.96:0/3436583380 >> v2:172.21.15.155:3300/0 conn(0x7f7a7c071470 0x7f7a7c0cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.132+0000 7f7a82e00640 1 --2- 172.21.15.96:0/3436583380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c1553f0 0x7f7a7c15b530 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.132+0000 7f7a82e00640 1 -- 172.21.15.96:0/3436583380 >> 172.21.15.96:0/3436583380 conn(0x7f7a7c0b1f10 msgr2=0x7f7a7c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:11.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.132+0000 7f7a82e00640 1 -- 172.21.15.96:0/3436583380 shutdown_connections 2024-04-24T23:59:11.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.132+0000 7f7a82e00640 1 -- 172.21.15.96:0/3436583380 wait complete. 2024-04-24T23:59:11.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.134+0000 7f7a82e00640 1 Processor -- start 2024-04-24T23:59:11.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.134+0000 7f7a82e00640 1 -- start start 2024-04-24T23:59:11.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.135+0000 7f7a82e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c071470 0x7f7a7c145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.135+0000 7f7a82e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a7c0cdbd0 0x7f7a7c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.135+0000 7f7a82e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a7c1553f0 0x7f7a7c14b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.135+0000 7f7a82e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c06cdb0 con 0x7f7a7c071470 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.135+0000 7f7a82e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c06cc30 con 0x7f7a7c1553f0 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.135+0000 7f7a82e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7c1557d0 con 0x7f7a7c0cdbd0 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.135+0000 7f7a81a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c071470 0x7f7a7c145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.135+0000 7f7a81a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c071470 0x7f7a7c145c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37234/0 (socket says 172.21.15.96:37234) 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.135+0000 7f7a81a00640 1 -- 172.21.15.96:0/3925987401 learned_addr learned my addr 172.21.15.96:0/3925987401 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a81a00640 1 -- 172.21.15.96:0/3925987401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a7c0cdbd0 msgr2=0x7f7a7c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a81a00640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a7c0cdbd0 0x7f7a7c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a81a00640 1 -- 172.21.15.96:0/3925987401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a7c1553f0 msgr2=0x7f7a7c14b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a81a00640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a7c1553f0 0x7f7a7c14b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a81a00640 1 -- 172.21.15.96:0/3925987401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c0adeb0 con 0x7f7a7c071470 2024-04-24T23:59:11.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a81a00640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c071470 0x7f7a7c145c20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7a70034040 tx=0x7f7a70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:11.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a79600640 1 -- 172.21.15.96:0/3925987401 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70036050 con 0x7f7a7c071470 2024-04-24T23:59:11.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a79600640 1 -- 172.21.15.96:0/3925987401 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a70042070 con 0x7f7a7c071470 2024-04-24T23:59:11.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a79600640 1 -- 172.21.15.96:0/3925987401 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70009510 con 0x7f7a7c071470 2024-04-24T23:59:11.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7c0ae170 con 0x7f7a7c071470 2024-04-24T23:59:11.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.136+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7c0ae730 con 0x7f7a7c071470 2024-04-24T23:59:11.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.138+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a7c067e40 con 0x7f7a7c071470 2024-04-24T23:59:11.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.138+0000 7f7a79600640 1 -- 172.21.15.96:0/3925987401 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a70007c50 con 0x7f7a7c071470 2024-04-24T23:59:11.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.139+0000 7f7a79600640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7a5c06be30 0x7f7a5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.139+0000 7f7a79600640 1 -- 172.21.15.96:0/3925987401 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f7a700abb00 con 0x7f7a7c071470 2024-04-24T23:59:11.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.139+0000 7f7a81000640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7a5c06be30 0x7f7a5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.140+0000 7f7a81000640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7a5c06be30 0x7f7a5c06e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c1f5210 tx=0x7f7a680079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:11.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.144+0000 7f7a79600640 1 -- 172.21.15.96:0/3925987401 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7a7007a110 con 0x7f7a7c071470 2024-04-24T23:59:11.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.393+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f7a7c0756b0 con 0x7f7a7c071470 2024-04-24T23:59:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.397+0000 7f7a79600640 1 -- 172.21.15.96:0/3925987401 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f7a7007e410 con 0x7f7a7c071470 2024-04-24T23:59:11.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.399+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7a5c06be30 msgr2=0x7f7a5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.399+0000 7f7a82e00640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7a5c06be30 0x7f7a5c06e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c1f5210 tx=0x7f7a680079b0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.399+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c071470 msgr2=0x7f7a7c145c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.399+0000 7f7a82e00640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c071470 0x7f7a7c145c20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7a70034040 tx=0x7f7a70004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:11.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.400+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 shutdown_connections 2024-04-24T23:59:11.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.400+0000 7f7a82e00640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a7c1553f0 0x7f7a7c14b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.400+0000 7f7a82e00640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a7c0cdbd0 0x7f7a7c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.400+0000 7f7a82e00640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7a5c06be30 0x7f7a5c06e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.400+0000 7f7a82e00640 1 --2- 172.21.15.96:0/3925987401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c071470 0x7f7a7c145c20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.400+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 >> 172.21.15.96:0/3925987401 conn(0x7f7a7c0b1f10 msgr2=0x7f7a7c15b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:11.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.400+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 shutdown_connections 2024-04-24T23:59:11.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.400+0000 7f7a82e00640 1 -- 172.21.15.96:0/3925987401 wait complete. 2024-04-24T23:59:11.417 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-24T23:59:11.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.601+0000 7faeee400640 1 Processor -- start 2024-04-24T23:59:11.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.601+0000 7faeee400640 1 -- start start 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.603+0000 7faeee400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faee815c460 0x7faee806fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.603+0000 7faeee400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee806b0c0 0x7faee806b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.603+0000 7faeee400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee80704b0 con 0x7faee815c080 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.603+0000 7faeee400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7faee8070a70 con 0x7faee815c460 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.603+0000 7faeee400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faee8070790 con 0x7faee806b0c0 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.603+0000 7faee7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faee815c460 0x7faee806fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.603+0000 7faee7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faee815c460 0x7faee806fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37250/0 (socket says 172.21.15.96:37250) 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.603+0000 7faee7e00640 1 -- 172.21.15.96:0/2750662550 learned_addr learned my addr 172.21.15.96:0/2750662550 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.603+0000 7faeeda00640 1 --2- 172.21.15.96:0/2750662550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee806b0c0 0x7faee806b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.604+0000 7faee7e00640 1 -- 172.21.15.96:0/2750662550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee806b0c0 msgr2=0x7faee806b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.604+0000 7faee7e00640 1 --2- 172.21.15.96:0/2750662550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee806b0c0 0x7faee806b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.604+0000 7faee7e00640 1 -- 172.21.15.96:0/2750662550 >> v1:172.21.15.155:6789/0 conn(0x7faee815c080 legacy=0x7faee806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:11.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.604+0000 7faee7e00640 1 -- 172.21.15.96:0/2750662550 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee80cdb00 con 0x7faee815c460 2024-04-24T23:59:11.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.605+0000 7faee7e00640 1 --2- 172.21.15.96:0/2750662550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee815c460 0x7faee806fed0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faed4009870 tx=0x7faed402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e5251cb83dfa33 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:11.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.605+0000 7faee7400640 1 -- 172.21.15.96:0/2750662550 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4037070 con 0x7faee815c460 2024-04-24T23:59:11.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.605+0000 7faee7400640 1 -- 172.21.15.96:0/2750662550 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed4032440 con 0x7faee815c460 2024-04-24T23:59:11.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.605+0000 7faee7400640 1 -- 172.21.15.96:0/2750662550 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4032810 con 0x7faee815c460 2024-04-24T23:59:11.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.606+0000 7faeee400640 1 -- 172.21.15.96:0/2750662550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee815c460 msgr2=0x7faee806fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.606+0000 7faeee400640 1 --2- 172.21.15.96:0/2750662550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee815c460 0x7faee806fed0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faed4009870 tx=0x7faed402a180 comp rx=0 tx=0).stop 2024-04-24T23:59:11.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.606+0000 7faeee400640 1 -- 172.21.15.96:0/2750662550 shutdown_connections 2024-04-24T23:59:11.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.606+0000 7faeee400640 1 --2- 172.21.15.96:0/2750662550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee806b0c0 0x7faee806b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.606+0000 7faeee400640 1 --2- 172.21.15.96:0/2750662550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee815c460 0x7faee806fed0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.606+0000 7faeee400640 1 -- 172.21.15.96:0/2750662550 >> 172.21.15.96:0/2750662550 conn(0x7faee806de70 msgr2=0x7faee806e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:11.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.606+0000 7faeee400640 1 -- 172.21.15.96:0/2750662550 shutdown_connections 2024-04-24T23:59:11.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.606+0000 7faeee400640 1 -- 172.21.15.96:0/2750662550 wait complete. 2024-04-24T23:59:11.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.608+0000 7faeee400640 1 Processor -- start 2024-04-24T23:59:11.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.608+0000 7faeee400640 1 -- start start 2024-04-24T23:59:11.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeee400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee806b0c0 0x7faee8149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeee400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee815c080 0x7faee8152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeee400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee815c460 0x7faee81e5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeee400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7faee80ce480 con 0x7faee806b0c0 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeee400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faee80ce300 con 0x7faee815c460 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeee400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faee80ce600 con 0x7faee815c080 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeed000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee806b0c0 0x7faee8149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeed000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee806b0c0 0x7faee8149aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37258/0 (socket says 172.21.15.96:37258) 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeed000640 1 -- 172.21.15.96:0/162662717 learned_addr learned my addr 172.21.15.96:0/162662717 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faeeda00640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee815c460 0x7faee81e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.609+0000 7faee7e00640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee815c080 0x7faee8152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faeed000640 1 -- 172.21.15.96:0/162662717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee815c080 msgr2=0x7faee8152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faeed000640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee815c080 0x7faee8152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faeed000640 1 -- 172.21.15.96:0/162662717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee815c460 msgr2=0x7faee81e5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faeed000640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee815c460 0x7faee81e5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faeed000640 1 -- 172.21.15.96:0/162662717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee80b43a0 con 0x7faee806b0c0 2024-04-24T23:59:11.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faeed000640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee806b0c0 0x7faee8149aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faedc00c430 tx=0x7faedc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:11.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faee4c00640 1 -- 172.21.15.96:0/162662717 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc011790 con 0x7faee806b0c0 2024-04-24T23:59:11.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faee4c00640 1 -- 172.21.15.96:0/162662717 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faedc017070 con 0x7faee806b0c0 2024-04-24T23:59:11.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faee4c00640 1 -- 172.21.15.96:0/162662717 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc011bb0 con 0x7faee806b0c0 2024-04-24T23:59:11.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee80b4640 con 0x7faee806b0c0 2024-04-24T23:59:11.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.610+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee8149fe0 con 0x7faee806b0c0 2024-04-24T23:59:11.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.611+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee80756b0 con 0x7faee806b0c0 2024-04-24T23:59:11.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.612+0000 7faee4c00640 1 -- 172.21.15.96:0/162662717 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faedc01c460 con 0x7faee806b0c0 2024-04-24T23:59:11.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.613+0000 7faee4c00640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7faec806be30 0x7faec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:11.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.613+0000 7faee4c00640 1 -- 172.21.15.96:0/162662717 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7faedc08a960 con 0x7faee806b0c0 2024-04-24T23:59:11.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.614+0000 7faee7e00640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7faec806be30 0x7faec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:11.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.614+0000 7faee7e00640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7faec806be30 0x7faec806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faed4034000 tx=0x7faed402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:11.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.618+0000 7faee4c00640 1 -- 172.21.15.96:0/162662717 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faedc0596f0 con 0x7faee806b0c0 2024-04-24T23:59:11.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.884+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7faee806be50 con 0x7faee806b0c0 2024-04-24T23:59:11.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.889+0000 7faee4c00640 1 -- 172.21.15.96:0/162662717 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7faedc058ff0 con 0x7faee806b0c0 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.891+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7faec806be30 msgr2=0x7faec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.891+0000 7faeee400640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7faec806be30 0x7faec806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faed4034000 tx=0x7faed402e000 comp rx=0 tx=0).stop 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.891+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee806b0c0 msgr2=0x7faee8149aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.891+0000 7faeee400640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee806b0c0 0x7faee8149aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faedc00c430 tx=0x7faedc00c8f0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.892+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 shutdown_connections 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.892+0000 7faeee400640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee815c460 0x7faee81e5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.892+0000 7faeee400640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee815c080 0x7faee8152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.892+0000 7faeee400640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7faec806be30 0x7faec806e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.892+0000 7faeee400640 1 --2- 172.21.15.96:0/162662717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee806b0c0 0x7faee8149aa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.892+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 >> 172.21.15.96:0/162662717 conn(0x7faee806de70 msgr2=0x7faee80cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:11.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.892+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 shutdown_connections 2024-04-24T23:59:11.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:11.892+0000 7faeee400640 1 -- 172.21.15.96:0/162662717 wait complete. 2024-04-24T23:59:11.911 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:12.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.095+0000 7f04d6600640 1 Processor -- start 2024-04-24T23:59:12.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.095+0000 7f04d6600640 1 -- start start 2024-04-24T23:59:12.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04d6600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f04d015f6b0 0x7f04d00ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04d6600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04d00b4ec0 0x7f04d00cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04d6600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d00ccc20 0x7f04d015fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04d6600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f04d00b4a30 con 0x7f04d015f6b0 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04d6600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f04d015fa90 con 0x7f04d00b4ec0 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04d6600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f04d00b3e20 con 0x7f04d00ccc20 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04d5200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f04d015f6b0 0x7f04d00ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04d5200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f04d015f6b0 0x7f04d00ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37266/0 (socket says 172.21.15.96:37266) 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04d5200640 1 -- 172.21.15.96:0/1587121077 learned_addr learned my addr 172.21.15.96:0/1587121077 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.097+0000 7f04cfe00640 1 --2- 172.21.15.96:0/1587121077 >> v2:172.21.15.155:3300/0 conn(0x7f04d00b4ec0 0x7f04d00cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.098+0000 7f04d5c00640 1 --2- 172.21.15.96:0/1587121077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d00ccc20 0x7f04d015fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.098+0000 7f04d5200640 1 -- 172.21.15.96:0/1587121077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d00ccc20 msgr2=0x7f04d015fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:12.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.098+0000 7f04d5200640 1 --2- 172.21.15.96:0/1587121077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d00ccc20 0x7f04d015fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.098+0000 7f04d5200640 1 -- 172.21.15.96:0/1587121077 >> v2:172.21.15.155:3300/0 conn(0x7f04d00b4ec0 msgr2=0x7f04d00cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.098+0000 7f04d5200640 1 --2- 172.21.15.96:0/1587121077 >> v2:172.21.15.155:3300/0 conn(0x7f04d00b4ec0 0x7f04d00cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.098+0000 7f04d5200640 1 -- 172.21.15.96:0/1587121077 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d00b4100 con 0x7f04d015f6b0 2024-04-24T23:59:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.100+0000 7f04d5200640 1 --2- 172.21.15.96:0/1587121077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d015f6b0 0x7f04d00ce5e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04d00af6a0 tx=0x7f04c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7269acb3261aa62 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.100+0000 7f04cf400640 1 -- 172.21.15.96:0/1587121077 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4037070 con 0x7f04d015f6b0 2024-04-24T23:59:12.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.100+0000 7f04cf400640 1 -- 172.21.15.96:0/1587121077 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c4032440 con 0x7f04d015f6b0 2024-04-24T23:59:12.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.100+0000 7f04cf400640 1 -- 172.21.15.96:0/1587121077 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4032810 con 0x7f04d015f6b0 2024-04-24T23:59:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.101+0000 7f04d6600640 1 -- 172.21.15.96:0/1587121077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d015f6b0 msgr2=0x7f04d00ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.101+0000 7f04d6600640 1 --2- 172.21.15.96:0/1587121077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d015f6b0 0x7f04d00ce5e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04d00af6a0 tx=0x7f04c402a1e0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.101+0000 7f04d6600640 1 -- 172.21.15.96:0/1587121077 shutdown_connections 2024-04-24T23:59:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.101+0000 7f04d6600640 1 --2- 172.21.15.96:0/1587121077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d00ccc20 0x7f04d015fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.101+0000 7f04d6600640 1 --2- 172.21.15.96:0/1587121077 >> v2:172.21.15.155:3300/0 conn(0x7f04d00b4ec0 0x7f04d00cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.101+0000 7f04d6600640 1 --2- 172.21.15.96:0/1587121077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d015f6b0 0x7f04d00ce5e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.101+0000 7f04d6600640 1 -- 172.21.15.96:0/1587121077 >> 172.21.15.96:0/1587121077 conn(0x7f04d00b1f10 msgr2=0x7f04d00cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.101+0000 7f04d6600640 1 -- 172.21.15.96:0/1587121077 shutdown_connections 2024-04-24T23:59:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.101+0000 7f04d6600640 1 -- 172.21.15.96:0/1587121077 wait complete. 2024-04-24T23:59:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.103+0000 7f04d6600640 1 Processor -- start 2024-04-24T23:59:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.103+0000 7f04d6600640 1 -- start start 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.104+0000 7f04d6600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d00b4ec0 0x7f04d00afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.104+0000 7f04d6600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d00ccc20 0x7f04d0153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.104+0000 7f04d6600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04d015f6b0 0x7f04d0154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.104+0000 7f04d6600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f04d00ceb20 con 0x7f04d00ccc20 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.104+0000 7f04d6600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f04d00b46c0 con 0x7f04d015f6b0 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.104+0000 7f04d6600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f04d00cf1c0 con 0x7f04d00b4ec0 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.104+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d00ccc20 0x7f04d0153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.104+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d00ccc20 0x7f04d0153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37278/0 (socket says 172.21.15.96:37278) 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.104+0000 7f04cfe00640 1 -- 172.21.15.96:0/462742373 learned_addr learned my addr 172.21.15.96:0/462742373 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04cfe00640 1 -- 172.21.15.96:0/462742373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d00b4ec0 msgr2=0x7f04d00afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04cfe00640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d00b4ec0 0x7f04d00afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04cfe00640 1 -- 172.21.15.96:0/462742373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04d015f6b0 msgr2=0x7f04d0154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04cfe00640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04d015f6b0 0x7f04d0154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04cfe00640 1 -- 172.21.15.96:0/462742373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d00c9e70 con 0x7f04d00ccc20 2024-04-24T23:59:12.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04cfe00640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d00ccc20 0x7f04d0153320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00e840 tx=0x7f04bc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:12.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04ccc00640 1 -- 172.21.15.96:0/462742373 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc017070 con 0x7f04d00ccc20 2024-04-24T23:59:12.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04ccc00640 1 -- 172.21.15.96:0/462742373 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc00c730 con 0x7f04d00ccc20 2024-04-24T23:59:12.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04ccc00640 1 -- 172.21.15.96:0/462742373 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00cb20 con 0x7f04d00ccc20 2024-04-24T23:59:12.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.105+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d00ca150 con 0x7f04d00ccc20 2024-04-24T23:59:12.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.106+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d00ca710 con 0x7f04d00ccc20 2024-04-24T23:59:12.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.106+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d0067e40 con 0x7f04d00ccc20 2024-04-24T23:59:12.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.107+0000 7f04ccc00640 1 -- 172.21.15.96:0/462742373 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04bc01a070 con 0x7f04d00ccc20 2024-04-24T23:59:12.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.108+0000 7f04ccc00640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f04b006be30 0x7f04b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.108+0000 7f04ccc00640 1 -- 172.21.15.96:0/462742373 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f04bc08ac90 con 0x7f04d00ccc20 2024-04-24T23:59:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.109+0000 7f04d5200640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f04b006be30 0x7f04b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.109+0000 7f04d5200640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f04b006be30 0x7f04b006e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f04c4034000 tx=0x7f04c402c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.112+0000 7f04ccc00640 1 -- 172.21.15.96:0/462742373 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f04bc059980 con 0x7f04d00ccc20 2024-04-24T23:59:12.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.296+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04d00d07d0 con 0x7f04d00ccc20 2024-04-24T23:59:12.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.298+0000 7f04ccc00640 1 -- 172.21.15.96:0/462742373 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+12843 (secure 0 0 0) 0x7f04bc059280 con 0x7f04d00ccc20 2024-04-24T23:59:12.298 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:12.298 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":29,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:08.444421+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f04b006be30 msgr2=0x7f04b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f04b006be30 0x7f04b006e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f04c4034000 tx=0x7f04c402c000 comp rx=0 tx=0).stop 2024-04-24T23:59:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d00ccc20 msgr2=0x7f04d0153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d00ccc20 0x7f04d0153320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00e840 tx=0x7f04bc00ed00 comp rx=0 tx=0).stop 2024-04-24T23:59:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 shutdown_connections 2024-04-24T23:59:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04d015f6b0 0x7f04d0154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f04b006be30 0x7f04b006e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d00ccc20 0x7f04d0153320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 --2- 172.21.15.96:0/462742373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04d00b4ec0 0x7f04d00afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.300+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 >> 172.21.15.96:0/462742373 conn(0x7f04d00b1f10 msgr2=0x7f04d015fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.301+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 shutdown_connections 2024-04-24T23:59:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.301+0000 7f04d6600640 1 -- 172.21.15.96:0/462742373 wait complete. 2024-04-24T23:59:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:59:12.318 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:59:12.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.513+0000 7f94b3e00640 1 Processor -- start 2024-04-24T23:59:12.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.513+0000 7f94b3e00640 1 -- start start 2024-04-24T23:59:12.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94b3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b413ef60 0x7f94b415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94b3e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94b41415d0 0x7f94b4141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94b3e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94b40ce620 con 0x7f94b40cf3e0 2024-04-24T23:59:12.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94b3e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f94b40ce900 con 0x7f94b41415d0 2024-04-24T23:59:12.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94b3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94b40cebe0 con 0x7f94b413ef60 2024-04-24T23:59:12.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94abe00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f94b40cf3e0 0x7f94b40cc5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37936/0 (socket says 172.21.15.96:37936) 2024-04-24T23:59:12.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94abe00640 1 -- 172.21.15.96:0/419420078 learned_addr learned my addr 172.21.15.96:0/419420078 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94b2a00640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b413ef60 0x7f94b415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94b3400640 1 --2- 172.21.15.96:0/419420078 >> v2:172.21.15.155:3300/0 conn(0x7f94b41415d0 0x7f94b4141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763868648 0 0) 0x7f94b40ce620 con 0x7f94b40cf3e0 2024-04-24T23:59:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.515+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9498003520 con 0x7f94b40cf3e0 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 676633743 0 0) 0x7f9498003520 con 0x7f94b40cf3e0 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b413ef60 msgr2=0x7f94b415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b413ef60 0x7f94b415cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 >> v2:172.21.15.155:3300/0 conn(0x7f94b41415d0 msgr2=0x7f94b4141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 --2- 172.21.15.96:0/419420078 >> v2:172.21.15.155:3300/0 conn(0x7f94b41415d0 0x7f94b4141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b40ce240 con 0x7f94b40cf3e0 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f949c001670 con 0x7f94b40cf3e0 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 >> v1:172.21.15.96:6789/0 conn(0x7f94b40cf3e0 legacy=0x7f94b40cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94980039b0 0x7f9498003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b413ef60 0x7f9498004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9498004d40 0x7f94980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f94b40ce900 con 0x7f9498004d40 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94b40cebe0 con 0x7f94980039b0 2024-04-24T23:59:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f949800b9c0 con 0x7f94b413ef60 2024-04-24T23:59:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.516+0000 7f94b3400640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9498004d40 0x7f94980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.517+0000 7f94abe00640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b413ef60 0x7f9498004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.517+0000 7f94b2a00640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94980039b0 0x7f9498003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.517+0000 7f94b3400640 1 -- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b413ef60 msgr2=0x7f9498004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.517+0000 7f94b3400640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b413ef60 0x7f9498004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.517+0000 7f94b3400640 1 -- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94980039b0 msgr2=0x7f9498003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.517+0000 7f94b3400640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94980039b0 0x7f9498003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.517+0000 7f94b3400640 1 -- 172.21.15.96:0/419420078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9498003520 con 0x7f9498004d40 2024-04-24T23:59:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.518+0000 7f94b3400640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9498004d40 0x7f94980051c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f94ac007390 tx=0x7f9498005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45f14e36b2f8c88 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.518+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac009be0 con 0x7f9498004d40 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.518+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac02e640 con 0x7f9498004d40 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.518+0000 7f94b2000640 1 -- 172.21.15.96:0/419420078 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac02ea10 con 0x7f9498004d40 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.518+0000 7f94b3e00640 1 -- 172.21.15.96:0/419420078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9498004d40 msgr2=0x7f94980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.518+0000 7f94b3e00640 1 --2- 172.21.15.96:0/419420078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9498004d40 0x7f94980051c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f94ac007390 tx=0x7f9498005830 comp rx=0 tx=0).stop 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.518+0000 7f94b3400640 1 -- 172.21.15.96:0/419420078 reap_dead start 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.519+0000 7f94b3e00640 1 -- 172.21.15.96:0/419420078 shutdown_connections 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.519+0000 7f94b3e00640 1 -- 172.21.15.96:0/419420078 >> 172.21.15.96:0/419420078 conn(0x7f94b40b18b0 msgr2=0x7f94b40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.519+0000 7f94b3e00640 1 -- 172.21.15.96:0/419420078 shutdown_connections 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.519+0000 7f94b3e00640 1 -- 172.21.15.96:0/419420078 wait complete. 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.520+0000 7f94b3e00640 1 Processor -- start 2024-04-24T23:59:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.521+0000 7f94b3e00640 1 -- start start 2024-04-24T23:59:12.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.521+0000 7f94b3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9498004d40 0x7f94b4166d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.521+0000 7f94b3e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b4071f90 0x7f94b4072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b413d000 0x7f94b413d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f94b415d160 con 0x7f94b413d000 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94b415cfe0 con 0x7f94b4071f90 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94b415d2e0 con 0x7f9498004d40 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b413d000 0x7f94b413d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b413d000 0x7f94b413d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37288/0 (socket says 172.21.15.96:37288) 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3400640 1 -- 172.21.15.96:0/2994084749 learned_addr learned my addr 172.21.15.96:0/2994084749 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b2a00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9498004d40 0x7f94b4166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94abe00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b4071f90 0x7f94b4072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3400640 1 -- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9498004d40 msgr2=0x7f94b4166d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3400640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9498004d40 0x7f94b4166d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3400640 1 -- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b4071f90 msgr2=0x7f94b4072410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3400640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b4071f90 0x7f94b4072410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b3400640 1 -- 172.21.15.96:0/2994084749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b413dbe0 con 0x7f94b413d000 2024-04-24T23:59:12.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94abe00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b4071f90 0x7f94b4072410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.522+0000 7f94b2a00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9498004d40 0x7f94b4166d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.523+0000 7f94b3400640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b413d000 0x7f94b413d480 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0074b0 tx=0x7f94ac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.523+0000 7f94aaa00640 1 -- 172.21.15.96:0/2994084749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac009be0 con 0x7f94b413d000 2024-04-24T23:59:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.523+0000 7f94aaa00640 1 -- 172.21.15.96:0/2994084749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac02e440 con 0x7f94b413d000 2024-04-24T23:59:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.523+0000 7f94aaa00640 1 -- 172.21.15.96:0/2994084749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac038280 con 0x7f94b413d000 2024-04-24T23:59:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.523+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b413dec0 con 0x7f94b413d000 2024-04-24T23:59:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.523+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b413e480 con 0x7f94b413d000 2024-04-24T23:59:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.524+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b4072950 con 0x7f94b413d000 2024-04-24T23:59:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.525+0000 7f94aaa00640 1 -- 172.21.15.96:0/2994084749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94ac038890 con 0x7f94b413d000 2024-04-24T23:59:12.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.526+0000 7f94aaa00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f949006be30 0x7f949006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.527+0000 7f94aaa00640 1 -- 172.21.15.96:0/2994084749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f94ac0ab2c0 con 0x7f94b413d000 2024-04-24T23:59:12.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.527+0000 7f94b2a00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f949006be30 0x7f949006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.527+0000 7f94b2a00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f949006be30 0x7f949006e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f94b4139020 tx=0x7f94a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:12.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.531+0000 7f94aaa00640 1 -- 172.21.15.96:0/2994084749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f94ac032030 con 0x7f94b413d000 2024-04-24T23:59:12.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.726+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f94b40755d0 con 0x7f94b413d000 2024-04-24T23:59:12.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.727+0000 7f94aaa00640 1 -- 172.21.15.96:0/2994084749 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f94ac079f20 con 0x7f94b413d000 2024-04-24T23:59:12.728 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:59:12.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f949006be30 msgr2=0x7f949006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f949006be30 0x7f949006e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f94b4139020 tx=0x7f94a4008040 comp rx=0 tx=0).stop 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b413d000 msgr2=0x7f94b413d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b413d000 0x7f94b413d480 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0074b0 tx=0x7f94ac004ab0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 shutdown_connections 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f949006be30 0x7f949006e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b413d000 0x7f94b413d480 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b4071f90 0x7f94b4072410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 --2- 172.21.15.96:0/2994084749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9498004d40 0x7f94b4166d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.730+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 >> 172.21.15.96:0/2994084749 conn(0x7f94b40b18b0 msgr2=0x7f94b415f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.731+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 shutdown_connections 2024-04-24T23:59:12.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.731+0000 7f94b3e00640 1 -- 172.21.15.96:0/2994084749 wait complete. 2024-04-24T23:59:12.751 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T23:59:12.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.949+0000 7fe827600640 1 Processor -- start 2024-04-24T23:59:12.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.949+0000 7fe827600640 1 -- start start 2024-04-24T23:59:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.951+0000 7fe827600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe8200af120 0x7fe820071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.951+0000 7fe827600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8200acda0 0x7fe82006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.951+0000 7fe827600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe820160b20 con 0x7fe82015c230 2024-04-24T23:59:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.951+0000 7fe827600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe82015c610 con 0x7fe8200af120 2024-04-24T23:59:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.951+0000 7fe827600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe8200ad230 con 0x7fe8200acda0 2024-04-24T23:59:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.951+0000 7fe817e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe8200af120 0x7fe820071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.951+0000 7fe817e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe8200af120 0x7fe820071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37296/0 (socket says 172.21.15.96:37296) 2024-04-24T23:59:12.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.951+0000 7fe817e00640 1 -- 172.21.15.96:0/327418100 learned_addr learned my addr 172.21.15.96:0/327418100 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.951+0000 7fe825600640 1 --2- 172.21.15.96:0/327418100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8200acda0 0x7fe82006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.952+0000 7fe817e00640 1 -- 172.21.15.96:0/327418100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8200acda0 msgr2=0x7fe82006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.952+0000 7fe817e00640 1 --2- 172.21.15.96:0/327418100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8200acda0 0x7fe82006cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.952+0000 7fe817e00640 1 -- 172.21.15.96:0/327418100 >> v1:172.21.15.155:6789/0 conn(0x7fe82015c230 legacy=0x7fe8200aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.952+0000 7fe817e00640 1 -- 172.21.15.96:0/327418100 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82015fd60 con 0x7fe8200af120 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.952+0000 7fe825600640 1 --2- 172.21.15.96:0/327418100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8200acda0 0x7fe82006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.953+0000 7fe817e00640 1 --2- 172.21.15.96:0/327418100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200af120 0x7fe820071800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe808009870 tx=0x7fe80802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eedcd9900f410c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.953+0000 7fe81fe00640 1 -- 172.21.15.96:0/327418100 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808037070 con 0x7fe8200af120 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.953+0000 7fe81fe00640 1 -- 172.21.15.96:0/327418100 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808032440 con 0x7fe8200af120 2024-04-24T23:59:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.953+0000 7fe81fe00640 1 -- 172.21.15.96:0/327418100 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808032810 con 0x7fe8200af120 2024-04-24T23:59:12.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.953+0000 7fe827600640 1 -- 172.21.15.96:0/327418100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200af120 msgr2=0x7fe820071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.953+0000 7fe827600640 1 --2- 172.21.15.96:0/327418100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200af120 0x7fe820071800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe808009870 tx=0x7fe80802a210 comp rx=0 tx=0).stop 2024-04-24T23:59:12.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.954+0000 7fe827600640 1 -- 172.21.15.96:0/327418100 shutdown_connections 2024-04-24T23:59:12.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.954+0000 7fe827600640 1 --2- 172.21.15.96:0/327418100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8200acda0 0x7fe82006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.954+0000 7fe827600640 1 --2- 172.21.15.96:0/327418100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200af120 0x7fe820071800 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.954+0000 7fe827600640 1 -- 172.21.15.96:0/327418100 >> 172.21.15.96:0/327418100 conn(0x7fe8200b19c0 msgr2=0x7fe8200b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:12.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.954+0000 7fe827600640 1 -- 172.21.15.96:0/327418100 shutdown_connections 2024-04-24T23:59:12.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.954+0000 7fe827600640 1 -- 172.21.15.96:0/327418100 wait complete. 2024-04-24T23:59:12.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.955+0000 7fe827600640 1 Processor -- start 2024-04-24T23:59:12.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.955+0000 7fe827600640 1 -- start start 2024-04-24T23:59:12.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.956+0000 7fe827600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200acda0 0x7fe820159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.956+0000 7fe827600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8200af120 0x7fe8200c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.956+0000 7fe827600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82015c230 0x7fe8200cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.956+0000 7fe827600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe820160600 con 0x7fe8200acda0 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.956+0000 7fe827600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe820160320 con 0x7fe8200af120 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.957+0000 7fe827600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe8200ad4d0 con 0x7fe82015c230 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.957+0000 7fe824c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200acda0 0x7fe820159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.957+0000 7fe824c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200acda0 0x7fe820159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37302/0 (socket says 172.21.15.96:37302) 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.957+0000 7fe824c00640 1 -- 172.21.15.96:0/257948054 learned_addr learned my addr 172.21.15.96:0/257948054 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.957+0000 7fe824c00640 1 -- 172.21.15.96:0/257948054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82015c230 msgr2=0x7fe8200cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.957+0000 7fe824c00640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82015c230 0x7fe8200cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.957+0000 7fe824c00640 1 -- 172.21.15.96:0/257948054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8200af120 msgr2=0x7fe8200c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.957+0000 7fe824c00640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8200af120 0x7fe8200c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.957+0000 7fe824c00640 1 -- 172.21.15.96:0/257948054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82015dbc0 con 0x7fe8200acda0 2024-04-24T23:59:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.958+0000 7fe824c00640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200acda0 0x7fe820159860 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b3f0 tx=0x7fe81000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:12.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.958+0000 7fe81d600640 1 -- 172.21.15.96:0/257948054 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810015020 con 0x7fe8200acda0 2024-04-24T23:59:12.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.958+0000 7fe81d600640 1 -- 172.21.15.96:0/257948054 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe810011830 con 0x7fe8200acda0 2024-04-24T23:59:12.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.958+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82015dea0 con 0x7fe8200acda0 2024-04-24T23:59:12.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.958+0000 7fe81d600640 1 -- 172.21.15.96:0/257948054 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810011c20 con 0x7fe8200acda0 2024-04-24T23:59:12.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.958+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82015e460 con 0x7fe8200acda0 2024-04-24T23:59:12.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.959+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe820069110 con 0x7fe8200acda0 2024-04-24T23:59:12.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.960+0000 7fe81d600640 1 -- 172.21.15.96:0/257948054 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe810018020 con 0x7fe8200acda0 2024-04-24T23:59:12.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.961+0000 7fe81d600640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:12.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.961+0000 7fe81d600640 1 -- 172.21.15.96:0/257948054 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fe81008a680 con 0x7fe8200acda0 2024-04-24T23:59:12.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.961+0000 7fe817e00640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.962+0000 7fe817e00640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe808034000 tx=0x7fe80802c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:12.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:12.965+0000 7fe81d600640 1 -- 172.21.15.96:0/257948054 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe81001f030 con 0x7fe8200acda0 2024-04-24T23:59:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.166+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe820159da0 con 0x7fe8200acda0 2024-04-24T23:59:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.167+0000 7fe81d600640 1 -- 172.21.15.96:0/257948054 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7fe8100172c0 con 0x7fe8200acda0 2024-04-24T23:59:13.167 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:13.167 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-04-24T23:59:13.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:13.167 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2024-04-24T23:59:13.167 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2024-04-24T23:59:13.167 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:13.167 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-04-24T23:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7fc06be30 msgr2=0x7fe7fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe808034000 tx=0x7fe80802c000 comp rx=0 tx=0).stop 2024-04-24T23:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200acda0 msgr2=0x7fe820159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200acda0 0x7fe820159860 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b3f0 tx=0x7fe81000b8b0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 shutdown_connections 2024-04-24T23:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe82015c230 0x7fe8200cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8200af120 0x7fe8200c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 --2- 172.21.15.96:0/257948054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8200acda0 0x7fe820159860 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.169+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 >> 172.21.15.96:0/257948054 conn(0x7fe8200b19c0 msgr2=0x7fe82015a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.170+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 shutdown_connections 2024-04-24T23:59:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.170+0000 7fe827600640 1 -- 172.21.15.96:0/257948054 wait complete. 2024-04-24T23:59:13.189 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T23:59:13.189 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T23:59:13.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.387+0000 7f7efe200640 1 Processor -- start 2024-04-24T23:59:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.387+0000 7f7efe200640 1 -- start start 2024-04-24T23:59:13.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.389+0000 7f7efe200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7ef8072850 0x7f7ef80ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:13.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.389+0000 7f7efe200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 0x7f7ef80cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:13.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.389+0000 7f7efe200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef80ccfa0 con 0x7f7ef8072470 2024-04-24T23:59:13.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.389+0000 7f7efe200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef80cdc00 con 0x7f7ef8072850 2024-04-24T23:59:13.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.389+0000 7f7efe200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef80cdee0 con 0x7f7ef80cf0e0 2024-04-24T23:59:13.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.389+0000 7f7ef7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7ef8072850 0x7f7ef80ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:13.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.389+0000 7f7ef7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7ef8072850 0x7f7ef80ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37314/0 (socket says 172.21.15.96:37314) 2024-04-24T23:59:13.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.389+0000 7f7ef7e00640 1 -- 172.21.15.96:0/4153179503 learned_addr learned my addr 172.21.15.96:0/4153179503 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:13.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.390+0000 7f7efd800640 1 --2- 172.21.15.96:0/4153179503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 0x7f7ef80cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:13.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.390+0000 7f7ef7e00640 1 -- 172.21.15.96:0/4153179503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 msgr2=0x7f7ef80cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:13.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.390+0000 7f7ef7e00640 1 --2- 172.21.15.96:0/4153179503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 0x7f7ef80cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.390+0000 7f7ef7e00640 1 -- 172.21.15.96:0/4153179503 >> v1:172.21.15.155:6789/0 conn(0x7f7ef8072470 legacy=0x7f7ef80cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:13.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.390+0000 7f7ef7e00640 1 -- 172.21.15.96:0/4153179503 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef80ce1c0 con 0x7f7ef8072850 2024-04-24T23:59:13.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.391+0000 7f7ef7e00640 1 --2- 172.21.15.96:0/4153179503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 0x7f7ef80ce9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009870 tx=0x7f7ee402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee900ebdad33021e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.391+0000 7f7ef7400640 1 -- 172.21.15.96:0/4153179503 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4037070 con 0x7f7ef8072850 2024-04-24T23:59:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.391+0000 7f7ef7400640 1 -- 172.21.15.96:0/4153179503 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee4032440 con 0x7f7ef8072850 2024-04-24T23:59:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.391+0000 7f7ef7400640 1 -- 172.21.15.96:0/4153179503 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4032810 con 0x7f7ef8072850 2024-04-24T23:59:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.392+0000 7f7efe200640 1 -- 172.21.15.96:0/4153179503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 msgr2=0x7f7ef80ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.392+0000 7f7efe200640 1 --2- 172.21.15.96:0/4153179503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 0x7f7ef80ce9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009870 tx=0x7f7ee402a210 comp rx=0 tx=0).stop 2024-04-24T23:59:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.392+0000 7f7efe200640 1 -- 172.21.15.96:0/4153179503 shutdown_connections 2024-04-24T23:59:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.392+0000 7f7efe200640 1 --2- 172.21.15.96:0/4153179503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 0x7f7ef80cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.392+0000 7f7efe200640 1 --2- 172.21.15.96:0/4153179503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 0x7f7ef80ce9c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.392+0000 7f7efe200640 1 -- 172.21.15.96:0/4153179503 >> 172.21.15.96:0/4153179503 conn(0x7f7ef80b1f80 msgr2=0x7f7ef80cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.392+0000 7f7efe200640 1 -- 172.21.15.96:0/4153179503 shutdown_connections 2024-04-24T23:59:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.392+0000 7f7efe200640 1 -- 172.21.15.96:0/4153179503 wait complete. 2024-04-24T23:59:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.394+0000 7f7efe200640 1 Processor -- start 2024-04-24T23:59:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.394+0000 7f7efe200640 1 -- start start 2024-04-24T23:59:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.395+0000 7f7efe200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ef8072470 0x7f7ef8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.395+0000 7f7efe200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 0x7f7ef8153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.395+0000 7f7efe200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 0x7f7ef8152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.395+0000 7f7efe200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef815d490 con 0x7f7ef8072850 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.395+0000 7f7efe200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef80cccc0 con 0x7f7ef8072470 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.395+0000 7f7efe200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef815d610 con 0x7f7ef80cf0e0 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.395+0000 7f7ef7e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 0x7f7ef8153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.395+0000 7f7ef7e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 0x7f7ef8153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37324/0 (socket says 172.21.15.96:37324) 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.395+0000 7f7ef7e00640 1 -- 172.21.15.96:0/877113528 learned_addr learned my addr 172.21.15.96:0/877113528 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7efd800640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 0x7f7ef8152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7ef7e00640 1 -- 172.21.15.96:0/877113528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 msgr2=0x7f7ef8152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7efce00640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ef8072470 0x7f7ef8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7ef7e00640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 0x7f7ef8152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7ef7e00640 1 -- 172.21.15.96:0/877113528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ef8072470 msgr2=0x7f7ef8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7ef7e00640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ef8072470 0x7f7ef8159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7ef7e00640 1 -- 172.21.15.96:0/877113528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef8151a20 con 0x7f7ef8072850 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7efce00640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ef8072470 0x7f7ef8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7ef7e00640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 0x7f7ef8153e60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009870 tx=0x7f7ee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7ef4c00640 1 -- 172.21.15.96:0/877113528 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4041020 con 0x7f7ef8072850 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7ef4c00640 1 -- 172.21.15.96:0/877113528 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee4030970 con 0x7f7ef8072850 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef8151d00 con 0x7f7ef8072850 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.396+0000 7f7ef4c00640 1 -- 172.21.15.96:0/877113528 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4037040 con 0x7f7ef8072850 2024-04-24T23:59:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.397+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef81525a0 con 0x7f7ef8072850 2024-04-24T23:59:13.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.398+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef81520f0 con 0x7f7ef8072850 2024-04-24T23:59:13.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.399+0000 7f7ef4c00640 1 -- 172.21.15.96:0/877113528 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ee4044020 con 0x7f7ef8072850 2024-04-24T23:59:13.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.400+0000 7f7ef4c00640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7ed806be30 0x7f7ed806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:13.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.400+0000 7f7ef4c00640 1 -- 172.21.15.96:0/877113528 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f7ee40ab460 con 0x7f7ef8072850 2024-04-24T23:59:13.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.400+0000 7f7efce00640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7ed806be30 0x7f7ed806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:13.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.401+0000 7f7efce00640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7ed806be30 0x7f7ed806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7eec003eb0 tx=0x7f7eec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:13.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.404+0000 7f7ef4c00640 1 -- 172.21.15.96:0/877113528 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7ee404b030 con 0x7f7ef8072850 2024-04-24T23:59:13.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:13.587+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7ef8067e40 con 0x7f7ef8072850 2024-04-24T23:59:14.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.449+0000 7f7ef4c00640 1 -- 172.21.15.96:0/877113528 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f7ee407a1f0 con 0x7f7ef8072850 2024-04-24T23:59:14.449 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2024-04-24T23:59:14.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.452+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7ed806be30 msgr2=0x7f7ed806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:14.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.452+0000 7f7efe200640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7ed806be30 0x7f7ed806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7eec003eb0 tx=0x7f7eec009040 comp rx=0 tx=0).stop 2024-04-24T23:59:14.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.452+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 msgr2=0x7f7ef8153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:14.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.452+0000 7f7efe200640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 0x7f7ef8153e60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009870 tx=0x7f7ee40046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.453+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 shutdown_connections 2024-04-24T23:59:14.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.453+0000 7f7efe200640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ef80cf0e0 0x7f7ef8152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.453+0000 7f7efe200640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7ed806be30 0x7f7ed806e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.453+0000 7f7efe200640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8072850 0x7f7ef8153e60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.453+0000 7f7efe200640 1 --2- 172.21.15.96:0/877113528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ef8072470 0x7f7ef8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.453+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 >> 172.21.15.96:0/877113528 conn(0x7f7ef80b1f80 msgr2=0x7f7ef8071570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:14.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.453+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 shutdown_connections 2024-04-24T23:59:14.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.453+0000 7f7efe200640 1 -- 172.21.15.96:0/877113528 wait complete. 2024-04-24T23:59:14.482 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T23:59:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.681+0000 7fec2f200640 1 Processor -- start 2024-04-24T23:59:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.682+0000 7fec2f200640 1 -- start start 2024-04-24T23:59:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.683+0000 7fec2f200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec280d1150 0x7fec280d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.683+0000 7fec2f200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fec280d2310 0x7fec280c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.683+0000 7fec2f200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec280c7df0 con 0x7fec2815e4a0 2024-04-24T23:59:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.683+0000 7fec2f200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fec280c80f0 con 0x7fec280d2310 2024-04-24T23:59:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.683+0000 7fec2f200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fec280d2ac0 con 0x7fec280d1150 2024-04-24T23:59:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.684+0000 7fec27e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fec2815e4a0 0x7fec280d0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37940/0 (socket says 172.21.15.96:37940) 2024-04-24T23:59:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.684+0000 7fec27e00640 1 -- 172.21.15.96:0/3280194422 learned_addr learned my addr 172.21.15.96:0/3280194422 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.684+0000 7fec2d200640 1 --2- 172.21.15.96:0/3280194422 >> v2:172.21.15.96:3300/0 conn(0x7fec280d2310 0x7fec280c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:14.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.684+0000 7fec1fe00640 1 --2- 172.21.15.96:0/3280194422 >> v2:172.21.15.155:3300/0 conn(0x7fec280d1150 0x7fec280d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:14.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.684+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695014125 0 0) 0x7fec280c7df0 con 0x7fec2815e4a0 2024-04-24T23:59:14.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.684+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec0c003520 con 0x7fec2815e4a0 2024-04-24T23:59:14.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.684+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1429431293 0 0) 0x7fec0c003520 con 0x7fec2815e4a0 2024-04-24T23:59:14.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 >> v2:172.21.15.155:3300/0 conn(0x7fec280d1150 msgr2=0x7fec280d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:14.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 --2- 172.21.15.96:0/3280194422 >> v2:172.21.15.155:3300/0 conn(0x7fec280d1150 0x7fec280d1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 >> v2:172.21.15.96:3300/0 conn(0x7fec280d2310 msgr2=0x7fec280c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:14.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 --2- 172.21.15.96:0/3280194422 >> v2:172.21.15.96:3300/0 conn(0x7fec280d2310 0x7fec280c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec280d2da0 con 0x7fec2815e4a0 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fec18001670 con 0x7fec2815e4a0 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 >> v1:172.21.15.96:6789/0 conn(0x7fec2815e4a0 legacy=0x7fec280d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c004800 0x7fec0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec0c0051c0 0x7fec0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fec280c80f0 con 0x7fec0c0039b0 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec280d2ac0 con 0x7fec0c004800 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fec0c00bf50 con 0x7fec0c0051c0 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec27e00640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:14.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec2d200640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec0c0051c0 0x7fec0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:14.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.685+0000 7fec1fe00640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c004800 0x7fec0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:14.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.686+0000 7fec27e00640 1 -- 172.21.15.96:0/3280194422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec0c0051c0 msgr2=0x7fec0c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:14.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.686+0000 7fec27e00640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec0c0051c0 0x7fec0c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.686+0000 7fec27e00640 1 -- 172.21.15.96:0/3280194422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c004800 msgr2=0x7fec0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:14.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.686+0000 7fec27e00640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c004800 0x7fec0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.686+0000 7fec27e00640 1 -- 172.21.15.96:0/3280194422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c003520 con 0x7fec0c0039b0 2024-04-24T23:59:14.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.686+0000 7fec1fe00640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c004800 0x7fec0c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:14.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.686+0000 7fec2d200640 1 -- 172.21.15.96:0/3280194422 reap_dead start 2024-04-24T23:59:14.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.687+0000 7fec27e00640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec0c003dd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fec18001050 tx=0x7fec0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc6408fc45ac5fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.687+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18007d70 con 0x7fec0c0039b0 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.687+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec18005af0 con 0x7fec0c0039b0 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.687+0000 7fec27400640 1 -- 172.21.15.96:0/3280194422 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18007070 con 0x7fec0c0039b0 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.687+0000 7fec2f200640 1 -- 172.21.15.96:0/3280194422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 msgr2=0x7fec0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.687+0000 7fec2f200640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec0c003dd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fec18001050 tx=0x7fec0c005830 comp rx=0 tx=0).stop 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.687+0000 7fec2f200640 1 -- 172.21.15.96:0/3280194422 shutdown_connections 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.687+0000 7fec2f200640 1 --2- 172.21.15.96:0/3280194422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec0c003dd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.687+0000 7fec2f200640 1 -- 172.21.15.96:0/3280194422 >> 172.21.15.96:0/3280194422 conn(0x7fec2809d4e0 msgr2=0x7fec280d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.688+0000 7fec2f200640 1 -- 172.21.15.96:0/3280194422 shutdown_connections 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.688+0000 7fec2f200640 1 -- 172.21.15.96:0/3280194422 wait complete. 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.689+0000 7fec2f200640 1 Processor -- start 2024-04-24T23:59:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.690+0000 7fec2f200640 1 -- start start 2024-04-24T23:59:14.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.690+0000 7fec2f200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec281532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:14.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.690+0000 7fec2f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec280b7c30 0x7fec28156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.690+0000 7fec2f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec28157300 0x7fec280b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec2f200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fec280d3200 con 0x7fec0c0039b0 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec2f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec280d3080 con 0x7fec280b7c30 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec2f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fec280d1dd0 con 0x7fec28157300 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec27e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec281532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec27e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec281532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37354/0 (socket says 172.21.15.96:37354) 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec27e00640 1 -- 172.21.15.96:0/2164611199 learned_addr learned my addr 172.21.15.96:0/2164611199 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec1fe00640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec280b7c30 0x7fec28156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec2d200640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec28157300 0x7fec280b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec27e00640 1 -- 172.21.15.96:0/2164611199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec28157300 msgr2=0x7fec280b92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec27e00640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec28157300 0x7fec280b92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec27e00640 1 -- 172.21.15.96:0/2164611199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec280b7c30 msgr2=0x7fec28156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec27e00640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec280b7c30 0x7fec28156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec27e00640 1 -- 172.21.15.96:0/2164611199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec280cce60 con 0x7fec0c0039b0 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.691+0000 7fec2d200640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec28157300 0x7fec280b92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.692+0000 7fec27e00640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec281532b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c300 tx=0x7fec18000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.692+0000 7fec24c00640 1 -- 172.21.15.96:0/2164611199 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18037040 con 0x7fec0c0039b0 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.692+0000 7fec24c00640 1 -- 172.21.15.96:0/2164611199 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec18041070 con 0x7fec0c0039b0 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.692+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec280cd140 con 0x7fec0c0039b0 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.692+0000 7fec24c00640 1 -- 172.21.15.96:0/2164611199 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec180047e0 con 0x7fec0c0039b0 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.692+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec280cd700 con 0x7fec0c0039b0 2024-04-24T23:59:14.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.693+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec28067e40 con 0x7fec0c0039b0 2024-04-24T23:59:14.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.694+0000 7fec24c00640 1 -- 172.21.15.96:0/2164611199 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec18004980 con 0x7fec0c0039b0 2024-04-24T23:59:14.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.695+0000 7fec24c00640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fec0406be30 0x7fec0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:14.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.695+0000 7fec24c00640 1 -- 172.21.15.96:0/2164611199 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fec180aa9c0 con 0x7fec0c0039b0 2024-04-24T23:59:14.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.695+0000 7fec1fe00640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fec0406be30 0x7fec0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:14.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.696+0000 7fec1fe00640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fec0406be30 0x7fec0406e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fec280d02d0 tx=0x7fec10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.700+0000 7fec24c00640 1 -- 172.21.15.96:0/2164611199 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fec18005040 con 0x7fec0c0039b0 2024-04-24T23:59:14.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:14.900+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fec280ce390 con 0x7fec0c0039b0 2024-04-24T23:59:15.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.456+0000 7fec24c00640 1 -- 172.21.15.96:0/2164611199 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7fec18079540 con 0x7fec0c0039b0 2024-04-24T23:59:15.456 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2024-04-24T23:59:15.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.461+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fec0406be30 msgr2=0x7fec0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:15.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.461+0000 7fec2f200640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fec0406be30 0x7fec0406e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fec280d02d0 tx=0x7fec10008040 comp rx=0 tx=0).stop 2024-04-24T23:59:15.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.461+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 msgr2=0x7fec281532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:15.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.461+0000 7fec2f200640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec281532b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c300 tx=0x7fec18000fe0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.462+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 shutdown_connections 2024-04-24T23:59:15.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.462+0000 7fec2f200640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec28157300 0x7fec280b92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.462+0000 7fec2f200640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec280b7c30 0x7fec28156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.462+0000 7fec2f200640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fec0406be30 0x7fec0406e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.462+0000 7fec2f200640 1 --2- 172.21.15.96:0/2164611199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0039b0 0x7fec281532b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.462+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 >> 172.21.15.96:0/2164611199 conn(0x7fec2809d4e0 msgr2=0x7fec2815d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:15.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.462+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 shutdown_connections 2024-04-24T23:59:15.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.462+0000 7fec2f200640 1 -- 172.21.15.96:0/2164611199 wait complete. 2024-04-24T23:59:15.495 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T23:59:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.670+0000 7fdb4a200640 1 Processor -- start 2024-04-24T23:59:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.671+0000 7fdb4a200640 1 -- start start 2024-04-24T23:59:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.672+0000 7fdb4a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb4406edf0 0x7fdb4415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.672+0000 7fdb4a200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4406d100 con 0x7fdb440ae8e0 2024-04-24T23:59:15.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.672+0000 7fdb4a200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb440acda0 con 0x7fdb44156620 2024-04-24T23:59:15.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.672+0000 7fdb4a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb440ad060 con 0x7fdb4406edf0 2024-04-24T23:59:15.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.672+0000 7fdb43e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdb440ae8e0 0x7fdb440aed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37954/0 (socket says 172.21.15.96:37954) 2024-04-24T23:59:15.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.672+0000 7fdb43e00640 1 -- 172.21.15.96:0/1269154394 learned_addr learned my addr 172.21.15.96:0/1269154394 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274807372 0 0) 0x7fdb4406d100 con 0x7fdb440ae8e0 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb28003520 con 0x7fdb440ae8e0 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb3aa00640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb4406edf0 0x7fdb4415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2899990683 0 0) 0x7fdb28003520 con 0x7fdb440ae8e0 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb4406edf0 msgr2=0x7fdb4415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb4406edf0 0x7fdb4415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 >> v1:172.21.15.155:6789/0 conn(0x7fdb44156620 legacy=0x7fdb4406dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4406d3a0 con 0x7fdb440ae8e0 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fdb3c0019f0 con 0x7fdb440ae8e0 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 >> v1:172.21.15.96:6789/0 conn(0x7fdb440ae8e0 legacy=0x7fdb440aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb4406edf0 0x7fdb280039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb28004010 0x7fdb28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.673+0000 7fdb42a00640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdb440ad060 con 0x7fdb28004d40 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2800bc00 con 0x7fdb28004010 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2800be00 con 0x7fdb4406edf0 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb43e00640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb43400640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb4406edf0 0x7fdb280039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb43e00640 1 -- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb4406edf0 msgr2=0x7fdb280039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb43e00640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb4406edf0 0x7fdb280039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb43e00640 1 -- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb28004010 msgr2=0x7fdb28004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb43e00640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb28004010 0x7fdb28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.674+0000 7fdb43e00640 1 -- 172.21.15.96:0/1269154394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb28003520 con 0x7fdb28004d40 2024-04-24T23:59:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.675+0000 7fdb43e00640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb280051c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00a860 tx=0x7fdb28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c25879d773f7c9c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.675+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00a480 con 0x7fdb28004d40 2024-04-24T23:59:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.676+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb3c02f070 con 0x7fdb28004d40 2024-04-24T23:59:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.676+0000 7fdb42a00640 1 -- 172.21.15.96:0/1269154394 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c02bd20 con 0x7fdb28004d40 2024-04-24T23:59:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.676+0000 7fdb4a200640 1 -- 172.21.15.96:0/1269154394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 msgr2=0x7fdb280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.676+0000 7fdb4a200640 1 --2- 172.21.15.96:0/1269154394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb280051c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00a860 tx=0x7fdb28005830 comp rx=0 tx=0).stop 2024-04-24T23:59:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.676+0000 7fdb43e00640 1 -- 172.21.15.96:0/1269154394 reap_dead start 2024-04-24T23:59:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.676+0000 7fdb4a200640 1 -- 172.21.15.96:0/1269154394 shutdown_connections 2024-04-24T23:59:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.676+0000 7fdb4a200640 1 -- 172.21.15.96:0/1269154394 >> 172.21.15.96:0/1269154394 conn(0x7fdb440b19c0 msgr2=0x7fdb440b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.676+0000 7fdb4a200640 1 -- 172.21.15.96:0/1269154394 shutdown_connections 2024-04-24T23:59:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.676+0000 7fdb4a200640 1 -- 172.21.15.96:0/1269154394 wait complete. 2024-04-24T23:59:15.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.678+0000 7fdb4a200640 1 Processor -- start 2024-04-24T23:59:15.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.678+0000 7fdb4a200640 1 -- start start 2024-04-24T23:59:15.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.679+0000 7fdb4a200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb4409aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.679+0000 7fdb4a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb440cf670 0x7fdb44150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.679+0000 7fdb4a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb4409b4a0 0x7fdb4409b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.679+0000 7fdb4a200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdb440ad4c0 con 0x7fdb28004d40 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.679+0000 7fdb4a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb440ad340 con 0x7fdb4409b4a0 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.679+0000 7fdb4a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4415cf70 con 0x7fdb440cf670 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.679+0000 7fdb43400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb4409aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.679+0000 7fdb43400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb4409aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37370/0 (socket says 172.21.15.96:37370) 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb43400640 1 -- 172.21.15.96:0/2180953342 learned_addr learned my addr 172.21.15.96:0/2180953342 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb3aa00640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb440cf670 0x7fdb44150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb43400640 1 -- 172.21.15.96:0/2180953342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb440cf670 msgr2=0x7fdb44150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb43400640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb440cf670 0x7fdb44150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb43400640 1 -- 172.21.15.96:0/2180953342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb4409b4a0 msgr2=0x7fdb4409b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:15.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb43400640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb4409b4a0 0x7fdb4409b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:15.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb43400640 1 -- 172.21.15.96:0/2180953342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb440cfaf0 con 0x7fdb28004d40 2024-04-24T23:59:15.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb43400640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb4409aae0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400d5a0 tx=0x7fdb3400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:15.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb3be00640 1 -- 172.21.15.96:0/2180953342 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34005480 con 0x7fdb28004d40 2024-04-24T23:59:15.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb3be00640 1 -- 172.21.15.96:0/2180953342 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb34017070 con 0x7fdb28004d40 2024-04-24T23:59:15.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.680+0000 7fdb3be00640 1 -- 172.21.15.96:0/2180953342 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34003810 con 0x7fdb28004d40 2024-04-24T23:59:15.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.681+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4415ab30 con 0x7fdb28004d40 2024-04-24T23:59:15.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.681+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4415b0f0 con 0x7fdb28004d40 2024-04-24T23:59:15.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.682+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb44069110 con 0x7fdb28004d40 2024-04-24T23:59:15.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.683+0000 7fdb3be00640 1 -- 172.21.15.96:0/2180953342 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb340039b0 con 0x7fdb28004d40 2024-04-24T23:59:15.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.684+0000 7fdb3be00640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdb2006be30 0x7fdb2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:15.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.684+0000 7fdb3be00640 1 -- 172.21.15.96:0/2180953342 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7fdb3408ab10 con 0x7fdb28004d40 2024-04-24T23:59:15.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.684+0000 7fdb3aa00640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdb2006be30 0x7fdb2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:15.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.685+0000 7fdb3aa00640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdb2006be30 0x7fdb2006e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c006a90 tx=0x7fdb2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:15.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.689+0000 7fdb3be00640 1 -- 172.21.15.96:0/2180953342 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdb340595b0 con 0x7fdb28004d40 2024-04-24T23:59:15.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:15.921+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fdb440af500 con 0x7fdb28004d40 2024-04-24T23:59:16.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.482+0000 7fdb3be00640 1 -- 172.21.15.96:0/2180953342 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7fdb34058eb0 con 0x7fdb28004d40 2024-04-24T23:59:16.483 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 4 and data pool 5 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.485+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdb2006be30 msgr2=0x7fdb2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.485+0000 7fdb4a200640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdb2006be30 0x7fdb2006e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c006a90 tx=0x7fdb2c008040 comp rx=0 tx=0).stop 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.485+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 msgr2=0x7fdb4409aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.485+0000 7fdb4a200640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb4409aae0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400d5a0 tx=0x7fdb3400da60 comp rx=0 tx=0).stop 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.486+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 shutdown_connections 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.486+0000 7fdb4a200640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb4409b4a0 0x7fdb4409b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.486+0000 7fdb4a200640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb440cf670 0x7fdb44150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.486+0000 7fdb4a200640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdb2006be30 0x7fdb2006e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.486+0000 7fdb4a200640 1 --2- 172.21.15.96:0/2180953342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb28004d40 0x7fdb4409aae0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.486+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 >> 172.21.15.96:0/2180953342 conn(0x7fdb440b19c0 msgr2=0x7fdb4406e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:16.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.488+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 shutdown_connections 2024-04-24T23:59:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.489+0000 7fdb4a200640 1 -- 172.21.15.96:0/2180953342 wait complete. 2024-04-24T23:59:16.530 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:16.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.694+0000 7f6507200640 1 Processor -- start 2024-04-24T23:59:16.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.694+0000 7f6507200640 1 -- start start 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.695+0000 7f6507200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f650015e480 0x7f65000cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6507200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f65000b2be0 0x7f6500072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6507200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650006cc10 con 0x7f65000cc6e0 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6507200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f6500073060 con 0x7f650015e480 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6507200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f650006cef0 con 0x7f65000b2be0 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6505e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f650015e480 0x7f65000cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6505e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f650015e480 0x7f65000cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37378/0 (socket says 172.21.15.96:37378) 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6505e00640 1 -- 172.21.15.96:0/4152468669 learned_addr learned my addr 172.21.15.96:0/4152468669 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6505400640 1 --2- 172.21.15.96:0/4152468669 >> v2:172.21.15.155:3300/0 conn(0x7f65000b2be0 0x7f6500072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6505e00640 1 -- 172.21.15.96:0/4152468669 >> v2:172.21.15.155:3300/0 conn(0x7f65000b2be0 msgr2=0x7f6500072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6505e00640 1 --2- 172.21.15.96:0/4152468669 >> v2:172.21.15.155:3300/0 conn(0x7f65000b2be0 0x7f6500072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6505e00640 1 -- 172.21.15.96:0/4152468669 >> v1:172.21.15.96:6789/0 conn(0x7f65000cc6e0 legacy=0x7f650006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6505e00640 1 -- 172.21.15.96:0/4152468669 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650006d1d0 con 0x7f650015e480 2024-04-24T23:59:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.696+0000 7f6505400640 1 --2- 172.21.15.96:0/4152468669 >> v2:172.21.15.155:3300/0 conn(0x7f65000b2be0 0x7f6500072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.697+0000 7f6505e00640 1 --2- 172.21.15.96:0/4152468669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f650015e480 0x7f65000cf670 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f650006ed90 tx=0x7f64f402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865faef5ce3288d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6504a00640 1 -- 172.21.15.96:0/4152468669 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f4037070 con 0x7f650015e480 2024-04-24T23:59:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6504a00640 1 -- 172.21.15.96:0/4152468669 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f4032440 con 0x7f650015e480 2024-04-24T23:59:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6504a00640 1 -- 172.21.15.96:0/4152468669 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f4032810 con 0x7f650015e480 2024-04-24T23:59:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6507200640 1 -- 172.21.15.96:0/4152468669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f650015e480 msgr2=0x7f65000cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6507200640 1 --2- 172.21.15.96:0/4152468669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f650015e480 0x7f65000cf670 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f650006ed90 tx=0x7f64f402a200 comp rx=0 tx=0).stop 2024-04-24T23:59:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6507200640 1 -- 172.21.15.96:0/4152468669 shutdown_connections 2024-04-24T23:59:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6507200640 1 --2- 172.21.15.96:0/4152468669 >> v2:172.21.15.155:3300/0 conn(0x7f65000b2be0 0x7f6500072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6507200640 1 --2- 172.21.15.96:0/4152468669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f650015e480 0x7f65000cf670 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6507200640 1 -- 172.21.15.96:0/4152468669 >> 172.21.15.96:0/4152468669 conn(0x7f65000b1f10 msgr2=0x7f65000cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6507200640 1 -- 172.21.15.96:0/4152468669 shutdown_connections 2024-04-24T23:59:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.698+0000 7f6507200640 1 -- 172.21.15.96:0/4152468669 wait complete. 2024-04-24T23:59:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.700+0000 7f6507200640 1 Processor -- start 2024-04-24T23:59:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.700+0000 7f6507200640 1 -- start start 2024-04-24T23:59:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.701+0000 7f6507200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65000b2be0 0x7f6500158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.701+0000 7f6507200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65000cc6e0 0x7f65001595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.701+0000 7f6507200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f650015e480 0x7f65000cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.701+0000 7f6507200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f65000ccb50 con 0x7f65000b2be0 2024-04-24T23:59:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.701+0000 7f6507200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6500072d50 con 0x7f65000cc6e0 2024-04-24T23:59:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.701+0000 7f6507200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65000cccd0 con 0x7f650015e480 2024-04-24T23:59:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.701+0000 7f6505e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65000b2be0 0x7f6500158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.701+0000 7f6505e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65000b2be0 0x7f6500158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37394/0 (socket says 172.21.15.96:37394) 2024-04-24T23:59:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.701+0000 7f6505e00640 1 -- 172.21.15.96:0/3172395825 learned_addr learned my addr 172.21.15.96:0/3172395825 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f6505e00640 1 -- 172.21.15.96:0/3172395825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f650015e480 msgr2=0x7f65000cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f6505e00640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f650015e480 0x7f65000cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f6505e00640 1 -- 172.21.15.96:0/3172395825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65000cc6e0 msgr2=0x7f65001595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f6505e00640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65000cc6e0 0x7f65001595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f6505e00640 1 -- 172.21.15.96:0/3172395825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6500159d00 con 0x7f65000b2be0 2024-04-24T23:59:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f6505e00640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65000b2be0 0x7f6500158f70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f64f402a240 tx=0x7f64f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f64fa000640 1 -- 172.21.15.96:0/3172395825 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f4037040 con 0x7f65000b2be0 2024-04-24T23:59:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f64fa000640 1 -- 172.21.15.96:0/3172395825 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f4042070 con 0x7f65000b2be0 2024-04-24T23:59:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f64fa000640 1 -- 172.21.15.96:0/3172395825 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f4030bb0 con 0x7f65000b2be0 2024-04-24T23:59:16.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6500159fe0 con 0x7f65000b2be0 2024-04-24T23:59:16.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.702+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f650015a5a0 con 0x7f65000b2be0 2024-04-24T23:59:16.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.703+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6500067e40 con 0x7f65000b2be0 2024-04-24T23:59:16.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.704+0000 7f64fa000640 1 -- 172.21.15.96:0/3172395825 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64f4047460 con 0x7f65000b2be0 2024-04-24T23:59:16.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.705+0000 7f64fa000640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f64e406be60 0x7f64e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:16.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.705+0000 7f64fa000640 1 -- 172.21.15.96:0/3172395825 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f64f40abb10 con 0x7f65000b2be0 2024-04-24T23:59:16.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.705+0000 7f6505400640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f64e406be60 0x7f64e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:16.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.706+0000 7f6505400640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f64e406be60 0x7f64e406e320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f64f0006fd0 tx=0x7f64f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:16.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.710+0000 7f64fa000640 1 -- 172.21.15.96:0/3172395825 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f64f4045360 con 0x7f65000b2be0 2024-04-24T23:59:16.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.893+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65000756b0 con 0x7f65000b2be0 2024-04-24T23:59:16.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.896+0000 7f64fa000640 1 -- 172.21.15.96:0/3172395825 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16634 (secure 0 0 0) 0x7f64f407a420 con 0x7f65000b2be0 2024-04-24T23:59:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:16.897 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":32,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:15.923064+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:59:13.640002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T23:59:14.952491+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:16.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f64e406be60 msgr2=0x7f64e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:16.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f64e406be60 0x7f64e406e320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f64f0006fd0 tx=0x7f64f0008040 comp rx=0 tx=0).stop 2024-04-24T23:59:16.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65000b2be0 msgr2=0x7f6500158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:16.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65000b2be0 0x7f6500158f70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f64f402a240 tx=0x7f64f40046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 shutdown_connections 2024-04-24T23:59:16.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f650015e480 0x7f65000cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65000cc6e0 0x7f65001595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f64e406be60 0x7f64e406e320 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 --2- 172.21.15.96:0/3172395825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65000b2be0 0x7f6500158f70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:16.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.899+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 >> 172.21.15.96:0/3172395825 conn(0x7f65000b1f10 msgr2=0x7f6500072350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:16.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.900+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 shutdown_connections 2024-04-24T23:59:16.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:16.900+0000 7f6507200640 1 -- 172.21.15.96:0/3172395825 wait complete. 2024-04-24T23:59:16.918 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:17.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.110+0000 7f1b8aa00640 1 Processor -- start 2024-04-24T23:59:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.110+0000 7f1b8aa00640 1 -- start start 2024-04-24T23:59:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.112+0000 7f1b8aa00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1b84070df0 0x7f1b8415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.112+0000 7f1b8aa00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b840713d0 con 0x7f1b8415b220 2024-04-24T23:59:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.112+0000 7f1b8aa00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b840ae4d0 con 0x7f1b840b2cc0 2024-04-24T23:59:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.112+0000 7f1b8aa00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f1b840aee00 con 0x7f1b84070df0 2024-04-24T23:59:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.112+0000 7f1b83e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1b8415b220 0x7f1b8415ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55974/0 (socket says 172.21.15.96:55974) 2024-04-24T23:59:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.112+0000 7f1b83e00640 1 -- 172.21.15.96:0/4015686273 learned_addr learned my addr 172.21.15.96:0/4015686273 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.112+0000 7f1b83400640 1 --2- 172.21.15.96:0/4015686273 >> v2:172.21.15.96:3300/0 conn(0x7f1b84070df0 0x7f1b8415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.112+0000 7f1b82a00640 1 -- 172.21.15.96:0/4015686273 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435286959 0 0) 0x7f1b840713d0 con 0x7f1b8415b220 2024-04-24T23:59:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.113+0000 7f1b82a00640 1 -- 172.21.15.96:0/4015686273 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b68003520 con 0x7f1b8415b220 2024-04-24T23:59:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.113+0000 7f1b83400640 1 -- 172.21.15.96:0/4015686273 >> v1:172.21.15.155:6789/0 conn(0x7f1b840b2cc0 legacy=0x7f1b840b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.113+0000 7f1b83400640 1 -- 172.21.15.96:0/4015686273 >> v1:172.21.15.96:6789/0 conn(0x7f1b8415b220 legacy=0x7f1b8415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:17.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.113+0000 7f1b83400640 1 -- 172.21.15.96:0/4015686273 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b840ae7b0 con 0x7f1b84070df0 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.114+0000 7f1b83400640 1 --2- 172.21.15.96:0/4015686273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b84070df0 0x7f1b8415f380 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009d90 tx=0x7f1b7002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7148e0c50da8b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.114+0000 7f1b82a00640 1 -- 172.21.15.96:0/4015686273 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70007740 con 0x7f1b84070df0 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.114+0000 7f1b82a00640 1 -- 172.21.15.96:0/4015686273 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b700078e0 con 0x7f1b84070df0 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.114+0000 7f1b82a00640 1 -- 172.21.15.96:0/4015686273 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70007cb0 con 0x7f1b84070df0 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.114+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4015686273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b84070df0 msgr2=0x7f1b8415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.114+0000 7f1b8aa00640 1 --2- 172.21.15.96:0/4015686273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b84070df0 0x7f1b8415f380 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009d90 tx=0x7f1b7002a6a0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.115+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4015686273 shutdown_connections 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.115+0000 7f1b8aa00640 1 --2- 172.21.15.96:0/4015686273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b84070df0 0x7f1b8415f380 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.115+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4015686273 >> 172.21.15.96:0/4015686273 conn(0x7f1b840b19c0 msgr2=0x7f1b840b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.115+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4015686273 shutdown_connections 2024-04-24T23:59:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.115+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4015686273 wait complete. 2024-04-24T23:59:17.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.116+0000 7f1b8aa00640 1 Processor -- start 2024-04-24T23:59:17.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.116+0000 7f1b8aa00640 1 -- start start 2024-04-24T23:59:17.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.117+0000 7f1b8aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b84070df0 0x7f1b8414d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.117+0000 7f1b8aa00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b2cc0 0x7f1b8415b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.117+0000 7f1b8aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415b220 0x7f1b840b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.117+0000 7f1b8aa00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8406ed10 con 0x7f1b840b2cc0 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.117+0000 7f1b8aa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8406eb90 con 0x7f1b84070df0 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.117+0000 7f1b8aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8415f8c0 con 0x7f1b8415b220 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.117+0000 7f1b83400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b2cc0 0x7f1b8415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b83400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b2cc0 0x7f1b8415b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35938/0 (socket says 172.21.15.96:35938) 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b83400640 1 -- 172.21.15.96:0/4270639364 learned_addr learned my addr 172.21.15.96:0/4270639364 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b83400640 1 -- 172.21.15.96:0/4270639364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415b220 msgr2=0x7f1b840b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b83400640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415b220 0x7f1b840b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b83400640 1 -- 172.21.15.96:0/4270639364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b84070df0 msgr2=0x7f1b8414d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b83400640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b84070df0 0x7f1b8414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b83400640 1 -- 172.21.15.96:0/4270639364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8415be50 con 0x7f1b840b2cc0 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b83400640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b2cc0 0x7f1b8415b600 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009eb0 tx=0x7f1b70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:17.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b7be00640 1 -- 172.21.15.96:0/4270639364 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70040070 con 0x7f1b840b2cc0 2024-04-24T23:59:17.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b7be00640 1 -- 172.21.15.96:0/4270639364 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b70031c40 con 0x7f1b840b2cc0 2024-04-24T23:59:17.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b7be00640 1 -- 172.21.15.96:0/4270639364 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70009450 con 0x7f1b840b2cc0 2024-04-24T23:59:17.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.118+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8415c130 con 0x7f1b840b2cc0 2024-04-24T23:59:17.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.119+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8415c6f0 con 0x7f1b840b2cc0 2024-04-24T23:59:17.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.120+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b84069110 con 0x7f1b840b2cc0 2024-04-24T23:59:17.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.121+0000 7f1b7be00640 1 -- 172.21.15.96:0/4270639364 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b70039040 con 0x7f1b840b2cc0 2024-04-24T23:59:17.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.121+0000 7f1b7be00640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1b6406be30 0x7f1b6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.121+0000 7f1b7be00640 1 -- 172.21.15.96:0/4270639364 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1b700ac8c0 con 0x7f1b840b2cc0 2024-04-24T23:59:17.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.122+0000 7f1b83e00640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1b6406be30 0x7f1b6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:17.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.122+0000 7f1b83e00640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1b6406be30 0x7f1b6406e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b74000f60 tx=0x7f1b740078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.125+0000 7f1b7be00640 1 -- 172.21.15.96:0/4270639364 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1b7007aaf0 con 0x7f1b840b2cc0 2024-04-24T23:59:17.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.309+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b8406e610 con 0x7f1b840b2cc0 2024-04-24T23:59:17.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.311+0000 7f1b7be00640 1 -- 172.21.15.96:0/4270639364 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16634 (secure 0 0 0) 0x7f1b7007edf0 con 0x7f1b840b2cc0 2024-04-24T23:59:17.312 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:17.313 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":32,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:15.923064+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:59:13.640002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T23:59:14.952491+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1b6406be30 msgr2=0x7f1b6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1b6406be30 0x7f1b6406e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b74000f60 tx=0x7f1b740078f0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b2cc0 msgr2=0x7f1b8415b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b2cc0 0x7f1b8415b600 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009eb0 tx=0x7f1b70004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 shutdown_connections 2024-04-24T23:59:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415b220 0x7f1b840b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f1b6406be30 0x7f1b6406e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b2cc0 0x7f1b8415b600 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 --2- 172.21.15.96:0/4270639364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b84070df0 0x7f1b8414d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 >> 172.21.15.96:0/4270639364 conn(0x7f1b840b19c0 msgr2=0x7f1b840b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 shutdown_connections 2024-04-24T23:59:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.314+0000 7f1b8aa00640 1 -- 172.21.15.96:0/4270639364 wait complete. 2024-04-24T23:59:17.333 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:59:17.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.529+0000 7fbcd4800640 1 Processor -- start 2024-04-24T23:59:17.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.529+0000 7fbcd4800640 1 -- start start 2024-04-24T23:59:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.530+0000 7fbcd4800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbccc1553b0 0x7fbccc0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.530+0000 7fbcd4800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbccc0cabe0 0x7fbccc06c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.530+0000 7fbcd4800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbccc0cf350 con 0x7fbccc0afd20 2024-04-24T23:59:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.530+0000 7fbcd4800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fbccc0d01e0 con 0x7fbccc1553b0 2024-04-24T23:59:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.530+0000 7fbcd4800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbccc072720 con 0x7fbccc0cabe0 2024-04-24T23:59:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.530+0000 7fbcd1e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbccc1553b0 0x7fbccc0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.531+0000 7fbcd1e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbccc1553b0 0x7fbccc0721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35948/0 (socket says 172.21.15.96:35948) 2024-04-24T23:59:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.531+0000 7fbcd1e00640 1 -- 172.21.15.96:0/4160673777 learned_addr learned my addr 172.21.15.96:0/4160673777 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.531+0000 7fbcd1400640 1 --2- 172.21.15.96:0/4160673777 >> v2:172.21.15.155:3300/0 conn(0x7fbccc0cabe0 0x7fbccc06c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.531+0000 7fbcd1e00640 1 -- 172.21.15.96:0/4160673777 >> v2:172.21.15.155:3300/0 conn(0x7fbccc0cabe0 msgr2=0x7fbccc06c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.531+0000 7fbcd1e00640 1 --2- 172.21.15.96:0/4160673777 >> v2:172.21.15.155:3300/0 conn(0x7fbccc0cabe0 0x7fbccc06c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.531+0000 7fbcd1e00640 1 -- 172.21.15.96:0/4160673777 >> v1:172.21.15.155:6789/0 conn(0x7fbccc0afd20 legacy=0x7fbccc161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.531+0000 7fbcd1e00640 1 -- 172.21.15.96:0/4160673777 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0cf5d0 con 0x7fbccc1553b0 2024-04-24T23:59:17.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.532+0000 7fbcd1e00640 1 --2- 172.21.15.96:0/4160673777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc1553b0 0x7fbccc0721e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbccc04f630 tx=0x7fbcc002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d8d0e88d95c2fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.532+0000 7fbcd0a00640 1 -- 172.21.15.96:0/4160673777 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0037070 con 0x7fbccc1553b0 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.532+0000 7fbcd0a00640 1 -- 172.21.15.96:0/4160673777 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc0032440 con 0x7fbccc1553b0 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.532+0000 7fbcd0a00640 1 -- 172.21.15.96:0/4160673777 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0032810 con 0x7fbccc1553b0 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.533+0000 7fbcd4800640 1 -- 172.21.15.96:0/4160673777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc1553b0 msgr2=0x7fbccc0721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.533+0000 7fbcd4800640 1 --2- 172.21.15.96:0/4160673777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc1553b0 0x7fbccc0721e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbccc04f630 tx=0x7fbcc002a1a0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.533+0000 7fbcd4800640 1 -- 172.21.15.96:0/4160673777 shutdown_connections 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.533+0000 7fbcd4800640 1 --2- 172.21.15.96:0/4160673777 >> v2:172.21.15.155:3300/0 conn(0x7fbccc0cabe0 0x7fbccc06c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.533+0000 7fbcd4800640 1 --2- 172.21.15.96:0/4160673777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc1553b0 0x7fbccc0721e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.533+0000 7fbcd4800640 1 -- 172.21.15.96:0/4160673777 >> 172.21.15.96:0/4160673777 conn(0x7fbccc0716c0 msgr2=0x7fbccc071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.533+0000 7fbcd4800640 1 -- 172.21.15.96:0/4160673777 shutdown_connections 2024-04-24T23:59:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.533+0000 7fbcd4800640 1 -- 172.21.15.96:0/4160673777 wait complete. 2024-04-24T23:59:17.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.535+0000 7fbcd4800640 1 Processor -- start 2024-04-24T23:59:17.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.535+0000 7fbcd4800640 1 -- start start 2024-04-24T23:59:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd4800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbccc0afd20 0x7fbccc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd4800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc0cabe0 0x7fbccc1e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd4800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbccc1553b0 0x7fbccc1e69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd4800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc0cfe70 con 0x7fbccc0cabe0 2024-04-24T23:59:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd4800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc0cfb90 con 0x7fbccc0afd20 2024-04-24T23:59:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd4800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc06c610 con 0x7fbccc1553b0 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd1400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc0cabe0 0x7fbccc1e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd1400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc0cabe0 0x7fbccc1e8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35954/0 (socket says 172.21.15.96:35954) 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd1400640 1 -- 172.21.15.96:0/1613290579 learned_addr learned my addr 172.21.15.96:0/1613290579 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd1400640 1 -- 172.21.15.96:0/1613290579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbccc1553b0 msgr2=0x7fbccc1e69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd1400640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbccc1553b0 0x7fbccc1e69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd1e00640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbccc0afd20 0x7fbccc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd1400640 1 -- 172.21.15.96:0/1613290579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbccc0afd20 msgr2=0x7fbccc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd1400640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbccc0afd20 0x7fbccc0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.536+0000 7fbcd1400640 1 -- 172.21.15.96:0/1613290579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0b5f10 con 0x7fbccc0cabe0 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.537+0000 7fbcd1400640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc0cabe0 0x7fbccc1e8350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00d7d0 tx=0x7fbcbc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.537+0000 7fbcc6000640 1 -- 172.21.15.96:0/1613290579 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00b6c0 con 0x7fbccc0cabe0 2024-04-24T23:59:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.537+0000 7fbcc6000640 1 -- 172.21.15.96:0/1613290579 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc019070 con 0x7fbccc0cabe0 2024-04-24T23:59:17.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.537+0000 7fbcc6000640 1 -- 172.21.15.96:0/1613290579 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00ba80 con 0x7fbccc0cabe0 2024-04-24T23:59:17.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.537+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbccc1e8890 con 0x7fbccc0cabe0 2024-04-24T23:59:17.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.537+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbccc1e7590 con 0x7fbccc0cabe0 2024-04-24T23:59:17.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.538+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbccc0681f0 con 0x7fbccc0cabe0 2024-04-24T23:59:17.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.539+0000 7fbcc6000640 1 -- 172.21.15.96:0/1613290579 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcbc00bc20 con 0x7fbccc0cabe0 2024-04-24T23:59:17.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.540+0000 7fbcc6000640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbcb006be30 0x7fbcb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.540+0000 7fbcc6000640 1 -- 172.21.15.96:0/1613290579 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbcbc08b390 con 0x7fbccc0cabe0 2024-04-24T23:59:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.541+0000 7fbcd1e00640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbcb006be30 0x7fbcb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.541+0000 7fbcd1e00640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbcb006be30 0x7fbcb006e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0034000 tx=0x7fbcc002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:17.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.545+0000 7fbcc6000640 1 -- 172.21.15.96:0/1613290579 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbcbc01c360 con 0x7fbccc0cabe0 2024-04-24T23:59:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:17.785+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbccc067050 con 0x7fbccc0cabe0 2024-04-24T23:59:18.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.521+0000 7fbcc6000640 1 -- 172.21.15.96:0/1613290579 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7fbcbc059ca0 con 0x7fbccc0cabe0 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbcb006be30 msgr2=0x7fbcb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbcb006be30 0x7fbcb006e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0034000 tx=0x7fbcc002e000 comp rx=0 tx=0).stop 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc0cabe0 msgr2=0x7fbccc1e8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc0cabe0 0x7fbccc1e8350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00d7d0 tx=0x7fbcbc00dc90 comp rx=0 tx=0).stop 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 shutdown_connections 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbccc1553b0 0x7fbccc1e69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbcb006be30 0x7fbcb006e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbccc0cabe0 0x7fbccc1e8350 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 --2- 172.21.15.96:0/1613290579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbccc0afd20 0x7fbccc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 >> 172.21.15.96:0/1613290579 conn(0x7fbccc0716c0 msgr2=0x7fbccc06b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.525+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 shutdown_connections 2024-04-24T23:59:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.526+0000 7fbcd4800640 1 -- 172.21.15.96:0/1613290579 wait complete. 2024-04-24T23:59:18.547 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-24T23:59:18.547 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:59:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.750+0000 7ff677400640 1 Processor -- start 2024-04-24T23:59:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.751+0000 7ff677400640 1 -- start start 2024-04-24T23:59:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.752+0000 7ff677400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff67006edf0 0x7ff67015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.752+0000 7ff677400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6700ae8e0 0x7ff6700aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.752+0000 7ff677400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67006d100 con 0x7ff670156620 2024-04-24T23:59:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.752+0000 7ff677400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff6700acda0 con 0x7ff67006edf0 2024-04-24T23:59:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.752+0000 7ff677400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6700af2d0 con 0x7ff6700ae8e0 2024-04-24T23:59:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.753+0000 7ff674a00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff670156620 0x7ff67006dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55990/0 (socket says 172.21.15.96:55990) 2024-04-24T23:59:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.753+0000 7ff674a00640 1 -- 172.21.15.96:0/3132290887 learned_addr learned my addr 172.21.15.96:0/3132290887 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.753+0000 7ff66fe00640 1 --2- 172.21.15.96:0/3132290887 >> v2:172.21.15.96:3300/0 conn(0x7ff67006edf0 0x7ff67015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.753+0000 7ff675400640 1 --2- 172.21.15.96:0/3132290887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6700ae8e0 0x7ff6700aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.753+0000 7ff66f400640 1 -- 172.21.15.96:0/3132290887 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425446064 0 0) 0x7ff67006d100 con 0x7ff670156620 2024-04-24T23:59:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.753+0000 7ff66f400640 1 -- 172.21.15.96:0/3132290887 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff654003520 con 0x7ff670156620 2024-04-24T23:59:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.753+0000 7ff66fe00640 1 -- 172.21.15.96:0/3132290887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6700ae8e0 msgr2=0x7ff6700aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.753+0000 7ff66fe00640 1 --2- 172.21.15.96:0/3132290887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6700ae8e0 0x7ff6700aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.753+0000 7ff66fe00640 1 -- 172.21.15.96:0/3132290887 >> v1:172.21.15.96:6789/0 conn(0x7ff670156620 legacy=0x7ff67006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.754+0000 7ff66fe00640 1 -- 172.21.15.96:0/3132290887 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6700ad060 con 0x7ff67006edf0 2024-04-24T23:59:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.755+0000 7ff66fe00640 1 --2- 172.21.15.96:0/3132290887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff67006edf0 0x7ff67015cf70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff6580097a0 tx=0x7ff65802a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b74b8cb2a4ef1bc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.755+0000 7ff66f400640 1 -- 172.21.15.96:0/3132290887 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658037070 con 0x7ff67006edf0 2024-04-24T23:59:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.755+0000 7ff66f400640 1 -- 172.21.15.96:0/3132290887 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65802ae40 con 0x7ff67006edf0 2024-04-24T23:59:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.755+0000 7ff66f400640 1 -- 172.21.15.96:0/3132290887 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658032660 con 0x7ff67006edf0 2024-04-24T23:59:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.755+0000 7ff677400640 1 -- 172.21.15.96:0/3132290887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff67006edf0 msgr2=0x7ff67015cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.755+0000 7ff677400640 1 --2- 172.21.15.96:0/3132290887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff67006edf0 0x7ff67015cf70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff6580097a0 tx=0x7ff65802a0f0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.756+0000 7ff677400640 1 -- 172.21.15.96:0/3132290887 shutdown_connections 2024-04-24T23:59:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.756+0000 7ff677400640 1 --2- 172.21.15.96:0/3132290887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6700ae8e0 0x7ff6700aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.756+0000 7ff677400640 1 --2- 172.21.15.96:0/3132290887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff67006edf0 0x7ff67015cf70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.756+0000 7ff677400640 1 -- 172.21.15.96:0/3132290887 >> 172.21.15.96:0/3132290887 conn(0x7ff6700b19c0 msgr2=0x7ff6700b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.756+0000 7ff677400640 1 -- 172.21.15.96:0/3132290887 shutdown_connections 2024-04-24T23:59:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.756+0000 7ff677400640 1 -- 172.21.15.96:0/3132290887 wait complete. 2024-04-24T23:59:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.757+0000 7ff677400640 1 Processor -- start 2024-04-24T23:59:18.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.758+0000 7ff677400640 1 -- start start 2024-04-24T23:59:18.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff677400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff67006edf0 0x7ff6701542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff677400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6700ae8e0 0x7ff67015b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff677400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff670156620 0x7ff67015b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff677400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff6700ad340 con 0x7ff670156620 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff677400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff67006d680 con 0x7ff6700ae8e0 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff677400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6700ad4c0 con 0x7ff67006edf0 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff675400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff670156620 0x7ff67015b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff675400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff670156620 0x7ff67015b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35958/0 (socket says 172.21.15.96:35958) 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff675400640 1 -- 172.21.15.96:0/3941403091 learned_addr learned my addr 172.21.15.96:0/3941403091 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff674a00640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff67006edf0 0x7ff6701542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.759+0000 7ff66fe00640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6700ae8e0 0x7ff67015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff675400640 1 -- 172.21.15.96:0/3941403091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff67006edf0 msgr2=0x7ff6701542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff675400640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff67006edf0 0x7ff6701542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff675400640 1 -- 172.21.15.96:0/3941403091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6700ae8e0 msgr2=0x7ff67015b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:18.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff675400640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6700ae8e0 0x7ff67015b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:18.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff675400640 1 -- 172.21.15.96:0/3941403091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67009b810 con 0x7ff670156620 2024-04-24T23:59:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff675400640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff670156620 0x7ff67015b970 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff668007e40 tx=0x7ff66800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff66cc00640 1 -- 172.21.15.96:0/3941403091 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668014620 con 0x7ff670156620 2024-04-24T23:59:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff66cc00640 1 -- 172.21.15.96:0/3941403091 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff668019070 con 0x7ff670156620 2024-04-24T23:59:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff66cc00640 1 -- 172.21.15.96:0/3941403091 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668014a20 con 0x7ff670156620 2024-04-24T23:59:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67009baf0 con 0x7ff670156620 2024-04-24T23:59:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.760+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67009c0b0 con 0x7ff670156620 2024-04-24T23:59:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.761+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff670069110 con 0x7ff670156620 2024-04-24T23:59:18.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.763+0000 7ff66cc00640 1 -- 172.21.15.96:0/3941403091 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff668014bc0 con 0x7ff670156620 2024-04-24T23:59:18.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.763+0000 7ff66cc00640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff64c06be30 0x7ff64c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.763+0000 7ff66cc00640 1 -- 172.21.15.96:0/3941403091 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff66808b860 con 0x7ff670156620 2024-04-24T23:59:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.764+0000 7ff674a00640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff64c06be30 0x7ff64c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.765+0000 7ff674a00640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff64c06be30 0x7ff64c06e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff660005880 tx=0x7ff660009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:18.768+0000 7ff66cc00640 1 -- 172.21.15.96:0/3941403091 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff66805a170 con 0x7ff670156620 2024-04-24T23:59:19.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.007+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff6700b0590 con 0x7ff670156620 2024-04-24T23:59:19.444 INFO:tasks.ceph.mds.c.smithi096.stderr:2024-04-24T23:59:19.444+0000 7f7dfbe00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:59:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.536+0000 7ff66cc00640 1 -- 172.21.15.96:0/3941403091 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7ff668059a70 con 0x7ff670156620 2024-04-24T23:59:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff64c06be30 msgr2=0x7ff64c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff64c06be30 0x7ff64c06e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff660005880 tx=0x7ff660009040 comp rx=0 tx=0).stop 2024-04-24T23:59:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff670156620 msgr2=0x7ff67015b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff670156620 0x7ff67015b970 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff668007e40 tx=0x7ff66800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:59:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 shutdown_connections 2024-04-24T23:59:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff64c06be30 0x7ff64c06e2f0 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff660005880 tx=0x7ff660009040 comp rx=0 tx=0).stop 2024-04-24T23:59:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff670156620 0x7ff67015b970 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6700ae8e0 0x7ff67015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 --2- 172.21.15.96:0/3941403091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff67006edf0 0x7ff6701542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:19.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 >> 172.21.15.96:0/3941403091 conn(0x7ff6700b19c0 msgr2=0x7ff6700b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:19.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 shutdown_connections 2024-04-24T23:59:19.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.540+0000 7ff677400640 1 -- 172.21.15.96:0/3941403091 wait complete. 2024-04-24T23:59:19.564 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:59:19.565 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:59:19.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.766+0000 7f7575a00640 1 Processor -- start 2024-04-24T23:59:19.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.766+0000 7f7575a00640 1 -- start start 2024-04-24T23:59:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7575a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75700b4ec0 0x7f75700cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7575a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700ccc20 0x7f7570070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7575a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757015fa90 con 0x7f757015f6b0 2024-04-24T23:59:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7575a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f75700b4a30 con 0x7f75700b4ec0 2024-04-24T23:59:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7575a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f75700b3e20 con 0x7f75700ccc20 2024-04-24T23:59:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7567400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75700b4ec0 0x7f75700cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7567400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75700b4ec0 0x7f75700cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35966/0 (socket says 172.21.15.96:35966) 2024-04-24T23:59:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7567400640 1 -- 172.21.15.96:0/2956830387 learned_addr learned my addr 172.21.15.96:0/2956830387 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7567400640 1 -- 172.21.15.96:0/2956830387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700ccc20 msgr2=0x7f7570070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7567400640 1 --2- 172.21.15.96:0/2956830387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700ccc20 0x7f7570070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.768+0000 7f7567400640 1 -- 172.21.15.96:0/2956830387 >> v1:172.21.15.155:6789/0 conn(0x7f757015f6b0 legacy=0x7f75700ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.769+0000 7f7567400640 1 -- 172.21.15.96:0/2956830387 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75700b4100 con 0x7f75700b4ec0 2024-04-24T23:59:19.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.769+0000 7f7567400640 1 --2- 172.21.15.96:0/2956830387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4ec0 0x7f75700cc6e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7558009870 tx=0x7f755802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f7e160bffd22b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.770+0000 7f756f400640 1 -- 172.21.15.96:0/2956830387 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558037070 con 0x7f75700b4ec0 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.770+0000 7f756f400640 1 -- 172.21.15.96:0/2956830387 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7558032440 con 0x7f75700b4ec0 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.770+0000 7f756f400640 1 -- 172.21.15.96:0/2956830387 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558032810 con 0x7f75700b4ec0 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.770+0000 7f7575a00640 1 -- 172.21.15.96:0/2956830387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4ec0 msgr2=0x7f75700cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.770+0000 7f7575a00640 1 --2- 172.21.15.96:0/2956830387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4ec0 0x7f75700cc6e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7558009870 tx=0x7f755802a210 comp rx=0 tx=0).stop 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.770+0000 7f7575a00640 1 -- 172.21.15.96:0/2956830387 shutdown_connections 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.770+0000 7f7575a00640 1 --2- 172.21.15.96:0/2956830387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700ccc20 0x7f7570070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.770+0000 7f7575a00640 1 --2- 172.21.15.96:0/2956830387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4ec0 0x7f75700cc6e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.770+0000 7f7575a00640 1 -- 172.21.15.96:0/2956830387 >> 172.21.15.96:0/2956830387 conn(0x7f75700b1f10 msgr2=0x7f75700cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.771+0000 7f7575a00640 1 -- 172.21.15.96:0/2956830387 shutdown_connections 2024-04-24T23:59:19.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.771+0000 7f7575a00640 1 -- 172.21.15.96:0/2956830387 wait complete. 2024-04-24T23:59:19.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.772+0000 7f7575a00640 1 Processor -- start 2024-04-24T23:59:19.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.772+0000 7f7575a00640 1 -- start start 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.773+0000 7f7575a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b4ec0 0x7f75700adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.773+0000 7f7575a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75700ccc20 0x7f757009c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.773+0000 7f7575a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f6b0 0x7f75701f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.773+0000 7f7575a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f75700cf1c0 con 0x7f757015f6b0 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.773+0000 7f7575a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f75700b46c0 con 0x7f75700ccc20 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.773+0000 7f7575a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f75700b3a40 con 0x7f75700b4ec0 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f7575000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f6b0 0x7f75701f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f7575000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f6b0 0x7f75701f3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35976/0 (socket says 172.21.15.96:35976) 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f7575000640 1 -- 172.21.15.96:0/827078310 learned_addr learned my addr 172.21.15.96:0/827078310 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f756fe00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b4ec0 0x7f75700adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:19.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f7567400640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75700ccc20 0x7f757009c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f7575000640 1 -- 172.21.15.96:0/827078310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b4ec0 msgr2=0x7f75700adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f7575000640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b4ec0 0x7f75700adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f7575000640 1 -- 172.21.15.96:0/827078310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75700ccc20 msgr2=0x7f757009c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f7575000640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75700ccc20 0x7f757009c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.774+0000 7f7575000640 1 -- 172.21.15.96:0/827078310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75700ae4b0 con 0x7f757015f6b0 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.775+0000 7f7575000640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f6b0 0x7f75701f3fa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f756800b970 tx=0x7f756800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.775+0000 7f756cc00640 1 -- 172.21.15.96:0/827078310 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568019070 con 0x7f757015f6b0 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.775+0000 7f756cc00640 1 -- 172.21.15.96:0/827078310 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f756800cb60 con 0x7f757015f6b0 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.775+0000 7f756cc00640 1 -- 172.21.15.96:0/827078310 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568014440 con 0x7f757015f6b0 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.775+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75701f4b00 con 0x7f757015f6b0 2024-04-24T23:59:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.775+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757009bb00 con 0x7f757015f6b0 2024-04-24T23:59:19.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.776+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75700756b0 con 0x7f757015f6b0 2024-04-24T23:59:19.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.777+0000 7f756cc00640 1 -- 172.21.15.96:0/827078310 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f756801c070 con 0x7f757015f6b0 2024-04-24T23:59:19.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.778+0000 7f756cc00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06be30 0x7f754c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:19.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.778+0000 7f756cc00640 1 -- 172.21.15.96:0/827078310 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f756808abc0 con 0x7f757015f6b0 2024-04-24T23:59:19.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.779+0000 7f756fe00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06be30 0x7f754c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:19.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.779+0000 7f756fe00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06be30 0x7f754c06e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7560006fd0 tx=0x7f7560008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:19.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:19.782+0000 7f756cc00640 1 -- 172.21.15.96:0/827078310 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7568059570 con 0x7f757015f6b0 2024-04-24T23:59:20.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.021+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75700d07d0 con 0x7f757015f6b0 2024-04-24T23:59:20.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.023+0000 7f756cc00640 1 -- 172.21.15.96:0/827078310 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7f7568058e70 con 0x7f757015f6b0 2024-04-24T23:59:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:20.023 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1875464528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1875464528},{"type":"v1","addr":"172.21.15.155:6835","nonce":1875464528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/2449705897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":2449705897},{"type":"v1","addr":"172.21.15.96:6837","nonce":2449705897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4160377725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4160377725},{"type":"v1","addr":"172.21.15.155:6833","nonce":4160377725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:59:15.923615+0000","modified":"2024-04-24T23:59:19.009098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.96:6835/3672280349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3672280349},{"type":"v1","addr":"172.21.15.96:6835","nonce":3672280349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5097,"qdb_cluster":[5097]},"id":2}]} 2024-04-24T23:59:20.024 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-04-24T23:59:20.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06be30 msgr2=0x7f754c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06be30 0x7f754c06e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7560006fd0 tx=0x7f7560008040 comp rx=0 tx=0).stop 2024-04-24T23:59:20.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f6b0 msgr2=0x7f75701f3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f6b0 0x7f75701f3fa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f756800b970 tx=0x7f756800be30 comp rx=0 tx=0).stop 2024-04-24T23:59:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 shutdown_connections 2024-04-24T23:59:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06be30 0x7f754c06e2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f6b0 0x7f75701f3fa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75700ccc20 0x7f757009c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 --2- 172.21.15.96:0/827078310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75700b4ec0 0x7f75700adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 >> 172.21.15.96:0/827078310 conn(0x7f75700b1f10 msgr2=0x7f7570160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 shutdown_connections 2024-04-24T23:59:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.026+0000 7f7575a00640 1 -- 172.21.15.96:0/827078310 wait complete. 2024-04-24T23:59:20.045 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:20.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.245+0000 7f30f7200640 1 Processor -- start 2024-04-24T23:59:20.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.245+0000 7f30f7200640 1 -- start start 2024-04-24T23:59:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.246+0000 7f30f7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f80b4ec0 0x7f30f80cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.246+0000 7f30f7200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f30f80ccc20 0x7f30f8070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f7200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f815fa90 con 0x7f30f815f6b0 2024-04-24T23:59:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f7200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f30f80b4a30 con 0x7f30f80ccc20 2024-04-24T23:59:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80b3e20 con 0x7f30f80b4ec0 2024-04-24T23:59:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f5e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f30f815f6b0 0x7f30f80ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:56000/0 (socket says 172.21.15.96:56000) 2024-04-24T23:59:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f5e00640 1 -- 172.21.15.96:0/4127725869 learned_addr learned my addr 172.21.15.96:0/4127725869 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f6800640 1 --2- 172.21.15.96:0/4127725869 >> v2:172.21.15.96:3300/0 conn(0x7f30f80ccc20 0x7f30f8070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30efe00640 1 --2- 172.21.15.96:0/4127725869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f80b4ec0 0x7f30f80cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f5400640 1 -- 172.21.15.96:0/4127725869 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975460894 0 0) 0x7f30f815fa90 con 0x7f30f815f6b0 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f5400640 1 -- 172.21.15.96:0/4127725869 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30dc003520 con 0x7f30f815f6b0 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f6800640 1 -- 172.21.15.96:0/4127725869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f80b4ec0 msgr2=0x7f30f80cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f6800640 1 --2- 172.21.15.96:0/4127725869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f80b4ec0 0x7f30f80cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f6800640 1 -- 172.21.15.96:0/4127725869 >> v1:172.21.15.96:6789/0 conn(0x7f30f815f6b0 legacy=0x7f30f80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.247+0000 7f30f6800640 1 -- 172.21.15.96:0/4127725869 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80b4100 con 0x7f30f80ccc20 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.248+0000 7f30f6800640 1 --2- 172.21.15.96:0/4127725869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f80ccc20 0x7f30f8070d60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009d90 tx=0x7f30f002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b587db377e758bf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.249+0000 7f30f5400640 1 -- 172.21.15.96:0/4127725869 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0007740 con 0x7f30f80ccc20 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.249+0000 7f30f5400640 1 -- 172.21.15.96:0/4127725869 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f00078e0 con 0x7f30f80ccc20 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.249+0000 7f30f5400640 1 -- 172.21.15.96:0/4127725869 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0007cb0 con 0x7f30f80ccc20 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.249+0000 7f30f7200640 1 -- 172.21.15.96:0/4127725869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f80ccc20 msgr2=0x7f30f8070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.249+0000 7f30f7200640 1 --2- 172.21.15.96:0/4127725869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f80ccc20 0x7f30f8070d60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009d90 tx=0x7f30f002a660 comp rx=0 tx=0).stop 2024-04-24T23:59:20.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.249+0000 7f30f7200640 1 -- 172.21.15.96:0/4127725869 shutdown_connections 2024-04-24T23:59:20.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.249+0000 7f30f7200640 1 --2- 172.21.15.96:0/4127725869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f80ccc20 0x7f30f8070d60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.249+0000 7f30f7200640 1 --2- 172.21.15.96:0/4127725869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f80b4ec0 0x7f30f80cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.249+0000 7f30f7200640 1 -- 172.21.15.96:0/4127725869 >> 172.21.15.96:0/4127725869 conn(0x7f30f80b1f10 msgr2=0x7f30f80cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:20.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.250+0000 7f30f7200640 1 -- 172.21.15.96:0/4127725869 shutdown_connections 2024-04-24T23:59:20.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.250+0000 7f30f7200640 1 -- 172.21.15.96:0/4127725869 wait complete. 2024-04-24T23:59:20.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.251+0000 7f30f7200640 1 Processor -- start 2024-04-24T23:59:20.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.251+0000 7f30f7200640 1 -- start start 2024-04-24T23:59:20.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.252+0000 7f30f7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f80b4ec0 0x7f30f81f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.252+0000 7f30f7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f80ccc20 0x7f30f80ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.252+0000 7f30f7200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f815f6b0 0x7f30f8155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.252+0000 7f30f7200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80cf1c0 con 0x7f30f815f6b0 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.252+0000 7f30f7200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80b46c0 con 0x7f30f80b4ec0 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.252+0000 7f30f7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80b3a40 con 0x7f30f80ccc20 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.253+0000 7f30f6800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f815f6b0 0x7f30f8155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.253+0000 7f30f6800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f815f6b0 0x7f30f8155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35988/0 (socket says 172.21.15.96:35988) 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.253+0000 7f30f6800640 1 -- 172.21.15.96:0/1861567615 learned_addr learned my addr 172.21.15.96:0/1861567615 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.253+0000 7f30f5e00640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f80b4ec0 0x7f30f81f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.253+0000 7f30f6800640 1 -- 172.21.15.96:0/1861567615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f80ccc20 msgr2=0x7f30f80ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.253+0000 7f30f6800640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f80ccc20 0x7f30f80ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.253+0000 7f30f6800640 1 -- 172.21.15.96:0/1861567615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f80b4ec0 msgr2=0x7f30f81f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.253+0000 7f30f6800640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f80b4ec0 0x7f30f81f74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.253+0000 7f30f6800640 1 -- 172.21.15.96:0/1861567615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f809aa70 con 0x7f30f815f6b0 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.254+0000 7f30f6800640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f815f6b0 0x7f30f8155c90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f30f002ac50 tx=0x7f30f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.254+0000 7f30ee000640 1 -- 172.21.15.96:0/1861567615 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0040070 con 0x7f30f815f6b0 2024-04-24T23:59:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.254+0000 7f30ee000640 1 -- 172.21.15.96:0/1861567615 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0031c60 con 0x7f30f815f6b0 2024-04-24T23:59:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.254+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f81f7d40 con 0x7f30f815f6b0 2024-04-24T23:59:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.254+0000 7f30ee000640 1 -- 172.21.15.96:0/1861567615 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0009450 con 0x7f30f815f6b0 2024-04-24T23:59:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.254+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f81f8300 con 0x7f30f815f6b0 2024-04-24T23:59:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.255+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f8067e40 con 0x7f30f815f6b0 2024-04-24T23:59:20.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.256+0000 7f30ee000640 1 -- 172.21.15.96:0/1861567615 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30f0039040 con 0x7f30f815f6b0 2024-04-24T23:59:20.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.257+0000 7f30ee000640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f30d406be60 0x7f30d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.257+0000 7f30ee000640 1 -- 172.21.15.96:0/1861567615 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f30f00ac330 con 0x7f30f815f6b0 2024-04-24T23:59:20.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.257+0000 7f30f5e00640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f30d406be60 0x7f30d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.258+0000 7f30f5e00640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f30d406be60 0x7f30d406e320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30e8000f60 tx=0x7f30e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:20.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.261+0000 7f30ee000640 1 -- 172.21.15.96:0/1861567615 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f30f007ace0 con 0x7f30f815f6b0 2024-04-24T23:59:20.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.463+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30f806eaf0 con 0x7f30f815f6b0 2024-04-24T23:59:20.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.465+0000 7f30ee000640 1 -- 172.21.15.96:0/1861567615 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16621 (secure 0 0 0) 0x7f30f007a5e0 con 0x7f30f815f6b0 2024-04-24T23:59:20.466 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:20.466 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":33,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:17.499374+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:59:13.640002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T23:59:14.952491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:20.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f30d406be60 msgr2=0x7f30d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f30d406be60 0x7f30d406e320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30e8000f60 tx=0x7f30e8009040 comp rx=0 tx=0).stop 2024-04-24T23:59:20.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f815f6b0 msgr2=0x7f30f8155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f815f6b0 0x7f30f8155c90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f30f002ac50 tx=0x7f30f0004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:20.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 shutdown_connections 2024-04-24T23:59:20.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f30d406be60 0x7f30d406e320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f815f6b0 0x7f30f8155c90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f80ccc20 0x7f30f80ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 --2- 172.21.15.96:0/1861567615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f80b4ec0 0x7f30f81f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.468+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 >> 172.21.15.96:0/1861567615 conn(0x7f30f80b1f10 msgr2=0x7f30f80ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:20.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.469+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 shutdown_connections 2024-04-24T23:59:20.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.469+0000 7f30f7200640 1 -- 172.21.15.96:0/1861567615 wait complete. 2024-04-24T23:59:20.488 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:59:20.488 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:59:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.694+0000 7f42bfe00640 1 Processor -- start 2024-04-24T23:59:20.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.694+0000 7f42bfe00640 1 -- start start 2024-04-24T23:59:20.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.696+0000 7f42bfe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b8070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.696+0000 7f42bfe00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f42b815ec70 0x7f42b815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.696+0000 7f42bfe00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b80713d0 con 0x7f42b815f630 2024-04-24T23:59:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.696+0000 7f42bfe00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f42b80aee00 con 0x7f42b815ec70 2024-04-24T23:59:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.696+0000 7f42bfe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f42b815fac0 con 0x7f42b815b220 2024-04-24T23:59:20.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.697+0000 7f42bd400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b8070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.697+0000 7f42bca00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f42b815ec70 0x7f42b815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.697+0000 7f42bd400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b8070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.96:40680/0 (socket says 172.21.15.96:40680) 2024-04-24T23:59:20.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.697+0000 7f42bd400640 1 -- 172.21.15.96:0/3552126314 learned_addr learned my addr 172.21.15.96:0/3552126314 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:20.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.697+0000 7f42bd400640 1 -- 172.21.15.96:0/3552126314 >> v2:172.21.15.155:3300/0 conn(0x7f42b815ec70 msgr2=0x7f42b815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:20.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.697+0000 7f42bd400640 1 --2- 172.21.15.96:0/3552126314 >> v2:172.21.15.155:3300/0 conn(0x7f42b815ec70 0x7f42b815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.697+0000 7f42bd400640 1 -- 172.21.15.96:0/3552126314 >> v1:172.21.15.155:6789/0 conn(0x7f42b815f630 legacy=0x7f42b8071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.697+0000 7f42bd400640 1 -- 172.21.15.96:0/3552126314 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b80ae4d0 con 0x7f42b815b220 2024-04-24T23:59:20.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.699+0000 7f42bd400640 1 --2- 172.21.15.96:0/3552126314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b8070df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009870 tx=0x7f42ac02c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de76d3021c56bae8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:20.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.699+0000 7f42b7e00640 1 -- 172.21.15.96:0/3552126314 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac038070 con 0x7f42b815b220 2024-04-24T23:59:20.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42b7e00640 1 -- 172.21.15.96:0/3552126314 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac031710 con 0x7f42b815b220 2024-04-24T23:59:20.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42b7e00640 1 -- 172.21.15.96:0/3552126314 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac031ae0 con 0x7f42b815b220 2024-04-24T23:59:20.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42bfe00640 1 -- 172.21.15.96:0/3552126314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 msgr2=0x7f42b8070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42bfe00640 1 --2- 172.21.15.96:0/3552126314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b8070df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009870 tx=0x7f42ac02c460 comp rx=0 tx=0).stop 2024-04-24T23:59:20.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42bfe00640 1 -- 172.21.15.96:0/3552126314 shutdown_connections 2024-04-24T23:59:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42bfe00640 1 --2- 172.21.15.96:0/3552126314 >> v2:172.21.15.155:3300/0 conn(0x7f42b815ec70 0x7f42b815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42bfe00640 1 --2- 172.21.15.96:0/3552126314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b8070df0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42bfe00640 1 -- 172.21.15.96:0/3552126314 >> 172.21.15.96:0/3552126314 conn(0x7f42b80b19c0 msgr2=0x7f42b80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42bfe00640 1 -- 172.21.15.96:0/3552126314 shutdown_connections 2024-04-24T23:59:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.700+0000 7f42bfe00640 1 -- 172.21.15.96:0/3552126314 wait complete. 2024-04-24T23:59:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.702+0000 7f42bfe00640 1 Processor -- start 2024-04-24T23:59:20.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.702+0000 7f42bfe00640 1 -- start start 2024-04-24T23:59:20.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.703+0000 7f42bfe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.703+0000 7f42bfe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b815ec70 0x7f42b815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.703+0000 7f42bfe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b815f630 0x7f42b8157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.703+0000 7f42bfe00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f42b806eb90 con 0x7f42b815f630 2024-04-24T23:59:20.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.703+0000 7f42bfe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f42b80aea90 con 0x7f42b815ec70 2024-04-24T23:59:20.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.703+0000 7f42bfe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f42b806ed10 con 0x7f42b815b220 2024-04-24T23:59:20.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.703+0000 7f42bde00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b815f630 0x7f42b8157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.703+0000 7f42bde00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b815f630 0x7f42b8157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35996/0 (socket says 172.21.15.96:35996) 2024-04-24T23:59:20.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.703+0000 7f42bde00640 1 -- 172.21.15.96:0/3555733041 learned_addr learned my addr 172.21.15.96:0/3555733041 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.704+0000 7f42bd400640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.704+0000 7f42bca00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b815ec70 0x7f42b815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.704+0000 7f42bde00640 1 -- 172.21.15.96:0/3555733041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 msgr2=0x7f42b814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.704+0000 7f42bde00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.704+0000 7f42bde00640 1 -- 172.21.15.96:0/3555733041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b815ec70 msgr2=0x7f42b815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.704+0000 7f42bde00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b815ec70 0x7f42b815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.704+0000 7f42bde00640 1 -- 172.21.15.96:0/3555733041 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b814ce80 con 0x7f42b815f630 2024-04-24T23:59:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.704+0000 7f42bde00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b815f630 0x7f42b8157090 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f42b000c730 tx=0x7f42b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.705+0000 7f42b5600640 1 -- 172.21.15.96:0/3555733041 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0003b70 con 0x7f42b815f630 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.705+0000 7f42b5600640 1 -- 172.21.15.96:0/3555733041 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0003d30 con 0x7f42b815f630 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.705+0000 7f42b5600640 1 -- 172.21.15.96:0/3555733041 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0005310 con 0x7f42b815f630 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.705+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b81f4130 con 0x7f42b815f630 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.705+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b809bad0 con 0x7f42b815f630 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.706+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b809b610 con 0x7f42b815f630 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.707+0000 7f42b5600640 1 -- 172.21.15.96:0/3555733041 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42b00054b0 con 0x7f42b815f630 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.708+0000 7f42b5600640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f429806be30 0x7f429806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.708+0000 7f42b5600640 1 -- 172.21.15.96:0/3555733041 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f42b008ad80 con 0x7f42b815f630 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.708+0000 7f42bd400640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f429806be30 0x7f429806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.709+0000 7f42bd400640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f429806be30 0x7f429806e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42ac035000 tx=0x7f42ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:20.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.712+0000 7f42b5600640 1 -- 172.21.15.96:0/3555733041 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f42b809b610 con 0x7f42b815f630 2024-04-24T23:59:20.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.909+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42b806e610 con 0x7f429806be30 2024-04-24T23:59:20.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.919+0000 7f42b5600640 1 -- 172.21.15.96:0/3555733041 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251950 (secure 0 0 0) 0x7f42b806e610 con 0x7f429806be30 2024-04-24T23:59:20.924 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:20.927 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-24T23:59:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f429806be30 msgr2=0x7f429806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f429806be30 0x7f429806e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42ac035000 tx=0x7f42ac008030 comp rx=0 tx=0).stop 2024-04-24T23:59:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b815f630 msgr2=0x7f42b8157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b815f630 0x7f42b8157090 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f42b000c730 tx=0x7f42b000cbf0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 shutdown_connections 2024-04-24T23:59:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f429806be30 0x7f429806e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b815f630 0x7f42b8157090 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b815ec70 0x7f42b815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 --2- 172.21.15.96:0/3555733041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b815b220 0x7f42b814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 >> 172.21.15.96:0/3555733041 conn(0x7f42b80b19c0 msgr2=0x7f42b80afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 shutdown_connections 2024-04-24T23:59:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:20.923+0000 7f42bfe00640 1 -- 172.21.15.96:0/3555733041 wait complete. 2024-04-24T23:59:20.942 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-24T23:59:20.323062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220348,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754372,"statfs":{"total":773094113280,"available":772868476928,"internally_reserved":0,"allocated":4235264,"data_stored":2359780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.871883"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519073+0000","last_change":"2024-04-24T23:59:16.521433+0000","last_active":"2024-04-24T23:59:17.519073+0000","last_peered":"2024-04-24T23:59:17.519073+0000","last_clean":"2024-04-24T23:59:17.519073+0000","last_became_active":"2024-04-24T23:59:16.520775+0000","last_became_peered":"2024-04-24T23:59:16.520775+0000","last_unstale":"2024-04-24T23:59:17.519073+0000","last_undegraded":"2024-04-24T23:59:17.519073+0000","last_fullsized":"2024-04-24T23:59:17.519073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:25:37.828138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768626+0000","last_change":"2024-04-24T23:59:16.518660+0000","last_active":"2024-04-24T23:59:17.768626+0000","last_peered":"2024-04-24T23:59:17.768626+0000","last_clean":"2024-04-24T23:59:17.768626+0000","last_became_active":"2024-04-24T23:59:16.517645+0000","last_became_peered":"2024-04-24T23:59:16.517645+0000","last_unstale":"2024-04-24T23:59:17.768626+0000","last_undegraded":"2024-04-24T23:59:17.768626+0000","last_fullsized":"2024-04-24T23:59:17.768626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:39.048928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765837+0000","last_change":"2024-04-24T23:59:16.524178+0000","last_active":"2024-04-24T23:59:17.765837+0000","last_peered":"2024-04-24T23:59:17.765837+0000","last_clean":"2024-04-24T23:59:17.765837+0000","last_became_active":"2024-04-24T23:59:16.523899+0000","last_became_peered":"2024-04-24T23:59:16.523899+0000","last_unstale":"2024-04-24T23:59:17.765837+0000","last_undegraded":"2024-04-24T23:59:17.765837+0000","last_fullsized":"2024-04-24T23:59:17.765837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:51.111395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767600+0000","last_change":"2024-04-24T23:59:16.532418+0000","last_active":"2024-04-24T23:59:17.767600+0000","last_peered":"2024-04-24T23:59:17.767600+0000","last_clean":"2024-04-24T23:59:17.767600+0000","last_became_active":"2024-04-24T23:59:16.532000+0000","last_became_peered":"2024-04-24T23:59:16.532000+0000","last_unstale":"2024-04-24T23:59:17.767600+0000","last_undegraded":"2024-04-24T23:59:17.767600+0000","last_fullsized":"2024-04-24T23:59:17.767600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:15.060759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763990+0000","last_change":"2024-04-24T23:59:16.513270+0000","last_active":"2024-04-24T23:59:17.763990+0000","last_peered":"2024-04-24T23:59:17.763990+0000","last_clean":"2024-04-24T23:59:17.763990+0000","last_became_active":"2024-04-24T23:59:16.512991+0000","last_became_peered":"2024-04-24T23:59:16.512991+0000","last_unstale":"2024-04-24T23:59:17.763990+0000","last_undegraded":"2024-04-24T23:59:17.763990+0000","last_fullsized":"2024-04-24T23:59:17.763990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:59.699454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765730+0000","last_change":"2024-04-24T23:59:16.516471+0000","last_active":"2024-04-24T23:59:17.765730+0000","last_peered":"2024-04-24T23:59:17.765730+0000","last_clean":"2024-04-24T23:59:17.765730+0000","last_became_active":"2024-04-24T23:59:16.516251+0000","last_became_peered":"2024-04-24T23:59:16.516251+0000","last_unstale":"2024-04-24T23:59:17.765730+0000","last_undegraded":"2024-04-24T23:59:17.765730+0000","last_fullsized":"2024-04-24T23:59:17.765730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:40:33.669402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767749+0000","last_change":"2024-04-24T23:59:16.526810+0000","last_active":"2024-04-24T23:59:17.767749+0000","last_peered":"2024-04-24T23:59:17.767749+0000","last_clean":"2024-04-24T23:59:17.767749+0000","last_became_active":"2024-04-24T23:59:16.526504+0000","last_became_peered":"2024-04-24T23:59:16.526504+0000","last_unstale":"2024-04-24T23:59:17.767749+0000","last_undegraded":"2024-04-24T23:59:17.767749+0000","last_fullsized":"2024-04-24T23:59:17.767749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:51.111395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766041+0000","last_change":"2024-04-24T23:59:16.519716+0000","last_active":"2024-04-24T23:59:17.766041+0000","last_peered":"2024-04-24T23:59:17.766041+0000","last_clean":"2024-04-24T23:59:17.766041+0000","last_became_active":"2024-04-24T23:59:16.518467+0000","last_became_peered":"2024-04-24T23:59:16.518467+0000","last_unstale":"2024-04-24T23:59:17.766041+0000","last_undegraded":"2024-04-24T23:59:17.766041+0000","last_fullsized":"2024-04-24T23:59:17.766041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:52.589555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520608+0000","last_change":"2024-04-24T23:59:16.530591+0000","last_active":"2024-04-24T23:59:17.520608+0000","last_peered":"2024-04-24T23:59:17.520608+0000","last_clean":"2024-04-24T23:59:17.520608+0000","last_became_active":"2024-04-24T23:59:16.530140+0000","last_became_peered":"2024-04-24T23:59:16.530140+0000","last_unstale":"2024-04-24T23:59:17.520608+0000","last_undegraded":"2024-04-24T23:59:17.520608+0000","last_fullsized":"2024-04-24T23:59:17.520608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:48.703131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767990+0000","last_change":"2024-04-24T23:59:16.521751+0000","last_active":"2024-04-24T23:59:17.767990+0000","last_peered":"2024-04-24T23:59:17.767990+0000","last_clean":"2024-04-24T23:59:17.767990+0000","last_became_active":"2024-04-24T23:59:16.521462+0000","last_became_peered":"2024-04-24T23:59:16.521462+0000","last_unstale":"2024-04-24T23:59:17.767990+0000","last_undegraded":"2024-04-24T23:59:17.767990+0000","last_fullsized":"2024-04-24T23:59:17.767990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:52.589555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768311+0000","last_change":"2024-04-24T23:59:16.527785+0000","last_active":"2024-04-24T23:59:17.768311+0000","last_peered":"2024-04-24T23:59:17.768311+0000","last_clean":"2024-04-24T23:59:17.768311+0000","last_became_active":"2024-04-24T23:59:16.527508+0000","last_became_peered":"2024-04-24T23:59:16.527508+0000","last_unstale":"2024-04-24T23:59:17.768311+0000","last_undegraded":"2024-04-24T23:59:17.768311+0000","last_fullsized":"2024-04-24T23:59:17.768311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:25.600843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765417+0000","last_change":"2024-04-24T23:59:16.504823+0000","last_active":"2024-04-24T23:59:17.765417+0000","last_peered":"2024-04-24T23:59:17.765417+0000","last_clean":"2024-04-24T23:59:17.765417+0000","last_became_active":"2024-04-24T23:59:16.504475+0000","last_became_peered":"2024-04-24T23:59:16.504475+0000","last_unstale":"2024-04-24T23:59:17.765417+0000","last_undegraded":"2024-04-24T23:59:17.765417+0000","last_fullsized":"2024-04-24T23:59:17.765417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.549589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763462+0000","last_change":"2024-04-24T23:59:16.525271+0000","last_active":"2024-04-24T23:59:17.763462+0000","last_peered":"2024-04-24T23:59:17.763462+0000","last_clean":"2024-04-24T23:59:17.763462+0000","last_became_active":"2024-04-24T23:59:16.525038+0000","last_became_peered":"2024-04-24T23:59:16.525038+0000","last_unstale":"2024-04-24T23:59:17.763462+0000","last_undegraded":"2024-04-24T23:59:17.763462+0000","last_fullsized":"2024-04-24T23:59:17.763462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:37.488597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766004+0000","last_change":"2024-04-24T23:59:16.506343+0000","last_active":"2024-04-24T23:59:17.766004+0000","last_peered":"2024-04-24T23:59:17.766004+0000","last_clean":"2024-04-24T23:59:17.766004+0000","last_became_active":"2024-04-24T23:59:16.505688+0000","last_became_peered":"2024-04-24T23:59:16.505688+0000","last_unstale":"2024-04-24T23:59:17.766004+0000","last_undegraded":"2024-04-24T23:59:17.766004+0000","last_fullsized":"2024-04-24T23:59:17.766004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:27.394923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764906+0000","last_change":"2024-04-24T23:59:16.508412+0000","last_active":"2024-04-24T23:59:17.764906+0000","last_peered":"2024-04-24T23:59:17.764906+0000","last_clean":"2024-04-24T23:59:17.764906+0000","last_became_active":"2024-04-24T23:59:16.507819+0000","last_became_peered":"2024-04-24T23:59:16.507819+0000","last_unstale":"2024-04-24T23:59:17.764906+0000","last_undegraded":"2024-04-24T23:59:17.764906+0000","last_fullsized":"2024-04-24T23:59:17.764906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:27.914859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767354+0000","last_change":"2024-04-24T23:59:16.520685+0000","last_active":"2024-04-24T23:59:17.767354+0000","last_peered":"2024-04-24T23:59:17.767354+0000","last_clean":"2024-04-24T23:59:17.767354+0000","last_became_active":"2024-04-24T23:59:16.520360+0000","last_became_peered":"2024-04-24T23:59:16.520360+0000","last_unstale":"2024-04-24T23:59:17.767354+0000","last_undegraded":"2024-04-24T23:59:17.767354+0000","last_fullsized":"2024-04-24T23:59:17.767354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:08.604405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768785+0000","last_change":"2024-04-24T23:59:16.517413+0000","last_active":"2024-04-24T23:59:17.768785+0000","last_peered":"2024-04-24T23:59:17.768785+0000","last_clean":"2024-04-24T23:59:17.768785+0000","last_became_active":"2024-04-24T23:59:16.517065+0000","last_became_peered":"2024-04-24T23:59:16.517065+0000","last_unstale":"2024-04-24T23:59:17.768785+0000","last_undegraded":"2024-04-24T23:59:17.768785+0000","last_fullsized":"2024-04-24T23:59:17.768785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.708449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768909+0000","last_change":"2024-04-24T23:59:16.525461+0000","last_active":"2024-04-24T23:59:17.768909+0000","last_peered":"2024-04-24T23:59:17.768909+0000","last_clean":"2024-04-24T23:59:17.768909+0000","last_became_active":"2024-04-24T23:59:16.524311+0000","last_became_peered":"2024-04-24T23:59:16.524311+0000","last_unstale":"2024-04-24T23:59:17.768909+0000","last_undegraded":"2024-04-24T23:59:17.768909+0000","last_fullsized":"2024-04-24T23:59:17.768909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:10:30.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768249+0000","last_change":"2024-04-24T23:59:16.526795+0000","last_active":"2024-04-24T23:59:17.768249+0000","last_peered":"2024-04-24T23:59:17.768249+0000","last_clean":"2024-04-24T23:59:17.768249+0000","last_became_active":"2024-04-24T23:59:16.526316+0000","last_became_peered":"2024-04-24T23:59:16.526316+0000","last_unstale":"2024-04-24T23:59:17.768249+0000","last_undegraded":"2024-04-24T23:59:17.768249+0000","last_fullsized":"2024-04-24T23:59:17.768249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:30.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763863+0000","last_change":"2024-04-24T23:59:16.519348+0000","last_active":"2024-04-24T23:59:17.763863+0000","last_peered":"2024-04-24T23:59:17.763863+0000","last_clean":"2024-04-24T23:59:17.763863+0000","last_became_active":"2024-04-24T23:59:16.518941+0000","last_became_peered":"2024-04-24T23:59:16.518941+0000","last_unstale":"2024-04-24T23:59:17.763863+0000","last_undegraded":"2024-04-24T23:59:17.763863+0000","last_fullsized":"2024-04-24T23:59:17.763863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:28.897675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519490+0000","last_change":"2024-04-24T23:59:16.535140+0000","last_active":"2024-04-24T23:59:17.519490+0000","last_peered":"2024-04-24T23:59:17.519490+0000","last_clean":"2024-04-24T23:59:17.519490+0000","last_became_active":"2024-04-24T23:59:16.534863+0000","last_became_peered":"2024-04-24T23:59:16.534863+0000","last_unstale":"2024-04-24T23:59:17.519490+0000","last_undegraded":"2024-04-24T23:59:17.519490+0000","last_fullsized":"2024-04-24T23:59:17.519490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:41.824787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519526+0000","last_change":"2024-04-24T23:59:16.526268+0000","last_active":"2024-04-24T23:59:17.519526+0000","last_peered":"2024-04-24T23:59:17.519526+0000","last_clean":"2024-04-24T23:59:17.519526+0000","last_became_active":"2024-04-24T23:59:16.525923+0000","last_became_peered":"2024-04-24T23:59:16.525923+0000","last_unstale":"2024-04-24T23:59:17.519526+0000","last_undegraded":"2024-04-24T23:59:17.519526+0000","last_fullsized":"2024-04-24T23:59:17.519526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:42.045158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515769+0000","last_change":"2024-04-24T23:59:16.526834+0000","last_active":"2024-04-24T23:59:17.515769+0000","last_peered":"2024-04-24T23:59:17.515769+0000","last_clean":"2024-04-24T23:59:17.515769+0000","last_became_active":"2024-04-24T23:59:16.526570+0000","last_became_peered":"2024-04-24T23:59:16.526570+0000","last_unstale":"2024-04-24T23:59:17.515769+0000","last_undegraded":"2024-04-24T23:59:17.515769+0000","last_fullsized":"2024-04-24T23:59:17.515769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:41.444542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764488+0000","last_change":"2024-04-24T23:59:16.519422+0000","last_active":"2024-04-24T23:59:17.764488+0000","last_peered":"2024-04-24T23:59:17.764488+0000","last_clean":"2024-04-24T23:59:17.764488+0000","last_became_active":"2024-04-24T23:59:16.515125+0000","last_became_peered":"2024-04-24T23:59:16.515125+0000","last_unstale":"2024-04-24T23:59:17.764488+0000","last_undegraded":"2024-04-24T23:59:17.764488+0000","last_fullsized":"2024-04-24T23:59:17.764488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:52.589555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768785+0000","last_change":"2024-04-24T23:59:16.525359+0000","last_active":"2024-04-24T23:59:17.768785+0000","last_peered":"2024-04-24T23:59:17.768785+0000","last_clean":"2024-04-24T23:59:17.768785+0000","last_became_active":"2024-04-24T23:59:16.525046+0000","last_became_peered":"2024-04-24T23:59:16.525046+0000","last_unstale":"2024-04-24T23:59:17.768785+0000","last_undegraded":"2024-04-24T23:59:17.768785+0000","last_fullsized":"2024-04-24T23:59:17.768785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:27.914859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768773+0000","last_change":"2024-04-24T23:59:16.519700+0000","last_active":"2024-04-24T23:59:17.768773+0000","last_peered":"2024-04-24T23:59:17.768773+0000","last_clean":"2024-04-24T23:59:17.768773+0000","last_became_active":"2024-04-24T23:59:16.519404+0000","last_became_peered":"2024-04-24T23:59:16.519404+0000","last_unstale":"2024-04-24T23:59:17.768773+0000","last_undegraded":"2024-04-24T23:59:17.768773+0000","last_fullsized":"2024-04-24T23:59:17.768773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:39.958333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767728+0000","last_change":"2024-04-24T23:59:16.538131+0000","last_active":"2024-04-24T23:59:17.767728+0000","last_peered":"2024-04-24T23:59:17.767728+0000","last_clean":"2024-04-24T23:59:17.767728+0000","last_became_active":"2024-04-24T23:59:16.537774+0000","last_became_peered":"2024-04-24T23:59:16.537774+0000","last_unstale":"2024-04-24T23:59:17.767728+0000","last_undegraded":"2024-04-24T23:59:17.767728+0000","last_fullsized":"2024-04-24T23:59:17.767728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:37.835711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765907+0000","last_change":"2024-04-24T23:59:16.519547+0000","last_active":"2024-04-24T23:59:17.765907+0000","last_peered":"2024-04-24T23:59:17.765907+0000","last_clean":"2024-04-24T23:59:17.765907+0000","last_became_active":"2024-04-24T23:59:16.519262+0000","last_became_peered":"2024-04-24T23:59:16.519262+0000","last_unstale":"2024-04-24T23:59:17.765907+0000","last_undegraded":"2024-04-24T23:59:17.765907+0000","last_fullsized":"2024-04-24T23:59:17.765907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:40:33.669402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519888+0000","last_change":"2024-04-24T23:59:16.529252+0000","last_active":"2024-04-24T23:59:17.519888+0000","last_peered":"2024-04-24T23:59:17.519888+0000","last_clean":"2024-04-24T23:59:17.519888+0000","last_became_active":"2024-04-24T23:59:16.528902+0000","last_became_peered":"2024-04-24T23:59:16.528902+0000","last_unstale":"2024-04-24T23:59:17.519888+0000","last_undegraded":"2024-04-24T23:59:17.519888+0000","last_fullsized":"2024-04-24T23:59:17.519888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:34.068265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767750+0000","last_change":"2024-04-24T23:59:16.524466+0000","last_active":"2024-04-24T23:59:17.767750+0000","last_peered":"2024-04-24T23:59:17.767750+0000","last_clean":"2024-04-24T23:59:17.767750+0000","last_became_active":"2024-04-24T23:59:16.524198+0000","last_became_peered":"2024-04-24T23:59:16.524198+0000","last_unstale":"2024-04-24T23:59:17.767750+0000","last_undegraded":"2024-04-24T23:59:17.767750+0000","last_fullsized":"2024-04-24T23:59:17.767750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:49.518009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518071+0000","last_change":"2024-04-24T23:59:16.507806+0000","last_active":"2024-04-24T23:59:17.518071+0000","last_peered":"2024-04-24T23:59:17.518071+0000","last_clean":"2024-04-24T23:59:17.518071+0000","last_became_active":"2024-04-24T23:59:16.507332+0000","last_became_peered":"2024-04-24T23:59:16.507332+0000","last_unstale":"2024-04-24T23:59:17.518071+0000","last_undegraded":"2024-04-24T23:59:17.518071+0000","last_fullsized":"2024-04-24T23:59:17.518071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:42.045158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766473+0000","last_change":"2024-04-24T23:59:16.535617+0000","last_active":"2024-04-24T23:59:17.766473+0000","last_peered":"2024-04-24T23:59:17.766473+0000","last_clean":"2024-04-24T23:59:17.766473+0000","last_became_active":"2024-04-24T23:59:16.534650+0000","last_became_peered":"2024-04-24T23:59:16.534650+0000","last_unstale":"2024-04-24T23:59:17.766473+0000","last_undegraded":"2024-04-24T23:59:17.766473+0000","last_fullsized":"2024-04-24T23:59:17.766473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.358841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515792+0000","last_change":"2024-04-24T23:59:16.523198+0000","last_active":"2024-04-24T23:59:17.515792+0000","last_peered":"2024-04-24T23:59:17.515792+0000","last_clean":"2024-04-24T23:59:17.515792+0000","last_became_active":"2024-04-24T23:59:16.522790+0000","last_became_peered":"2024-04-24T23:59:16.522790+0000","last_unstale":"2024-04-24T23:59:17.515792+0000","last_undegraded":"2024-04-24T23:59:17.515792+0000","last_fullsized":"2024-04-24T23:59:17.515792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:33.753248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519476+0000","last_change":"2024-04-24T23:59:15.500439+0000","last_active":"2024-04-24T23:59:17.519476+0000","last_peered":"2024-04-24T23:59:17.519476+0000","last_clean":"2024-04-24T23:59:17.519476+0000","last_became_active":"2024-04-24T23:59:15.500137+0000","last_became_peered":"2024-04-24T23:59:15.500137+0000","last_unstale":"2024-04-24T23:59:17.519476+0000","last_undegraded":"2024-04-24T23:59:17.519476+0000","last_fullsized":"2024-04-24T23:59:17.519476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:36.475914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519517+0000","last_change":"2024-04-24T23:59:16.533100+0000","last_active":"2024-04-24T23:59:17.519517+0000","last_peered":"2024-04-24T23:59:17.519517+0000","last_clean":"2024-04-24T23:59:17.519517+0000","last_became_active":"2024-04-24T23:59:16.532818+0000","last_became_peered":"2024-04-24T23:59:16.532818+0000","last_unstale":"2024-04-24T23:59:17.519517+0000","last_undegraded":"2024-04-24T23:59:17.519517+0000","last_fullsized":"2024-04-24T23:59:17.519517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:48.703131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515910+0000","last_change":"2024-04-24T23:59:15.494104+0000","last_active":"2024-04-24T23:59:17.515910+0000","last_peered":"2024-04-24T23:59:17.515910+0000","last_clean":"2024-04-24T23:59:17.515910+0000","last_became_active":"2024-04-24T23:59:15.493778+0000","last_became_peered":"2024-04-24T23:59:15.493778+0000","last_unstale":"2024-04-24T23:59:17.515910+0000","last_undegraded":"2024-04-24T23:59:17.515910+0000","last_fullsized":"2024-04-24T23:59:17.515910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:58.686771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520332+0000","last_change":"2024-04-24T23:59:16.530565+0000","last_active":"2024-04-24T23:59:17.520332+0000","last_peered":"2024-04-24T23:59:17.520332+0000","last_clean":"2024-04-24T23:59:17.520332+0000","last_became_active":"2024-04-24T23:59:16.530199+0000","last_became_peered":"2024-04-24T23:59:16.530199+0000","last_unstale":"2024-04-24T23:59:17.520332+0000","last_undegraded":"2024-04-24T23:59:17.520332+0000","last_fullsized":"2024-04-24T23:59:17.520332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:25:37.828138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768448+0000","last_change":"2024-04-24T23:59:15.497744+0000","last_active":"2024-04-24T23:59:17.768448+0000","last_peered":"2024-04-24T23:59:17.768448+0000","last_clean":"2024-04-24T23:59:17.768448+0000","last_became_active":"2024-04-24T23:59:15.497391+0000","last_became_peered":"2024-04-24T23:59:15.497391+0000","last_unstale":"2024-04-24T23:59:17.768448+0000","last_undegraded":"2024-04-24T23:59:17.768448+0000","last_fullsized":"2024-04-24T23:59:17.768448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:32.740566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768040+0000","last_change":"2024-04-24T23:59:16.537470+0000","last_active":"2024-04-24T23:59:17.768040+0000","last_peered":"2024-04-24T23:59:17.768040+0000","last_clean":"2024-04-24T23:59:17.768040+0000","last_became_active":"2024-04-24T23:59:16.537222+0000","last_became_peered":"2024-04-24T23:59:16.537222+0000","last_unstale":"2024-04-24T23:59:17.768040+0000","last_undegraded":"2024-04-24T23:59:17.768040+0000","last_fullsized":"2024-04-24T23:59:17.768040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.358841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764125+0000","last_change":"2024-04-24T23:59:15.487618+0000","last_active":"2024-04-24T23:59:17.764125+0000","last_peered":"2024-04-24T23:59:17.764125+0000","last_clean":"2024-04-24T23:59:17.764125+0000","last_became_active":"2024-04-24T23:59:15.487070+0000","last_became_peered":"2024-04-24T23:59:15.487070+0000","last_unstale":"2024-04-24T23:59:17.764125+0000","last_undegraded":"2024-04-24T23:59:17.764125+0000","last_fullsized":"2024-04-24T23:59:17.764125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:48.901884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767994+0000","last_change":"2024-04-24T23:59:16.536474+0000","last_active":"2024-04-24T23:59:17.767994+0000","last_peered":"2024-04-24T23:59:17.767994+0000","last_clean":"2024-04-24T23:59:17.767994+0000","last_became_active":"2024-04-24T23:59:16.535161+0000","last_became_peered":"2024-04-24T23:59:16.535161+0000","last_unstale":"2024-04-24T23:59:17.767994+0000","last_undegraded":"2024-04-24T23:59:17.767994+0000","last_fullsized":"2024-04-24T23:59:17.767994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:40:33.669402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520489+0000","last_change":"2024-04-24T23:59:15.494023+0000","last_active":"2024-04-24T23:59:17.520489+0000","last_peered":"2024-04-24T23:59:17.520489+0000","last_clean":"2024-04-24T23:59:17.520489+0000","last_became_active":"2024-04-24T23:59:15.493748+0000","last_became_peered":"2024-04-24T23:59:15.493748+0000","last_unstale":"2024-04-24T23:59:17.520489+0000","last_undegraded":"2024-04-24T23:59:17.520489+0000","last_fullsized":"2024-04-24T23:59:17.520489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:30.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764657+0000","last_change":"2024-04-24T23:59:16.520632+0000","last_active":"2024-04-24T23:59:17.764657+0000","last_peered":"2024-04-24T23:59:17.764657+0000","last_clean":"2024-04-24T23:59:17.764657+0000","last_became_active":"2024-04-24T23:59:16.520284+0000","last_became_peered":"2024-04-24T23:59:16.520284+0000","last_unstale":"2024-04-24T23:59:17.764657+0000","last_undegraded":"2024-04-24T23:59:17.764657+0000","last_fullsized":"2024-04-24T23:59:17.764657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.358841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519807+0000","last_change":"2024-04-24T23:59:15.496589+0000","last_active":"2024-04-24T23:59:17.519807+0000","last_peered":"2024-04-24T23:59:17.519807+0000","last_clean":"2024-04-24T23:59:17.519807+0000","last_became_active":"2024-04-24T23:59:15.494812+0000","last_became_peered":"2024-04-24T23:59:15.494812+0000","last_unstale":"2024-04-24T23:59:17.519807+0000","last_undegraded":"2024-04-24T23:59:17.519807+0000","last_fullsized":"2024-04-24T23:59:17.519807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:45.556721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518265+0000","last_change":"2024-04-24T23:59:16.511398+0000","last_active":"2024-04-24T23:59:17.518265+0000","last_peered":"2024-04-24T23:59:17.518265+0000","last_clean":"2024-04-24T23:59:17.518265+0000","last_became_active":"2024-04-24T23:59:16.511026+0000","last_became_peered":"2024-04-24T23:59:16.511026+0000","last_unstale":"2024-04-24T23:59:17.518265+0000","last_undegraded":"2024-04-24T23:59:17.518265+0000","last_fullsized":"2024-04-24T23:59:17.518265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.754570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763747+0000","last_change":"2024-04-24T23:59:15.490318+0000","last_active":"2024-04-24T23:59:17.763747+0000","last_peered":"2024-04-24T23:59:17.763747+0000","last_clean":"2024-04-24T23:59:17.763747+0000","last_became_active":"2024-04-24T23:59:15.489342+0000","last_became_peered":"2024-04-24T23:59:15.489342+0000","last_unstale":"2024-04-24T23:59:17.763747+0000","last_undegraded":"2024-04-24T23:59:17.763747+0000","last_fullsized":"2024-04-24T23:59:17.763747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:47.690448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764832+0000","last_change":"2024-04-24T23:59:16.523624+0000","last_active":"2024-04-24T23:59:17.764832+0000","last_peered":"2024-04-24T23:59:17.764832+0000","last_clean":"2024-04-24T23:59:17.764832+0000","last_became_active":"2024-04-24T23:59:16.523353+0000","last_became_peered":"2024-04-24T23:59:16.523353+0000","last_unstale":"2024-04-24T23:59:17.764832+0000","last_undegraded":"2024-04-24T23:59:17.764832+0000","last_fullsized":"2024-04-24T23:59:17.764832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:53.054861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518310+0000","last_change":"2024-04-24T23:59:15.491164+0000","last_active":"2024-04-24T23:59:17.518310+0000","last_peered":"2024-04-24T23:59:17.518310+0000","last_clean":"2024-04-24T23:59:17.518310+0000","last_became_active":"2024-04-24T23:59:15.490884+0000","last_became_peered":"2024-04-24T23:59:15.490884+0000","last_unstale":"2024-04-24T23:59:17.518310+0000","last_undegraded":"2024-04-24T23:59:17.518310+0000","last_fullsized":"2024-04-24T23:59:17.518310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:48.901884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766219+0000","last_change":"2024-04-24T23:59:16.515321+0000","last_active":"2024-04-24T23:59:17.766219+0000","last_peered":"2024-04-24T23:59:17.766219+0000","last_clean":"2024-04-24T23:59:17.766219+0000","last_became_active":"2024-04-24T23:59:16.514964+0000","last_became_peered":"2024-04-24T23:59:16.514964+0000","last_unstale":"2024-04-24T23:59:17.766219+0000","last_undegraded":"2024-04-24T23:59:17.766219+0000","last_fullsized":"2024-04-24T23:59:17.766219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:27.394923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.769387+0000","last_change":"2024-04-24T23:59:15.494956+0000","last_active":"2024-04-24T23:59:17.769387+0000","last_peered":"2024-04-24T23:59:17.769387+0000","last_clean":"2024-04-24T23:59:17.769387+0000","last_became_active":"2024-04-24T23:59:15.494666+0000","last_became_peered":"2024-04-24T23:59:15.494666+0000","last_unstale":"2024-04-24T23:59:17.769387+0000","last_undegraded":"2024-04-24T23:59:17.769387+0000","last_fullsized":"2024-04-24T23:59:17.769387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:52.042178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.769154+0000","last_change":"2024-04-24T23:59:16.525916+0000","last_active":"2024-04-24T23:59:17.769154+0000","last_peered":"2024-04-24T23:59:17.769154+0000","last_clean":"2024-04-24T23:59:17.769154+0000","last_became_active":"2024-04-24T23:59:16.525446+0000","last_became_peered":"2024-04-24T23:59:16.525446+0000","last_unstale":"2024-04-24T23:59:17.769154+0000","last_undegraded":"2024-04-24T23:59:17.769154+0000","last_fullsized":"2024-04-24T23:59:17.769154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:37.353908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515895+0000","last_change":"2024-04-24T23:59:15.490272+0000","last_active":"2024-04-24T23:59:17.515895+0000","last_peered":"2024-04-24T23:59:17.515895+0000","last_clean":"2024-04-24T23:59:17.515895+0000","last_became_active":"2024-04-24T23:59:15.489910+0000","last_became_peered":"2024-04-24T23:59:15.489910+0000","last_unstale":"2024-04-24T23:59:17.515895+0000","last_undegraded":"2024-04-24T23:59:17.515895+0000","last_fullsized":"2024-04-24T23:59:17.515895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:12.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767492+0000","last_change":"2024-04-24T23:59:16.519990+0000","last_active":"2024-04-24T23:59:17.767492+0000","last_peered":"2024-04-24T23:59:17.767492+0000","last_clean":"2024-04-24T23:59:17.767492+0000","last_became_active":"2024-04-24T23:59:16.519753+0000","last_became_peered":"2024-04-24T23:59:16.519753+0000","last_unstale":"2024-04-24T23:59:17.767492+0000","last_undegraded":"2024-04-24T23:59:17.767492+0000","last_fullsized":"2024-04-24T23:59:17.767492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.708449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766180+0000","last_change":"2024-04-24T23:59:15.499875+0000","last_active":"2024-04-24T23:59:17.766180+0000","last_peered":"2024-04-24T23:59:17.766180+0000","last_clean":"2024-04-24T23:59:17.766180+0000","last_became_active":"2024-04-24T23:59:15.499556+0000","last_became_peered":"2024-04-24T23:59:15.499556+0000","last_unstale":"2024-04-24T23:59:17.766180+0000","last_undegraded":"2024-04-24T23:59:17.766180+0000","last_fullsized":"2024-04-24T23:59:17.766180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:41.032475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765403+0000","last_change":"2024-04-24T23:59:16.524315+0000","last_active":"2024-04-24T23:59:17.765403+0000","last_peered":"2024-04-24T23:59:17.765403+0000","last_clean":"2024-04-24T23:59:17.765403+0000","last_became_active":"2024-04-24T23:59:16.524014+0000","last_became_peered":"2024-04-24T23:59:16.524014+0000","last_unstale":"2024-04-24T23:59:17.765403+0000","last_undegraded":"2024-04-24T23:59:17.765403+0000","last_fullsized":"2024-04-24T23:59:17.765403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:08.604405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767888+0000","last_change":"2024-04-24T23:59:15.493122+0000","last_active":"2024-04-24T23:59:17.767888+0000","last_peered":"2024-04-24T23:59:17.767888+0000","last_clean":"2024-04-24T23:59:17.767888+0000","last_became_active":"2024-04-24T23:59:15.492729+0000","last_became_peered":"2024-04-24T23:59:15.492729+0000","last_unstale":"2024-04-24T23:59:17.767888+0000","last_undegraded":"2024-04-24T23:59:17.767888+0000","last_fullsized":"2024-04-24T23:59:17.767888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:35.368820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765472+0000","last_change":"2024-04-24T23:59:16.521760+0000","last_active":"2024-04-24T23:59:17.765472+0000","last_peered":"2024-04-24T23:59:17.765472+0000","last_clean":"2024-04-24T23:59:17.765472+0000","last_became_active":"2024-04-24T23:59:16.521468+0000","last_became_peered":"2024-04-24T23:59:16.521468+0000","last_unstale":"2024-04-24T23:59:17.765472+0000","last_undegraded":"2024-04-24T23:59:17.765472+0000","last_fullsized":"2024-04-24T23:59:17.765472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:39:49.893485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520171+0000","last_change":"2024-04-24T23:59:15.490972+0000","last_active":"2024-04-24T23:59:17.520171+0000","last_peered":"2024-04-24T23:59:17.520171+0000","last_clean":"2024-04-24T23:59:17.520171+0000","last_became_active":"2024-04-24T23:59:15.490313+0000","last_became_peered":"2024-04-24T23:59:15.490313+0000","last_unstale":"2024-04-24T23:59:17.520171+0000","last_undegraded":"2024-04-24T23:59:17.520171+0000","last_fullsized":"2024-04-24T23:59:17.520171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:01:36.040057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767279+0000","last_change":"2024-04-24T23:59:16.517324+0000","last_active":"2024-04-24T23:59:17.767279+0000","last_peered":"2024-04-24T23:59:17.767279+0000","last_clean":"2024-04-24T23:59:17.767279+0000","last_became_active":"2024-04-24T23:59:16.517076+0000","last_became_peered":"2024-04-24T23:59:16.517076+0000","last_unstale":"2024-04-24T23:59:17.767279+0000","last_undegraded":"2024-04-24T23:59:17.767279+0000","last_fullsized":"2024-04-24T23:59:17.767279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:25.600843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765413+0000","last_change":"2024-04-24T23:59:15.488165+0000","last_active":"2024-04-24T23:59:17.765413+0000","last_peered":"2024-04-24T23:59:17.765413+0000","last_clean":"2024-04-24T23:59:17.765413+0000","last_became_active":"2024-04-24T23:59:15.487850+0000","last_became_peered":"2024-04-24T23:59:15.487850+0000","last_unstale":"2024-04-24T23:59:17.765413+0000","last_undegraded":"2024-04-24T23:59:17.765413+0000","last_fullsized":"2024-04-24T23:59:17.765413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:27.884992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766821+0000","last_change":"2024-04-24T23:59:16.535407+0000","last_active":"2024-04-24T23:59:17.766821+0000","last_peered":"2024-04-24T23:59:17.766821+0000","last_clean":"2024-04-24T23:59:17.766821+0000","last_became_active":"2024-04-24T23:59:16.535115+0000","last_became_peered":"2024-04-24T23:59:16.535115+0000","last_unstale":"2024-04-24T23:59:17.766821+0000","last_undegraded":"2024-04-24T23:59:17.766821+0000","last_fullsized":"2024-04-24T23:59:17.766821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:27.914859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763507+0000","last_change":"2024-04-24T23:59:15.496338+0000","last_active":"2024-04-24T23:59:17.763507+0000","last_peered":"2024-04-24T23:59:17.763507+0000","last_clean":"2024-04-24T23:59:17.763507+0000","last_became_active":"2024-04-24T23:59:15.495669+0000","last_became_peered":"2024-04-24T23:59:15.495669+0000","last_unstale":"2024-04-24T23:59:17.763507+0000","last_undegraded":"2024-04-24T23:59:17.763507+0000","last_fullsized":"2024-04-24T23:59:17.763507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:25:36.815456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518539+0000","last_change":"2024-04-24T23:59:16.531708+0000","last_active":"2024-04-24T23:59:17.518539+0000","last_peered":"2024-04-24T23:59:17.518539+0000","last_clean":"2024-04-24T23:59:17.518539+0000","last_became_active":"2024-04-24T23:59:16.531431+0000","last_became_peered":"2024-04-24T23:59:16.531431+0000","last_unstale":"2024-04-24T23:59:17.518539+0000","last_undegraded":"2024-04-24T23:59:17.518539+0000","last_fullsized":"2024-04-24T23:59:17.518539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:34.068265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765014+0000","last_change":"2024-04-24T23:59:15.488455+0000","last_active":"2024-04-24T23:59:17.765014+0000","last_peered":"2024-04-24T23:59:17.765014+0000","last_clean":"2024-04-24T23:59:17.765014+0000","last_became_active":"2024-04-24T23:59:15.488231+0000","last_became_peered":"2024-04-24T23:59:15.488231+0000","last_unstale":"2024-04-24T23:59:17.765014+0000","last_undegraded":"2024-04-24T23:59:17.765014+0000","last_fullsized":"2024-04-24T23:59:17.765014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:21:17.718194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520642+0000","last_change":"2024-04-24T23:59:16.530698+0000","last_active":"2024-04-24T23:59:17.520642+0000","last_peered":"2024-04-24T23:59:17.520642+0000","last_clean":"2024-04-24T23:59:17.520642+0000","last_became_active":"2024-04-24T23:59:16.530390+0000","last_became_peered":"2024-04-24T23:59:16.530390+0000","last_unstale":"2024-04-24T23:59:17.520642+0000","last_undegraded":"2024-04-24T23:59:17.520642+0000","last_fullsized":"2024-04-24T23:59:17.520642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:41.444542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768921+0000","last_change":"2024-04-24T23:59:15.490356+0000","last_active":"2024-04-24T23:59:17.768921+0000","last_peered":"2024-04-24T23:59:17.768921+0000","last_clean":"2024-04-24T23:59:17.768921+0000","last_became_active":"2024-04-24T23:59:15.489965+0000","last_became_peered":"2024-04-24T23:59:15.489965+0000","last_unstale":"2024-04-24T23:59:17.768921+0000","last_undegraded":"2024-04-24T23:59:17.768921+0000","last_fullsized":"2024-04-24T23:59:17.768921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:13.718332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768104+0000","last_change":"2024-04-24T23:59:16.532148+0000","last_active":"2024-04-24T23:59:17.768104+0000","last_peered":"2024-04-24T23:59:17.768104+0000","last_clean":"2024-04-24T23:59:17.768104+0000","last_became_active":"2024-04-24T23:59:16.531856+0000","last_became_peered":"2024-04-24T23:59:16.531856+0000","last_unstale":"2024-04-24T23:59:17.768104+0000","last_undegraded":"2024-04-24T23:59:17.768104+0000","last_fullsized":"2024-04-24T23:59:17.768104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:25.600843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520929+0000","last_change":"2024-04-24T23:59:15.488784+0000","last_active":"2024-04-24T23:59:17.520929+0000","last_peered":"2024-04-24T23:59:17.520929+0000","last_clean":"2024-04-24T23:59:17.520929+0000","last_became_active":"2024-04-24T23:59:15.488297+0000","last_became_peered":"2024-04-24T23:59:15.488297+0000","last_unstale":"2024-04-24T23:59:17.520929+0000","last_undegraded":"2024-04-24T23:59:17.520929+0000","last_fullsized":"2024-04-24T23:59:17.520929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:56:56.943857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767619+0000","last_change":"2024-04-24T23:59:16.534911+0000","last_active":"2024-04-24T23:59:17.767619+0000","last_peered":"2024-04-24T23:59:17.767619+0000","last_clean":"2024-04-24T23:59:17.767619+0000","last_became_active":"2024-04-24T23:59:16.534567+0000","last_became_peered":"2024-04-24T23:59:16.534567+0000","last_unstale":"2024-04-24T23:59:17.767619+0000","last_undegraded":"2024-04-24T23:59:17.767619+0000","last_fullsized":"2024-04-24T23:59:17.767619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:27.519857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.521113+0000","last_change":"2024-04-24T23:59:15.492933+0000","last_active":"2024-04-24T23:59:17.521113+0000","last_peered":"2024-04-24T23:59:17.521113+0000","last_clean":"2024-04-24T23:59:17.521113+0000","last_became_active":"2024-04-24T23:59:15.492633+0000","last_became_peered":"2024-04-24T23:59:15.492633+0000","last_unstale":"2024-04-24T23:59:17.521113+0000","last_undegraded":"2024-04-24T23:59:17.521113+0000","last_fullsized":"2024-04-24T23:59:17.521113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:58.686771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764389+0000","last_change":"2024-04-24T23:59:16.522427+0000","last_active":"2024-04-24T23:59:17.764389+0000","last_peered":"2024-04-24T23:59:17.764389+0000","last_clean":"2024-04-24T23:59:17.764389+0000","last_became_active":"2024-04-24T23:59:16.522177+0000","last_became_peered":"2024-04-24T23:59:16.522177+0000","last_unstale":"2024-04-24T23:59:17.764389+0000","last_undegraded":"2024-04-24T23:59:17.764389+0000","last_fullsized":"2024-04-24T23:59:17.764389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:14.731015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520296+0000","last_change":"2024-04-24T23:59:15.488335+0000","last_active":"2024-04-24T23:59:17.520296+0000","last_peered":"2024-04-24T23:59:17.520296+0000","last_clean":"2024-04-24T23:59:17.520296+0000","last_became_active":"2024-04-24T23:59:15.487794+0000","last_became_peered":"2024-04-24T23:59:15.487794+0000","last_unstale":"2024-04-24T23:59:17.520296+0000","last_undegraded":"2024-04-24T23:59:17.520296+0000","last_fullsized":"2024-04-24T23:59:17.520296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:06:52.313801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763278+0000","last_change":"2024-04-24T23:59:16.530058+0000","last_active":"2024-04-24T23:59:17.763278+0000","last_peered":"2024-04-24T23:59:17.763278+0000","last_clean":"2024-04-24T23:59:17.763278+0000","last_became_active":"2024-04-24T23:59:16.529744+0000","last_became_peered":"2024-04-24T23:59:16.529744+0000","last_unstale":"2024-04-24T23:59:17.763278+0000","last_undegraded":"2024-04-24T23:59:17.763278+0000","last_fullsized":"2024-04-24T23:59:17.763278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:49.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.516053+0000","last_change":"2024-04-24T23:59:15.486585+0000","last_active":"2024-04-24T23:59:17.516053+0000","last_peered":"2024-04-24T23:59:17.516053+0000","last_clean":"2024-04-24T23:59:17.516053+0000","last_became_active":"2024-04-24T23:59:15.486302+0000","last_became_peered":"2024-04-24T23:59:15.486302+0000","last_unstale":"2024-04-24T23:59:17.516053+0000","last_undegraded":"2024-04-24T23:59:17.516053+0000","last_fullsized":"2024-04-24T23:59:17.516053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:27.884992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763851+0000","last_change":"2024-04-24T23:59:16.518756+0000","last_active":"2024-04-24T23:59:17.763851+0000","last_peered":"2024-04-24T23:59:17.763851+0000","last_clean":"2024-04-24T23:59:17.763851+0000","last_became_active":"2024-04-24T23:59:16.518461+0000","last_became_peered":"2024-04-24T23:59:16.518461+0000","last_unstale":"2024-04-24T23:59:17.763851+0000","last_undegraded":"2024-04-24T23:59:17.763851+0000","last_fullsized":"2024-04-24T23:59:17.763851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:07:18.996632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519867+0000","last_change":"2024-04-24T23:59:15.495135+0000","last_active":"2024-04-24T23:59:17.519867+0000","last_peered":"2024-04-24T23:59:17.519867+0000","last_clean":"2024-04-24T23:59:17.519867+0000","last_became_active":"2024-04-24T23:59:15.494838+0000","last_became_peered":"2024-04-24T23:59:15.494838+0000","last_unstale":"2024-04-24T23:59:17.519867+0000","last_undegraded":"2024-04-24T23:59:17.519867+0000","last_fullsized":"2024-04-24T23:59:17.519867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:48.926355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.762932+0000","last_change":"2024-04-24T23:59:16.515702+0000","last_active":"2024-04-24T23:59:17.762932+0000","last_peered":"2024-04-24T23:59:17.762932+0000","last_clean":"2024-04-24T23:59:17.762932+0000","last_became_active":"2024-04-24T23:59:16.515445+0000","last_became_peered":"2024-04-24T23:59:16.515445+0000","last_unstale":"2024-04-24T23:59:17.762932+0000","last_undegraded":"2024-04-24T23:59:17.762932+0000","last_fullsized":"2024-04-24T23:59:17.762932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:06:53.326484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518372+0000","last_change":"2024-04-24T23:59:15.487006+0000","last_active":"2024-04-24T23:59:17.518372+0000","last_peered":"2024-04-24T23:59:17.518372+0000","last_clean":"2024-04-24T23:59:17.518372+0000","last_became_active":"2024-04-24T23:59:15.486535+0000","last_became_peered":"2024-04-24T23:59:15.486535+0000","last_unstale":"2024-04-24T23:59:17.518372+0000","last_undegraded":"2024-04-24T23:59:17.518372+0000","last_fullsized":"2024-04-24T23:59:17.518372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:32.275871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767610+0000","last_change":"2024-04-24T23:59:16.526747+0000","last_active":"2024-04-24T23:59:17.767610+0000","last_peered":"2024-04-24T23:59:17.767610+0000","last_clean":"2024-04-24T23:59:17.767610+0000","last_became_active":"2024-04-24T23:59:16.526434+0000","last_became_peered":"2024-04-24T23:59:16.526434+0000","last_unstale":"2024-04-24T23:59:17.767610+0000","last_undegraded":"2024-04-24T23:59:17.767610+0000","last_fullsized":"2024-04-24T23:59:17.767610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.549589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764269+0000","last_change":"2024-04-24T23:59:15.496048+0000","last_active":"2024-04-24T23:59:17.764269+0000","last_peered":"2024-04-24T23:59:17.764269+0000","last_clean":"2024-04-24T23:59:17.764269+0000","last_became_active":"2024-04-24T23:59:15.495668+0000","last_became_peered":"2024-04-24T23:59:15.495668+0000","last_unstale":"2024-04-24T23:59:17.764269+0000","last_undegraded":"2024-04-24T23:59:17.764269+0000","last_fullsized":"2024-04-24T23:59:17.764269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:33.055582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765467+0000","last_change":"2024-04-24T23:59:16.524355+0000","last_active":"2024-04-24T23:59:17.765467+0000","last_peered":"2024-04-24T23:59:17.765467+0000","last_clean":"2024-04-24T23:59:17.765467+0000","last_became_active":"2024-04-24T23:59:16.524095+0000","last_became_peered":"2024-04-24T23:59:16.524095+0000","last_unstale":"2024-04-24T23:59:17.765467+0000","last_undegraded":"2024-04-24T23:59:17.765467+0000","last_fullsized":"2024-04-24T23:59:17.765467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.754570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.769123+0000","last_change":"2024-04-24T23:59:15.501587+0000","last_active":"2024-04-24T23:59:17.769123+0000","last_peered":"2024-04-24T23:59:17.769123+0000","last_clean":"2024-04-24T23:59:17.769123+0000","last_became_active":"2024-04-24T23:59:15.501335+0000","last_became_peered":"2024-04-24T23:59:15.501335+0000","last_unstale":"2024-04-24T23:59:17.769123+0000","last_undegraded":"2024-04-24T23:59:17.769123+0000","last_fullsized":"2024-04-24T23:59:17.769123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:12.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765774+0000","last_change":"2024-04-24T23:59:16.528530+0000","last_active":"2024-04-24T23:59:17.765774+0000","last_peered":"2024-04-24T23:59:17.765774+0000","last_clean":"2024-04-24T23:59:17.765774+0000","last_became_active":"2024-04-24T23:59:16.528226+0000","last_became_peered":"2024-04-24T23:59:16.528226+0000","last_unstale":"2024-04-24T23:59:17.765774+0000","last_undegraded":"2024-04-24T23:59:17.765774+0000","last_fullsized":"2024-04-24T23:59:17.765774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:49.518009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:18.499753+0000","last_change":"2024-04-24T23:59:15.487444+0000","last_active":"2024-04-24T23:59:18.499753+0000","last_peered":"2024-04-24T23:59:18.499753+0000","last_clean":"2024-04-24T23:59:18.499753+0000","last_became_active":"2024-04-24T23:59:15.487184+0000","last_became_peered":"2024-04-24T23:59:15.487184+0000","last_unstale":"2024-04-24T23:59:18.499753+0000","last_undegraded":"2024-04-24T23:59:18.499753+0000","last_fullsized":"2024-04-24T23:59:18.499753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:41.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515708+0000","last_change":"2024-04-24T23:59:16.524589+0000","last_active":"2024-04-24T23:59:17.515708+0000","last_peered":"2024-04-24T23:59:17.515708+0000","last_clean":"2024-04-24T23:59:17.515708+0000","last_became_active":"2024-04-24T23:59:16.523383+0000","last_became_peered":"2024-04-24T23:59:16.523383+0000","last_unstale":"2024-04-24T23:59:17.515708+0000","last_undegraded":"2024-04-24T23:59:17.515708+0000","last_fullsized":"2024-04-24T23:59:17.515708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:48.703131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767937+0000","last_change":"2024-04-24T23:59:15.486372+0000","last_active":"2024-04-24T23:59:17.767937+0000","last_peered":"2024-04-24T23:59:17.767937+0000","last_clean":"2024-04-24T23:59:17.767937+0000","last_became_active":"2024-04-24T23:59:15.486053+0000","last_became_peered":"2024-04-24T23:59:15.486053+0000","last_unstale":"2024-04-24T23:59:17.767937+0000","last_undegraded":"2024-04-24T23:59:17.767937+0000","last_fullsized":"2024-04-24T23:59:17.767937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:41.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519616+0000","last_change":"2024-04-24T23:59:16.516553+0000","last_active":"2024-04-24T23:59:17.519616+0000","last_peered":"2024-04-24T23:59:17.519616+0000","last_clean":"2024-04-24T23:59:17.519616+0000","last_became_active":"2024-04-24T23:59:16.516204+0000","last_became_peered":"2024-04-24T23:59:16.516204+0000","last_unstale":"2024-04-24T23:59:17.519616+0000","last_undegraded":"2024-04-24T23:59:17.519616+0000","last_fullsized":"2024-04-24T23:59:17.519616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:41.444542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515905+0000","last_change":"2024-04-24T23:59:15.496109+0000","last_active":"2024-04-24T23:59:17.515905+0000","last_peered":"2024-04-24T23:59:17.515905+0000","last_clean":"2024-04-24T23:59:17.515905+0000","last_became_active":"2024-04-24T23:59:15.495266+0000","last_became_peered":"2024-04-24T23:59:15.495266+0000","last_unstale":"2024-04-24T23:59:17.515905+0000","last_undegraded":"2024-04-24T23:59:17.515905+0000","last_fullsized":"2024-04-24T23:59:17.515905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:13.718332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515798+0000","last_change":"2024-04-24T23:59:16.515496+0000","last_active":"2024-04-24T23:59:17.515798+0000","last_peered":"2024-04-24T23:59:17.515798+0000","last_clean":"2024-04-24T23:59:17.515798+0000","last_became_active":"2024-04-24T23:59:16.515187+0000","last_became_peered":"2024-04-24T23:59:16.515187+0000","last_unstale":"2024-04-24T23:59:17.515798+0000","last_undegraded":"2024-04-24T23:59:17.515798+0000","last_fullsized":"2024-04-24T23:59:17.515798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:36.381503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765607+0000","last_change":"2024-04-24T23:59:15.497169+0000","last_active":"2024-04-24T23:59:17.765607+0000","last_peered":"2024-04-24T23:59:17.765607+0000","last_clean":"2024-04-24T23:59:17.765607+0000","last_became_active":"2024-04-24T23:59:15.496868+0000","last_became_peered":"2024-04-24T23:59:15.496868+0000","last_unstale":"2024-04-24T23:59:17.765607+0000","last_undegraded":"2024-04-24T23:59:17.765607+0000","last_fullsized":"2024-04-24T23:59:17.765607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:58.686771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764525+0000","last_change":"2024-04-24T23:59:16.523485+0000","last_active":"2024-04-24T23:59:17.764525+0000","last_peered":"2024-04-24T23:59:17.764525+0000","last_clean":"2024-04-24T23:59:17.764525+0000","last_became_active":"2024-04-24T23:59:16.523247+0000","last_became_peered":"2024-04-24T23:59:16.523247+0000","last_unstale":"2024-04-24T23:59:17.764525+0000","last_undegraded":"2024-04-24T23:59:17.764525+0000","last_fullsized":"2024-04-24T23:59:17.764525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:51.111395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518677+0000","last_change":"2024-04-24T23:59:15.489667+0000","last_active":"2024-04-24T23:59:17.518677+0000","last_peered":"2024-04-24T23:59:17.518677+0000","last_clean":"2024-04-24T23:59:17.518677+0000","last_became_active":"2024-04-24T23:59:15.489250+0000","last_became_peered":"2024-04-24T23:59:15.489250+0000","last_unstale":"2024-04-24T23:59:17.518677+0000","last_undegraded":"2024-04-24T23:59:17.518677+0000","last_fullsized":"2024-04-24T23:59:17.518677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:54:51.965663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518355+0000","last_change":"2024-04-24T23:59:16.519873+0000","last_active":"2024-04-24T23:59:17.518355+0000","last_peered":"2024-04-24T23:59:17.518355+0000","last_clean":"2024-04-24T23:59:17.518355+0000","last_became_active":"2024-04-24T23:59:16.519561+0000","last_became_peered":"2024-04-24T23:59:16.519561+0000","last_unstale":"2024-04-24T23:59:17.518355+0000","last_undegraded":"2024-04-24T23:59:17.518355+0000","last_fullsized":"2024-04-24T23:59:17.518355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:42.413115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764763+0000","last_change":"2024-04-24T23:59:15.495057+0000","last_active":"2024-04-24T23:59:17.764763+0000","last_peered":"2024-04-24T23:59:17.764763+0000","last_clean":"2024-04-24T23:59:17.764763+0000","last_became_active":"2024-04-24T23:59:15.494712+0000","last_became_peered":"2024-04-24T23:59:15.494712+0000","last_unstale":"2024-04-24T23:59:17.764763+0000","last_undegraded":"2024-04-24T23:59:17.764763+0000","last_fullsized":"2024-04-24T23:59:17.764763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:40.431859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768308+0000","last_change":"2024-04-24T23:59:16.519096+0000","last_active":"2024-04-24T23:59:17.768308+0000","last_peered":"2024-04-24T23:59:17.768308+0000","last_clean":"2024-04-24T23:59:17.768308+0000","last_became_active":"2024-04-24T23:59:16.518803+0000","last_became_peered":"2024-04-24T23:59:16.518803+0000","last_unstale":"2024-04-24T23:59:17.768308+0000","last_undegraded":"2024-04-24T23:59:17.768308+0000","last_fullsized":"2024-04-24T23:59:17.768308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:27.394923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.517717+0000","last_change":"2024-04-24T23:59:15.498725+0000","last_active":"2024-04-24T23:59:17.517717+0000","last_peered":"2024-04-24T23:59:17.517717+0000","last_clean":"2024-04-24T23:59:17.517717+0000","last_became_active":"2024-04-24T23:59:15.498309+0000","last_became_peered":"2024-04-24T23:59:15.498309+0000","last_unstale":"2024-04-24T23:59:17.517717+0000","last_undegraded":"2024-04-24T23:59:17.517717+0000","last_fullsized":"2024-04-24T23:59:17.517717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:07:17.983950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767330+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:59:17.767330+0000","last_peered":"2024-04-24T23:59:17.767330+0000","last_clean":"2024-04-24T23:59:17.767330+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:59:17.767330+0000","last_undegraded":"2024-04-24T23:59:17.767330+0000","last_fullsized":"2024-04-24T23:59:17.767330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":737236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":737146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:59:20.947 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:59:21.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.190+0000 7fc014e00640 1 Processor -- start 2024-04-24T23:59:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.190+0000 7fc014e00640 1 -- start start 2024-04-24T23:59:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.192+0000 7fc014e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01015bfc0 0x7fc0100ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.192+0000 7fc014e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc01015c3a0 0x7fc0100cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.192+0000 7fc014e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc0100b4df0 0x7fc0100ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.192+0000 7fc014e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc0100b3d50 con 0x7fc01015c3a0 2024-04-24T23:59:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.192+0000 7fc014e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc0100b4030 con 0x7fc0100b4df0 2024-04-24T23:59:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.192+0000 7fc014e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc0100b4310 con 0x7fc01015bfc0 2024-04-24T23:59:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.192+0000 7fc006a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc01015c3a0 0x7fc0100cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.192+0000 7fc006a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc01015c3a0 0x7fc0100cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36000/0 (socket says 172.21.15.96:36000) 2024-04-24T23:59:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.192+0000 7fc006a00640 1 -- 172.21.15.96:0/1339637281 learned_addr learned my addr 172.21.15.96:0/1339637281 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.193+0000 7fc00f400640 1 --2- 172.21.15.96:0/1339637281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01015bfc0 0x7fc0100ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.193+0000 7fc006a00640 1 -- 172.21.15.96:0/1339637281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01015bfc0 msgr2=0x7fc0100ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.193+0000 7fc006a00640 1 --2- 172.21.15.96:0/1339637281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01015bfc0 0x7fc0100ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.193+0000 7fc006a00640 1 -- 172.21.15.96:0/1339637281 >> v2:172.21.15.155:3300/0 conn(0x7fc0100b4df0 msgr2=0x7fc0100ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.193+0000 7fc00fe00640 1 --2- 172.21.15.96:0/1339637281 >> v2:172.21.15.155:3300/0 conn(0x7fc0100b4df0 0x7fc0100ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.193+0000 7fc006a00640 1 --2- 172.21.15.96:0/1339637281 >> v2:172.21.15.155:3300/0 conn(0x7fc0100b4df0 0x7fc0100ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.193+0000 7fc006a00640 1 -- 172.21.15.96:0/1339637281 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0100b45f0 con 0x7fc01015c3a0 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.194+0000 7fc006a00640 1 --2- 172.21.15.96:0/1339637281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015c3a0 0x7fc0100cc6e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc0100d07a0 tx=0x7fbff802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19887526b5652e1e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.194+0000 7fc00ea00640 1 -- 172.21.15.96:0/1339637281 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8037070 con 0x7fc01015c3a0 2024-04-24T23:59:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.194+0000 7fc00ea00640 1 -- 172.21.15.96:0/1339637281 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8032440 con 0x7fc01015c3a0 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.194+0000 7fc00ea00640 1 -- 172.21.15.96:0/1339637281 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8032810 con 0x7fc01015c3a0 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.195+0000 7fc014e00640 1 -- 172.21.15.96:0/1339637281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015c3a0 msgr2=0x7fc0100cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.195+0000 7fc014e00640 1 --2- 172.21.15.96:0/1339637281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015c3a0 0x7fc0100cc6e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc0100d07a0 tx=0x7fbff802a140 comp rx=0 tx=0).stop 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.195+0000 7fc014e00640 1 -- 172.21.15.96:0/1339637281 shutdown_connections 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.195+0000 7fc014e00640 1 --2- 172.21.15.96:0/1339637281 >> v2:172.21.15.155:3300/0 conn(0x7fc0100b4df0 0x7fc0100ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.195+0000 7fc014e00640 1 --2- 172.21.15.96:0/1339637281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015c3a0 0x7fc0100cc6e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.195+0000 7fc014e00640 1 --2- 172.21.15.96:0/1339637281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01015bfc0 0x7fc0100ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.195+0000 7fc014e00640 1 -- 172.21.15.96:0/1339637281 >> 172.21.15.96:0/1339637281 conn(0x7fc0100b1f10 msgr2=0x7fc0100cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.195+0000 7fc014e00640 1 -- 172.21.15.96:0/1339637281 shutdown_connections 2024-04-24T23:59:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.195+0000 7fc014e00640 1 -- 172.21.15.96:0/1339637281 wait complete. 2024-04-24T23:59:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.196+0000 7fc014e00640 1 Processor -- start 2024-04-24T23:59:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.197+0000 7fc014e00640 1 -- start start 2024-04-24T23:59:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.197+0000 7fc014e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100b4df0 0x7fc0100ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc014e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015bfc0 0x7fc01009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc014e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01015c3a0 0x7fc01009ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc014e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100ceb20 con 0x7fc01015bfc0 2024-04-24T23:59:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc014e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100b3a40 con 0x7fc0100b4df0 2024-04-24T23:59:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc014e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc0100cf0c0 con 0x7fc01015c3a0 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc006a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015bfc0 0x7fc01009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc006a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015bfc0 0x7fc01009d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36014/0 (socket says 172.21.15.96:36014) 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc006a00640 1 -- 172.21.15.96:0/2196499370 learned_addr learned my addr 172.21.15.96:0/2196499370 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc00f400640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100b4df0 0x7fc0100ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc006a00640 1 -- 172.21.15.96:0/2196499370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01015c3a0 msgr2=0x7fc01009ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc006a00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01015c3a0 0x7fc01009ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc006a00640 1 -- 172.21.15.96:0/2196499370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100b4df0 msgr2=0x7fc0100ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc006a00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100b4df0 0x7fc0100ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc006a00640 1 -- 172.21.15.96:0/2196499370 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01009b960 con 0x7fc01015bfc0 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.198+0000 7fc00f400640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100b4df0 0x7fc0100ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.199+0000 7fc006a00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015bfc0 0x7fc01009d8d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbff802a180 tx=0x7fbff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.199+0000 7fc007e00640 1 -- 172.21.15.96:0/2196499370 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8037040 con 0x7fc01015bfc0 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.199+0000 7fc007e00640 1 -- 172.21.15.96:0/2196499370 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8042070 con 0x7fc01015bfc0 2024-04-24T23:59:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.199+0000 7fc007e00640 1 -- 172.21.15.96:0/2196499370 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8030bb0 con 0x7fc01015bfc0 2024-04-24T23:59:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.199+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0100ad230 con 0x7fc01015bfc0 2024-04-24T23:59:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.199+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0100ad7f0 con 0x7fc01015bfc0 2024-04-24T23:59:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.200+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01006e210 con 0x7fc01015bfc0 2024-04-24T23:59:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.201+0000 7fc007e00640 1 -- 172.21.15.96:0/2196499370 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbff8047460 con 0x7fc01015bfc0 2024-04-24T23:59:21.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.202+0000 7fc007e00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfec06be60 0x7fbfec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.202+0000 7fc007e00640 1 -- 172.21.15.96:0/2196499370 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbff80abac0 con 0x7fc01015bfc0 2024-04-24T23:59:21.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.202+0000 7fc00f400640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfec06be60 0x7fbfec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.203+0000 7fc00f400640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfec06be60 0x7fbfec06e320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc000007eb0 tx=0x7fc000007400 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:21.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.207+0000 7fc007e00640 1 -- 172.21.15.96:0/2196499370 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc01006e210 con 0x7fc01015bfc0 2024-04-24T23:59:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.401+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0100cd310 con 0x7fbfec06be60 2024-04-24T23:59:21.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.418+0000 7fc007e00640 1 -- 172.21.15.96:0/2196499370 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251950 (secure 0 0 0) 0x7fc0100cd310 con 0x7fbfec06be60 2024-04-24T23:59:21.422 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:21.424 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-24T23:59:21.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfec06be60 msgr2=0x7fbfec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfec06be60 0x7fbfec06e320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc000007eb0 tx=0x7fc000007400 comp rx=0 tx=0).stop 2024-04-24T23:59:21.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015bfc0 msgr2=0x7fc01009d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015bfc0 0x7fc01009d8d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbff802a180 tx=0x7fbff80046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 shutdown_connections 2024-04-24T23:59:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01015c3a0 0x7fc01009ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfec06be60 0x7fbfec06e320 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc01015bfc0 0x7fc01009d8d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 --2- 172.21.15.96:0/2196499370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100b4df0 0x7fc0100ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.424+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 >> 172.21.15.96:0/2196499370 conn(0x7fc0100b1f10 msgr2=0x7fc0100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.425+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 shutdown_connections 2024-04-24T23:59:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.425+0000 7fc014e00640 1 -- 172.21.15.96:0/2196499370 wait complete. 2024-04-24T23:59:21.444 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-24T23:59:20.323062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220348,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754372,"statfs":{"total":773094113280,"available":772868476928,"internally_reserved":0,"allocated":4235264,"data_stored":2359780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.871883"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519073+0000","last_change":"2024-04-24T23:59:16.521433+0000","last_active":"2024-04-24T23:59:17.519073+0000","last_peered":"2024-04-24T23:59:17.519073+0000","last_clean":"2024-04-24T23:59:17.519073+0000","last_became_active":"2024-04-24T23:59:16.520775+0000","last_became_peered":"2024-04-24T23:59:16.520775+0000","last_unstale":"2024-04-24T23:59:17.519073+0000","last_undegraded":"2024-04-24T23:59:17.519073+0000","last_fullsized":"2024-04-24T23:59:17.519073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:25:37.828138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768626+0000","last_change":"2024-04-24T23:59:16.518660+0000","last_active":"2024-04-24T23:59:17.768626+0000","last_peered":"2024-04-24T23:59:17.768626+0000","last_clean":"2024-04-24T23:59:17.768626+0000","last_became_active":"2024-04-24T23:59:16.517645+0000","last_became_peered":"2024-04-24T23:59:16.517645+0000","last_unstale":"2024-04-24T23:59:17.768626+0000","last_undegraded":"2024-04-24T23:59:17.768626+0000","last_fullsized":"2024-04-24T23:59:17.768626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:39.048928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765837+0000","last_change":"2024-04-24T23:59:16.524178+0000","last_active":"2024-04-24T23:59:17.765837+0000","last_peered":"2024-04-24T23:59:17.765837+0000","last_clean":"2024-04-24T23:59:17.765837+0000","last_became_active":"2024-04-24T23:59:16.523899+0000","last_became_peered":"2024-04-24T23:59:16.523899+0000","last_unstale":"2024-04-24T23:59:17.765837+0000","last_undegraded":"2024-04-24T23:59:17.765837+0000","last_fullsized":"2024-04-24T23:59:17.765837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:51.111395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767600+0000","last_change":"2024-04-24T23:59:16.532418+0000","last_active":"2024-04-24T23:59:17.767600+0000","last_peered":"2024-04-24T23:59:17.767600+0000","last_clean":"2024-04-24T23:59:17.767600+0000","last_became_active":"2024-04-24T23:59:16.532000+0000","last_became_peered":"2024-04-24T23:59:16.532000+0000","last_unstale":"2024-04-24T23:59:17.767600+0000","last_undegraded":"2024-04-24T23:59:17.767600+0000","last_fullsized":"2024-04-24T23:59:17.767600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:15.060759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763990+0000","last_change":"2024-04-24T23:59:16.513270+0000","last_active":"2024-04-24T23:59:17.763990+0000","last_peered":"2024-04-24T23:59:17.763990+0000","last_clean":"2024-04-24T23:59:17.763990+0000","last_became_active":"2024-04-24T23:59:16.512991+0000","last_became_peered":"2024-04-24T23:59:16.512991+0000","last_unstale":"2024-04-24T23:59:17.763990+0000","last_undegraded":"2024-04-24T23:59:17.763990+0000","last_fullsized":"2024-04-24T23:59:17.763990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:59.699454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765730+0000","last_change":"2024-04-24T23:59:16.516471+0000","last_active":"2024-04-24T23:59:17.765730+0000","last_peered":"2024-04-24T23:59:17.765730+0000","last_clean":"2024-04-24T23:59:17.765730+0000","last_became_active":"2024-04-24T23:59:16.516251+0000","last_became_peered":"2024-04-24T23:59:16.516251+0000","last_unstale":"2024-04-24T23:59:17.765730+0000","last_undegraded":"2024-04-24T23:59:17.765730+0000","last_fullsized":"2024-04-24T23:59:17.765730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:40:33.669402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767749+0000","last_change":"2024-04-24T23:59:16.526810+0000","last_active":"2024-04-24T23:59:17.767749+0000","last_peered":"2024-04-24T23:59:17.767749+0000","last_clean":"2024-04-24T23:59:17.767749+0000","last_became_active":"2024-04-24T23:59:16.526504+0000","last_became_peered":"2024-04-24T23:59:16.526504+0000","last_unstale":"2024-04-24T23:59:17.767749+0000","last_undegraded":"2024-04-24T23:59:17.767749+0000","last_fullsized":"2024-04-24T23:59:17.767749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:51.111395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766041+0000","last_change":"2024-04-24T23:59:16.519716+0000","last_active":"2024-04-24T23:59:17.766041+0000","last_peered":"2024-04-24T23:59:17.766041+0000","last_clean":"2024-04-24T23:59:17.766041+0000","last_became_active":"2024-04-24T23:59:16.518467+0000","last_became_peered":"2024-04-24T23:59:16.518467+0000","last_unstale":"2024-04-24T23:59:17.766041+0000","last_undegraded":"2024-04-24T23:59:17.766041+0000","last_fullsized":"2024-04-24T23:59:17.766041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:52.589555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520608+0000","last_change":"2024-04-24T23:59:16.530591+0000","last_active":"2024-04-24T23:59:17.520608+0000","last_peered":"2024-04-24T23:59:17.520608+0000","last_clean":"2024-04-24T23:59:17.520608+0000","last_became_active":"2024-04-24T23:59:16.530140+0000","last_became_peered":"2024-04-24T23:59:16.530140+0000","last_unstale":"2024-04-24T23:59:17.520608+0000","last_undegraded":"2024-04-24T23:59:17.520608+0000","last_fullsized":"2024-04-24T23:59:17.520608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:48.703131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767990+0000","last_change":"2024-04-24T23:59:16.521751+0000","last_active":"2024-04-24T23:59:17.767990+0000","last_peered":"2024-04-24T23:59:17.767990+0000","last_clean":"2024-04-24T23:59:17.767990+0000","last_became_active":"2024-04-24T23:59:16.521462+0000","last_became_peered":"2024-04-24T23:59:16.521462+0000","last_unstale":"2024-04-24T23:59:17.767990+0000","last_undegraded":"2024-04-24T23:59:17.767990+0000","last_fullsized":"2024-04-24T23:59:17.767990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:52.589555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768311+0000","last_change":"2024-04-24T23:59:16.527785+0000","last_active":"2024-04-24T23:59:17.768311+0000","last_peered":"2024-04-24T23:59:17.768311+0000","last_clean":"2024-04-24T23:59:17.768311+0000","last_became_active":"2024-04-24T23:59:16.527508+0000","last_became_peered":"2024-04-24T23:59:16.527508+0000","last_unstale":"2024-04-24T23:59:17.768311+0000","last_undegraded":"2024-04-24T23:59:17.768311+0000","last_fullsized":"2024-04-24T23:59:17.768311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:25.600843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765417+0000","last_change":"2024-04-24T23:59:16.504823+0000","last_active":"2024-04-24T23:59:17.765417+0000","last_peered":"2024-04-24T23:59:17.765417+0000","last_clean":"2024-04-24T23:59:17.765417+0000","last_became_active":"2024-04-24T23:59:16.504475+0000","last_became_peered":"2024-04-24T23:59:16.504475+0000","last_unstale":"2024-04-24T23:59:17.765417+0000","last_undegraded":"2024-04-24T23:59:17.765417+0000","last_fullsized":"2024-04-24T23:59:17.765417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.549589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763462+0000","last_change":"2024-04-24T23:59:16.525271+0000","last_active":"2024-04-24T23:59:17.763462+0000","last_peered":"2024-04-24T23:59:17.763462+0000","last_clean":"2024-04-24T23:59:17.763462+0000","last_became_active":"2024-04-24T23:59:16.525038+0000","last_became_peered":"2024-04-24T23:59:16.525038+0000","last_unstale":"2024-04-24T23:59:17.763462+0000","last_undegraded":"2024-04-24T23:59:17.763462+0000","last_fullsized":"2024-04-24T23:59:17.763462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:37.488597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766004+0000","last_change":"2024-04-24T23:59:16.506343+0000","last_active":"2024-04-24T23:59:17.766004+0000","last_peered":"2024-04-24T23:59:17.766004+0000","last_clean":"2024-04-24T23:59:17.766004+0000","last_became_active":"2024-04-24T23:59:16.505688+0000","last_became_peered":"2024-04-24T23:59:16.505688+0000","last_unstale":"2024-04-24T23:59:17.766004+0000","last_undegraded":"2024-04-24T23:59:17.766004+0000","last_fullsized":"2024-04-24T23:59:17.766004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:27.394923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764906+0000","last_change":"2024-04-24T23:59:16.508412+0000","last_active":"2024-04-24T23:59:17.764906+0000","last_peered":"2024-04-24T23:59:17.764906+0000","last_clean":"2024-04-24T23:59:17.764906+0000","last_became_active":"2024-04-24T23:59:16.507819+0000","last_became_peered":"2024-04-24T23:59:16.507819+0000","last_unstale":"2024-04-24T23:59:17.764906+0000","last_undegraded":"2024-04-24T23:59:17.764906+0000","last_fullsized":"2024-04-24T23:59:17.764906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:27.914859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767354+0000","last_change":"2024-04-24T23:59:16.520685+0000","last_active":"2024-04-24T23:59:17.767354+0000","last_peered":"2024-04-24T23:59:17.767354+0000","last_clean":"2024-04-24T23:59:17.767354+0000","last_became_active":"2024-04-24T23:59:16.520360+0000","last_became_peered":"2024-04-24T23:59:16.520360+0000","last_unstale":"2024-04-24T23:59:17.767354+0000","last_undegraded":"2024-04-24T23:59:17.767354+0000","last_fullsized":"2024-04-24T23:59:17.767354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:08.604405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768785+0000","last_change":"2024-04-24T23:59:16.517413+0000","last_active":"2024-04-24T23:59:17.768785+0000","last_peered":"2024-04-24T23:59:17.768785+0000","last_clean":"2024-04-24T23:59:17.768785+0000","last_became_active":"2024-04-24T23:59:16.517065+0000","last_became_peered":"2024-04-24T23:59:16.517065+0000","last_unstale":"2024-04-24T23:59:17.768785+0000","last_undegraded":"2024-04-24T23:59:17.768785+0000","last_fullsized":"2024-04-24T23:59:17.768785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.708449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768909+0000","last_change":"2024-04-24T23:59:16.525461+0000","last_active":"2024-04-24T23:59:17.768909+0000","last_peered":"2024-04-24T23:59:17.768909+0000","last_clean":"2024-04-24T23:59:17.768909+0000","last_became_active":"2024-04-24T23:59:16.524311+0000","last_became_peered":"2024-04-24T23:59:16.524311+0000","last_unstale":"2024-04-24T23:59:17.768909+0000","last_undegraded":"2024-04-24T23:59:17.768909+0000","last_fullsized":"2024-04-24T23:59:17.768909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:10:30.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768249+0000","last_change":"2024-04-24T23:59:16.526795+0000","last_active":"2024-04-24T23:59:17.768249+0000","last_peered":"2024-04-24T23:59:17.768249+0000","last_clean":"2024-04-24T23:59:17.768249+0000","last_became_active":"2024-04-24T23:59:16.526316+0000","last_became_peered":"2024-04-24T23:59:16.526316+0000","last_unstale":"2024-04-24T23:59:17.768249+0000","last_undegraded":"2024-04-24T23:59:17.768249+0000","last_fullsized":"2024-04-24T23:59:17.768249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:30.941985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763863+0000","last_change":"2024-04-24T23:59:16.519348+0000","last_active":"2024-04-24T23:59:17.763863+0000","last_peered":"2024-04-24T23:59:17.763863+0000","last_clean":"2024-04-24T23:59:17.763863+0000","last_became_active":"2024-04-24T23:59:16.518941+0000","last_became_peered":"2024-04-24T23:59:16.518941+0000","last_unstale":"2024-04-24T23:59:17.763863+0000","last_undegraded":"2024-04-24T23:59:17.763863+0000","last_fullsized":"2024-04-24T23:59:17.763863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:28.897675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519490+0000","last_change":"2024-04-24T23:59:16.535140+0000","last_active":"2024-04-24T23:59:17.519490+0000","last_peered":"2024-04-24T23:59:17.519490+0000","last_clean":"2024-04-24T23:59:17.519490+0000","last_became_active":"2024-04-24T23:59:16.534863+0000","last_became_peered":"2024-04-24T23:59:16.534863+0000","last_unstale":"2024-04-24T23:59:17.519490+0000","last_undegraded":"2024-04-24T23:59:17.519490+0000","last_fullsized":"2024-04-24T23:59:17.519490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:41.824787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519526+0000","last_change":"2024-04-24T23:59:16.526268+0000","last_active":"2024-04-24T23:59:17.519526+0000","last_peered":"2024-04-24T23:59:17.519526+0000","last_clean":"2024-04-24T23:59:17.519526+0000","last_became_active":"2024-04-24T23:59:16.525923+0000","last_became_peered":"2024-04-24T23:59:16.525923+0000","last_unstale":"2024-04-24T23:59:17.519526+0000","last_undegraded":"2024-04-24T23:59:17.519526+0000","last_fullsized":"2024-04-24T23:59:17.519526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:42.045158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515769+0000","last_change":"2024-04-24T23:59:16.526834+0000","last_active":"2024-04-24T23:59:17.515769+0000","last_peered":"2024-04-24T23:59:17.515769+0000","last_clean":"2024-04-24T23:59:17.515769+0000","last_became_active":"2024-04-24T23:59:16.526570+0000","last_became_peered":"2024-04-24T23:59:16.526570+0000","last_unstale":"2024-04-24T23:59:17.515769+0000","last_undegraded":"2024-04-24T23:59:17.515769+0000","last_fullsized":"2024-04-24T23:59:17.515769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:41.444542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764488+0000","last_change":"2024-04-24T23:59:16.519422+0000","last_active":"2024-04-24T23:59:17.764488+0000","last_peered":"2024-04-24T23:59:17.764488+0000","last_clean":"2024-04-24T23:59:17.764488+0000","last_became_active":"2024-04-24T23:59:16.515125+0000","last_became_peered":"2024-04-24T23:59:16.515125+0000","last_unstale":"2024-04-24T23:59:17.764488+0000","last_undegraded":"2024-04-24T23:59:17.764488+0000","last_fullsized":"2024-04-24T23:59:17.764488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:52.589555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768785+0000","last_change":"2024-04-24T23:59:16.525359+0000","last_active":"2024-04-24T23:59:17.768785+0000","last_peered":"2024-04-24T23:59:17.768785+0000","last_clean":"2024-04-24T23:59:17.768785+0000","last_became_active":"2024-04-24T23:59:16.525046+0000","last_became_peered":"2024-04-24T23:59:16.525046+0000","last_unstale":"2024-04-24T23:59:17.768785+0000","last_undegraded":"2024-04-24T23:59:17.768785+0000","last_fullsized":"2024-04-24T23:59:17.768785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:27.914859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768773+0000","last_change":"2024-04-24T23:59:16.519700+0000","last_active":"2024-04-24T23:59:17.768773+0000","last_peered":"2024-04-24T23:59:17.768773+0000","last_clean":"2024-04-24T23:59:17.768773+0000","last_became_active":"2024-04-24T23:59:16.519404+0000","last_became_peered":"2024-04-24T23:59:16.519404+0000","last_unstale":"2024-04-24T23:59:17.768773+0000","last_undegraded":"2024-04-24T23:59:17.768773+0000","last_fullsized":"2024-04-24T23:59:17.768773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:39.958333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767728+0000","last_change":"2024-04-24T23:59:16.538131+0000","last_active":"2024-04-24T23:59:17.767728+0000","last_peered":"2024-04-24T23:59:17.767728+0000","last_clean":"2024-04-24T23:59:17.767728+0000","last_became_active":"2024-04-24T23:59:16.537774+0000","last_became_peered":"2024-04-24T23:59:16.537774+0000","last_unstale":"2024-04-24T23:59:17.767728+0000","last_undegraded":"2024-04-24T23:59:17.767728+0000","last_fullsized":"2024-04-24T23:59:17.767728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:37.835711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765907+0000","last_change":"2024-04-24T23:59:16.519547+0000","last_active":"2024-04-24T23:59:17.765907+0000","last_peered":"2024-04-24T23:59:17.765907+0000","last_clean":"2024-04-24T23:59:17.765907+0000","last_became_active":"2024-04-24T23:59:16.519262+0000","last_became_peered":"2024-04-24T23:59:16.519262+0000","last_unstale":"2024-04-24T23:59:17.765907+0000","last_undegraded":"2024-04-24T23:59:17.765907+0000","last_fullsized":"2024-04-24T23:59:17.765907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:40:33.669402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519888+0000","last_change":"2024-04-24T23:59:16.529252+0000","last_active":"2024-04-24T23:59:17.519888+0000","last_peered":"2024-04-24T23:59:17.519888+0000","last_clean":"2024-04-24T23:59:17.519888+0000","last_became_active":"2024-04-24T23:59:16.528902+0000","last_became_peered":"2024-04-24T23:59:16.528902+0000","last_unstale":"2024-04-24T23:59:17.519888+0000","last_undegraded":"2024-04-24T23:59:17.519888+0000","last_fullsized":"2024-04-24T23:59:17.519888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:34.068265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767750+0000","last_change":"2024-04-24T23:59:16.524466+0000","last_active":"2024-04-24T23:59:17.767750+0000","last_peered":"2024-04-24T23:59:17.767750+0000","last_clean":"2024-04-24T23:59:17.767750+0000","last_became_active":"2024-04-24T23:59:16.524198+0000","last_became_peered":"2024-04-24T23:59:16.524198+0000","last_unstale":"2024-04-24T23:59:17.767750+0000","last_undegraded":"2024-04-24T23:59:17.767750+0000","last_fullsized":"2024-04-24T23:59:17.767750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:49.518009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518071+0000","last_change":"2024-04-24T23:59:16.507806+0000","last_active":"2024-04-24T23:59:17.518071+0000","last_peered":"2024-04-24T23:59:17.518071+0000","last_clean":"2024-04-24T23:59:17.518071+0000","last_became_active":"2024-04-24T23:59:16.507332+0000","last_became_peered":"2024-04-24T23:59:16.507332+0000","last_unstale":"2024-04-24T23:59:17.518071+0000","last_undegraded":"2024-04-24T23:59:17.518071+0000","last_fullsized":"2024-04-24T23:59:17.518071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:42.045158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766473+0000","last_change":"2024-04-24T23:59:16.535617+0000","last_active":"2024-04-24T23:59:17.766473+0000","last_peered":"2024-04-24T23:59:17.766473+0000","last_clean":"2024-04-24T23:59:17.766473+0000","last_became_active":"2024-04-24T23:59:16.534650+0000","last_became_peered":"2024-04-24T23:59:16.534650+0000","last_unstale":"2024-04-24T23:59:17.766473+0000","last_undegraded":"2024-04-24T23:59:17.766473+0000","last_fullsized":"2024-04-24T23:59:17.766473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.358841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515792+0000","last_change":"2024-04-24T23:59:16.523198+0000","last_active":"2024-04-24T23:59:17.515792+0000","last_peered":"2024-04-24T23:59:17.515792+0000","last_clean":"2024-04-24T23:59:17.515792+0000","last_became_active":"2024-04-24T23:59:16.522790+0000","last_became_peered":"2024-04-24T23:59:16.522790+0000","last_unstale":"2024-04-24T23:59:17.515792+0000","last_undegraded":"2024-04-24T23:59:17.515792+0000","last_fullsized":"2024-04-24T23:59:17.515792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:33.753248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519476+0000","last_change":"2024-04-24T23:59:15.500439+0000","last_active":"2024-04-24T23:59:17.519476+0000","last_peered":"2024-04-24T23:59:17.519476+0000","last_clean":"2024-04-24T23:59:17.519476+0000","last_became_active":"2024-04-24T23:59:15.500137+0000","last_became_peered":"2024-04-24T23:59:15.500137+0000","last_unstale":"2024-04-24T23:59:17.519476+0000","last_undegraded":"2024-04-24T23:59:17.519476+0000","last_fullsized":"2024-04-24T23:59:17.519476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:36.475914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519517+0000","last_change":"2024-04-24T23:59:16.533100+0000","last_active":"2024-04-24T23:59:17.519517+0000","last_peered":"2024-04-24T23:59:17.519517+0000","last_clean":"2024-04-24T23:59:17.519517+0000","last_became_active":"2024-04-24T23:59:16.532818+0000","last_became_peered":"2024-04-24T23:59:16.532818+0000","last_unstale":"2024-04-24T23:59:17.519517+0000","last_undegraded":"2024-04-24T23:59:17.519517+0000","last_fullsized":"2024-04-24T23:59:17.519517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:48.703131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515910+0000","last_change":"2024-04-24T23:59:15.494104+0000","last_active":"2024-04-24T23:59:17.515910+0000","last_peered":"2024-04-24T23:59:17.515910+0000","last_clean":"2024-04-24T23:59:17.515910+0000","last_became_active":"2024-04-24T23:59:15.493778+0000","last_became_peered":"2024-04-24T23:59:15.493778+0000","last_unstale":"2024-04-24T23:59:17.515910+0000","last_undegraded":"2024-04-24T23:59:17.515910+0000","last_fullsized":"2024-04-24T23:59:17.515910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:58.686771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520332+0000","last_change":"2024-04-24T23:59:16.530565+0000","last_active":"2024-04-24T23:59:17.520332+0000","last_peered":"2024-04-24T23:59:17.520332+0000","last_clean":"2024-04-24T23:59:17.520332+0000","last_became_active":"2024-04-24T23:59:16.530199+0000","last_became_peered":"2024-04-24T23:59:16.530199+0000","last_unstale":"2024-04-24T23:59:17.520332+0000","last_undegraded":"2024-04-24T23:59:17.520332+0000","last_fullsized":"2024-04-24T23:59:17.520332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:25:37.828138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768448+0000","last_change":"2024-04-24T23:59:15.497744+0000","last_active":"2024-04-24T23:59:17.768448+0000","last_peered":"2024-04-24T23:59:17.768448+0000","last_clean":"2024-04-24T23:59:17.768448+0000","last_became_active":"2024-04-24T23:59:15.497391+0000","last_became_peered":"2024-04-24T23:59:15.497391+0000","last_unstale":"2024-04-24T23:59:17.768448+0000","last_undegraded":"2024-04-24T23:59:17.768448+0000","last_fullsized":"2024-04-24T23:59:17.768448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:32.740566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768040+0000","last_change":"2024-04-24T23:59:16.537470+0000","last_active":"2024-04-24T23:59:17.768040+0000","last_peered":"2024-04-24T23:59:17.768040+0000","last_clean":"2024-04-24T23:59:17.768040+0000","last_became_active":"2024-04-24T23:59:16.537222+0000","last_became_peered":"2024-04-24T23:59:16.537222+0000","last_unstale":"2024-04-24T23:59:17.768040+0000","last_undegraded":"2024-04-24T23:59:17.768040+0000","last_fullsized":"2024-04-24T23:59:17.768040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.358841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764125+0000","last_change":"2024-04-24T23:59:15.487618+0000","last_active":"2024-04-24T23:59:17.764125+0000","last_peered":"2024-04-24T23:59:17.764125+0000","last_clean":"2024-04-24T23:59:17.764125+0000","last_became_active":"2024-04-24T23:59:15.487070+0000","last_became_peered":"2024-04-24T23:59:15.487070+0000","last_unstale":"2024-04-24T23:59:17.764125+0000","last_undegraded":"2024-04-24T23:59:17.764125+0000","last_fullsized":"2024-04-24T23:59:17.764125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:48.901884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767994+0000","last_change":"2024-04-24T23:59:16.536474+0000","last_active":"2024-04-24T23:59:17.767994+0000","last_peered":"2024-04-24T23:59:17.767994+0000","last_clean":"2024-04-24T23:59:17.767994+0000","last_became_active":"2024-04-24T23:59:16.535161+0000","last_became_peered":"2024-04-24T23:59:16.535161+0000","last_unstale":"2024-04-24T23:59:17.767994+0000","last_undegraded":"2024-04-24T23:59:17.767994+0000","last_fullsized":"2024-04-24T23:59:17.767994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:40:33.669402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520489+0000","last_change":"2024-04-24T23:59:15.494023+0000","last_active":"2024-04-24T23:59:17.520489+0000","last_peered":"2024-04-24T23:59:17.520489+0000","last_clean":"2024-04-24T23:59:17.520489+0000","last_became_active":"2024-04-24T23:59:15.493748+0000","last_became_peered":"2024-04-24T23:59:15.493748+0000","last_unstale":"2024-04-24T23:59:17.520489+0000","last_undegraded":"2024-04-24T23:59:17.520489+0000","last_fullsized":"2024-04-24T23:59:17.520489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:30.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764657+0000","last_change":"2024-04-24T23:59:16.520632+0000","last_active":"2024-04-24T23:59:17.764657+0000","last_peered":"2024-04-24T23:59:17.764657+0000","last_clean":"2024-04-24T23:59:17.764657+0000","last_became_active":"2024-04-24T23:59:16.520284+0000","last_became_peered":"2024-04-24T23:59:16.520284+0000","last_unstale":"2024-04-24T23:59:17.764657+0000","last_undegraded":"2024-04-24T23:59:17.764657+0000","last_fullsized":"2024-04-24T23:59:17.764657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.358841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519807+0000","last_change":"2024-04-24T23:59:15.496589+0000","last_active":"2024-04-24T23:59:17.519807+0000","last_peered":"2024-04-24T23:59:17.519807+0000","last_clean":"2024-04-24T23:59:17.519807+0000","last_became_active":"2024-04-24T23:59:15.494812+0000","last_became_peered":"2024-04-24T23:59:15.494812+0000","last_unstale":"2024-04-24T23:59:17.519807+0000","last_undegraded":"2024-04-24T23:59:17.519807+0000","last_fullsized":"2024-04-24T23:59:17.519807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:45.556721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518265+0000","last_change":"2024-04-24T23:59:16.511398+0000","last_active":"2024-04-24T23:59:17.518265+0000","last_peered":"2024-04-24T23:59:17.518265+0000","last_clean":"2024-04-24T23:59:17.518265+0000","last_became_active":"2024-04-24T23:59:16.511026+0000","last_became_peered":"2024-04-24T23:59:16.511026+0000","last_unstale":"2024-04-24T23:59:17.518265+0000","last_undegraded":"2024-04-24T23:59:17.518265+0000","last_fullsized":"2024-04-24T23:59:17.518265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.754570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763747+0000","last_change":"2024-04-24T23:59:15.490318+0000","last_active":"2024-04-24T23:59:17.763747+0000","last_peered":"2024-04-24T23:59:17.763747+0000","last_clean":"2024-04-24T23:59:17.763747+0000","last_became_active":"2024-04-24T23:59:15.489342+0000","last_became_peered":"2024-04-24T23:59:15.489342+0000","last_unstale":"2024-04-24T23:59:17.763747+0000","last_undegraded":"2024-04-24T23:59:17.763747+0000","last_fullsized":"2024-04-24T23:59:17.763747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:47.690448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764832+0000","last_change":"2024-04-24T23:59:16.523624+0000","last_active":"2024-04-24T23:59:17.764832+0000","last_peered":"2024-04-24T23:59:17.764832+0000","last_clean":"2024-04-24T23:59:17.764832+0000","last_became_active":"2024-04-24T23:59:16.523353+0000","last_became_peered":"2024-04-24T23:59:16.523353+0000","last_unstale":"2024-04-24T23:59:17.764832+0000","last_undegraded":"2024-04-24T23:59:17.764832+0000","last_fullsized":"2024-04-24T23:59:17.764832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:53.054861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518310+0000","last_change":"2024-04-24T23:59:15.491164+0000","last_active":"2024-04-24T23:59:17.518310+0000","last_peered":"2024-04-24T23:59:17.518310+0000","last_clean":"2024-04-24T23:59:17.518310+0000","last_became_active":"2024-04-24T23:59:15.490884+0000","last_became_peered":"2024-04-24T23:59:15.490884+0000","last_unstale":"2024-04-24T23:59:17.518310+0000","last_undegraded":"2024-04-24T23:59:17.518310+0000","last_fullsized":"2024-04-24T23:59:17.518310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:48.901884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766219+0000","last_change":"2024-04-24T23:59:16.515321+0000","last_active":"2024-04-24T23:59:17.766219+0000","last_peered":"2024-04-24T23:59:17.766219+0000","last_clean":"2024-04-24T23:59:17.766219+0000","last_became_active":"2024-04-24T23:59:16.514964+0000","last_became_peered":"2024-04-24T23:59:16.514964+0000","last_unstale":"2024-04-24T23:59:17.766219+0000","last_undegraded":"2024-04-24T23:59:17.766219+0000","last_fullsized":"2024-04-24T23:59:17.766219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:27.394923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.769387+0000","last_change":"2024-04-24T23:59:15.494956+0000","last_active":"2024-04-24T23:59:17.769387+0000","last_peered":"2024-04-24T23:59:17.769387+0000","last_clean":"2024-04-24T23:59:17.769387+0000","last_became_active":"2024-04-24T23:59:15.494666+0000","last_became_peered":"2024-04-24T23:59:15.494666+0000","last_unstale":"2024-04-24T23:59:17.769387+0000","last_undegraded":"2024-04-24T23:59:17.769387+0000","last_fullsized":"2024-04-24T23:59:17.769387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:19:52.042178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.769154+0000","last_change":"2024-04-24T23:59:16.525916+0000","last_active":"2024-04-24T23:59:17.769154+0000","last_peered":"2024-04-24T23:59:17.769154+0000","last_clean":"2024-04-24T23:59:17.769154+0000","last_became_active":"2024-04-24T23:59:16.525446+0000","last_became_peered":"2024-04-24T23:59:16.525446+0000","last_unstale":"2024-04-24T23:59:17.769154+0000","last_undegraded":"2024-04-24T23:59:17.769154+0000","last_fullsized":"2024-04-24T23:59:17.769154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:37.353908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515895+0000","last_change":"2024-04-24T23:59:15.490272+0000","last_active":"2024-04-24T23:59:17.515895+0000","last_peered":"2024-04-24T23:59:17.515895+0000","last_clean":"2024-04-24T23:59:17.515895+0000","last_became_active":"2024-04-24T23:59:15.489910+0000","last_became_peered":"2024-04-24T23:59:15.489910+0000","last_unstale":"2024-04-24T23:59:17.515895+0000","last_undegraded":"2024-04-24T23:59:17.515895+0000","last_fullsized":"2024-04-24T23:59:17.515895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:12.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767492+0000","last_change":"2024-04-24T23:59:16.519990+0000","last_active":"2024-04-24T23:59:17.767492+0000","last_peered":"2024-04-24T23:59:17.767492+0000","last_clean":"2024-04-24T23:59:17.767492+0000","last_became_active":"2024-04-24T23:59:16.519753+0000","last_became_peered":"2024-04-24T23:59:16.519753+0000","last_unstale":"2024-04-24T23:59:17.767492+0000","last_undegraded":"2024-04-24T23:59:17.767492+0000","last_fullsized":"2024-04-24T23:59:17.767492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.708449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766180+0000","last_change":"2024-04-24T23:59:15.499875+0000","last_active":"2024-04-24T23:59:17.766180+0000","last_peered":"2024-04-24T23:59:17.766180+0000","last_clean":"2024-04-24T23:59:17.766180+0000","last_became_active":"2024-04-24T23:59:15.499556+0000","last_became_peered":"2024-04-24T23:59:15.499556+0000","last_unstale":"2024-04-24T23:59:17.766180+0000","last_undegraded":"2024-04-24T23:59:17.766180+0000","last_fullsized":"2024-04-24T23:59:17.766180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:41.032475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765403+0000","last_change":"2024-04-24T23:59:16.524315+0000","last_active":"2024-04-24T23:59:17.765403+0000","last_peered":"2024-04-24T23:59:17.765403+0000","last_clean":"2024-04-24T23:59:17.765403+0000","last_became_active":"2024-04-24T23:59:16.524014+0000","last_became_peered":"2024-04-24T23:59:16.524014+0000","last_unstale":"2024-04-24T23:59:17.765403+0000","last_undegraded":"2024-04-24T23:59:17.765403+0000","last_fullsized":"2024-04-24T23:59:17.765403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:08.604405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767888+0000","last_change":"2024-04-24T23:59:15.493122+0000","last_active":"2024-04-24T23:59:17.767888+0000","last_peered":"2024-04-24T23:59:17.767888+0000","last_clean":"2024-04-24T23:59:17.767888+0000","last_became_active":"2024-04-24T23:59:15.492729+0000","last_became_peered":"2024-04-24T23:59:15.492729+0000","last_unstale":"2024-04-24T23:59:17.767888+0000","last_undegraded":"2024-04-24T23:59:17.767888+0000","last_fullsized":"2024-04-24T23:59:17.767888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:35.368820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765472+0000","last_change":"2024-04-24T23:59:16.521760+0000","last_active":"2024-04-24T23:59:17.765472+0000","last_peered":"2024-04-24T23:59:17.765472+0000","last_clean":"2024-04-24T23:59:17.765472+0000","last_became_active":"2024-04-24T23:59:16.521468+0000","last_became_peered":"2024-04-24T23:59:16.521468+0000","last_unstale":"2024-04-24T23:59:17.765472+0000","last_undegraded":"2024-04-24T23:59:17.765472+0000","last_fullsized":"2024-04-24T23:59:17.765472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:39:49.893485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520171+0000","last_change":"2024-04-24T23:59:15.490972+0000","last_active":"2024-04-24T23:59:17.520171+0000","last_peered":"2024-04-24T23:59:17.520171+0000","last_clean":"2024-04-24T23:59:17.520171+0000","last_became_active":"2024-04-24T23:59:15.490313+0000","last_became_peered":"2024-04-24T23:59:15.490313+0000","last_unstale":"2024-04-24T23:59:17.520171+0000","last_undegraded":"2024-04-24T23:59:17.520171+0000","last_fullsized":"2024-04-24T23:59:17.520171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:01:36.040057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767279+0000","last_change":"2024-04-24T23:59:16.517324+0000","last_active":"2024-04-24T23:59:17.767279+0000","last_peered":"2024-04-24T23:59:17.767279+0000","last_clean":"2024-04-24T23:59:17.767279+0000","last_became_active":"2024-04-24T23:59:16.517076+0000","last_became_peered":"2024-04-24T23:59:16.517076+0000","last_unstale":"2024-04-24T23:59:17.767279+0000","last_undegraded":"2024-04-24T23:59:17.767279+0000","last_fullsized":"2024-04-24T23:59:17.767279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:25.600843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765413+0000","last_change":"2024-04-24T23:59:15.488165+0000","last_active":"2024-04-24T23:59:17.765413+0000","last_peered":"2024-04-24T23:59:17.765413+0000","last_clean":"2024-04-24T23:59:17.765413+0000","last_became_active":"2024-04-24T23:59:15.487850+0000","last_became_peered":"2024-04-24T23:59:15.487850+0000","last_unstale":"2024-04-24T23:59:17.765413+0000","last_undegraded":"2024-04-24T23:59:17.765413+0000","last_fullsized":"2024-04-24T23:59:17.765413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:27.884992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.766821+0000","last_change":"2024-04-24T23:59:16.535407+0000","last_active":"2024-04-24T23:59:17.766821+0000","last_peered":"2024-04-24T23:59:17.766821+0000","last_clean":"2024-04-24T23:59:17.766821+0000","last_became_active":"2024-04-24T23:59:16.535115+0000","last_became_peered":"2024-04-24T23:59:16.535115+0000","last_unstale":"2024-04-24T23:59:17.766821+0000","last_undegraded":"2024-04-24T23:59:17.766821+0000","last_fullsized":"2024-04-24T23:59:17.766821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:27.914859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763507+0000","last_change":"2024-04-24T23:59:15.496338+0000","last_active":"2024-04-24T23:59:17.763507+0000","last_peered":"2024-04-24T23:59:17.763507+0000","last_clean":"2024-04-24T23:59:17.763507+0000","last_became_active":"2024-04-24T23:59:15.495669+0000","last_became_peered":"2024-04-24T23:59:15.495669+0000","last_unstale":"2024-04-24T23:59:17.763507+0000","last_undegraded":"2024-04-24T23:59:17.763507+0000","last_fullsized":"2024-04-24T23:59:17.763507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:25:36.815456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518539+0000","last_change":"2024-04-24T23:59:16.531708+0000","last_active":"2024-04-24T23:59:17.518539+0000","last_peered":"2024-04-24T23:59:17.518539+0000","last_clean":"2024-04-24T23:59:17.518539+0000","last_became_active":"2024-04-24T23:59:16.531431+0000","last_became_peered":"2024-04-24T23:59:16.531431+0000","last_unstale":"2024-04-24T23:59:17.518539+0000","last_undegraded":"2024-04-24T23:59:17.518539+0000","last_fullsized":"2024-04-24T23:59:17.518539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:34.068265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765014+0000","last_change":"2024-04-24T23:59:15.488455+0000","last_active":"2024-04-24T23:59:17.765014+0000","last_peered":"2024-04-24T23:59:17.765014+0000","last_clean":"2024-04-24T23:59:17.765014+0000","last_became_active":"2024-04-24T23:59:15.488231+0000","last_became_peered":"2024-04-24T23:59:15.488231+0000","last_unstale":"2024-04-24T23:59:17.765014+0000","last_undegraded":"2024-04-24T23:59:17.765014+0000","last_fullsized":"2024-04-24T23:59:17.765014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:21:17.718194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520642+0000","last_change":"2024-04-24T23:59:16.530698+0000","last_active":"2024-04-24T23:59:17.520642+0000","last_peered":"2024-04-24T23:59:17.520642+0000","last_clean":"2024-04-24T23:59:17.520642+0000","last_became_active":"2024-04-24T23:59:16.530390+0000","last_became_peered":"2024-04-24T23:59:16.530390+0000","last_unstale":"2024-04-24T23:59:17.520642+0000","last_undegraded":"2024-04-24T23:59:17.520642+0000","last_fullsized":"2024-04-24T23:59:17.520642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:41.444542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768921+0000","last_change":"2024-04-24T23:59:15.490356+0000","last_active":"2024-04-24T23:59:17.768921+0000","last_peered":"2024-04-24T23:59:17.768921+0000","last_clean":"2024-04-24T23:59:17.768921+0000","last_became_active":"2024-04-24T23:59:15.489965+0000","last_became_peered":"2024-04-24T23:59:15.489965+0000","last_unstale":"2024-04-24T23:59:17.768921+0000","last_undegraded":"2024-04-24T23:59:17.768921+0000","last_fullsized":"2024-04-24T23:59:17.768921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:13.718332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768104+0000","last_change":"2024-04-24T23:59:16.532148+0000","last_active":"2024-04-24T23:59:17.768104+0000","last_peered":"2024-04-24T23:59:17.768104+0000","last_clean":"2024-04-24T23:59:17.768104+0000","last_became_active":"2024-04-24T23:59:16.531856+0000","last_became_peered":"2024-04-24T23:59:16.531856+0000","last_unstale":"2024-04-24T23:59:17.768104+0000","last_undegraded":"2024-04-24T23:59:17.768104+0000","last_fullsized":"2024-04-24T23:59:17.768104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:25.600843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520929+0000","last_change":"2024-04-24T23:59:15.488784+0000","last_active":"2024-04-24T23:59:17.520929+0000","last_peered":"2024-04-24T23:59:17.520929+0000","last_clean":"2024-04-24T23:59:17.520929+0000","last_became_active":"2024-04-24T23:59:15.488297+0000","last_became_peered":"2024-04-24T23:59:15.488297+0000","last_unstale":"2024-04-24T23:59:17.520929+0000","last_undegraded":"2024-04-24T23:59:17.520929+0000","last_fullsized":"2024-04-24T23:59:17.520929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:56:56.943857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767619+0000","last_change":"2024-04-24T23:59:16.534911+0000","last_active":"2024-04-24T23:59:17.767619+0000","last_peered":"2024-04-24T23:59:17.767619+0000","last_clean":"2024-04-24T23:59:17.767619+0000","last_became_active":"2024-04-24T23:59:16.534567+0000","last_became_peered":"2024-04-24T23:59:16.534567+0000","last_unstale":"2024-04-24T23:59:17.767619+0000","last_undegraded":"2024-04-24T23:59:17.767619+0000","last_fullsized":"2024-04-24T23:59:17.767619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:27.519857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.521113+0000","last_change":"2024-04-24T23:59:15.492933+0000","last_active":"2024-04-24T23:59:17.521113+0000","last_peered":"2024-04-24T23:59:17.521113+0000","last_clean":"2024-04-24T23:59:17.521113+0000","last_became_active":"2024-04-24T23:59:15.492633+0000","last_became_peered":"2024-04-24T23:59:15.492633+0000","last_unstale":"2024-04-24T23:59:17.521113+0000","last_undegraded":"2024-04-24T23:59:17.521113+0000","last_fullsized":"2024-04-24T23:59:17.521113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:58.686771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764389+0000","last_change":"2024-04-24T23:59:16.522427+0000","last_active":"2024-04-24T23:59:17.764389+0000","last_peered":"2024-04-24T23:59:17.764389+0000","last_clean":"2024-04-24T23:59:17.764389+0000","last_became_active":"2024-04-24T23:59:16.522177+0000","last_became_peered":"2024-04-24T23:59:16.522177+0000","last_unstale":"2024-04-24T23:59:17.764389+0000","last_undegraded":"2024-04-24T23:59:17.764389+0000","last_fullsized":"2024-04-24T23:59:17.764389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:14.731015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.520296+0000","last_change":"2024-04-24T23:59:15.488335+0000","last_active":"2024-04-24T23:59:17.520296+0000","last_peered":"2024-04-24T23:59:17.520296+0000","last_clean":"2024-04-24T23:59:17.520296+0000","last_became_active":"2024-04-24T23:59:15.487794+0000","last_became_peered":"2024-04-24T23:59:15.487794+0000","last_unstale":"2024-04-24T23:59:17.520296+0000","last_undegraded":"2024-04-24T23:59:17.520296+0000","last_fullsized":"2024-04-24T23:59:17.520296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:06:52.313801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763278+0000","last_change":"2024-04-24T23:59:16.530058+0000","last_active":"2024-04-24T23:59:17.763278+0000","last_peered":"2024-04-24T23:59:17.763278+0000","last_clean":"2024-04-24T23:59:17.763278+0000","last_became_active":"2024-04-24T23:59:16.529744+0000","last_became_peered":"2024-04-24T23:59:16.529744+0000","last_unstale":"2024-04-24T23:59:17.763278+0000","last_undegraded":"2024-04-24T23:59:17.763278+0000","last_fullsized":"2024-04-24T23:59:17.763278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:49.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.516053+0000","last_change":"2024-04-24T23:59:15.486585+0000","last_active":"2024-04-24T23:59:17.516053+0000","last_peered":"2024-04-24T23:59:17.516053+0000","last_clean":"2024-04-24T23:59:17.516053+0000","last_became_active":"2024-04-24T23:59:15.486302+0000","last_became_peered":"2024-04-24T23:59:15.486302+0000","last_unstale":"2024-04-24T23:59:17.516053+0000","last_undegraded":"2024-04-24T23:59:17.516053+0000","last_fullsized":"2024-04-24T23:59:17.516053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:27.884992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.763851+0000","last_change":"2024-04-24T23:59:16.518756+0000","last_active":"2024-04-24T23:59:17.763851+0000","last_peered":"2024-04-24T23:59:17.763851+0000","last_clean":"2024-04-24T23:59:17.763851+0000","last_became_active":"2024-04-24T23:59:16.518461+0000","last_became_peered":"2024-04-24T23:59:16.518461+0000","last_unstale":"2024-04-24T23:59:17.763851+0000","last_undegraded":"2024-04-24T23:59:17.763851+0000","last_fullsized":"2024-04-24T23:59:17.763851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:07:18.996632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519867+0000","last_change":"2024-04-24T23:59:15.495135+0000","last_active":"2024-04-24T23:59:17.519867+0000","last_peered":"2024-04-24T23:59:17.519867+0000","last_clean":"2024-04-24T23:59:17.519867+0000","last_became_active":"2024-04-24T23:59:15.494838+0000","last_became_peered":"2024-04-24T23:59:15.494838+0000","last_unstale":"2024-04-24T23:59:17.519867+0000","last_undegraded":"2024-04-24T23:59:17.519867+0000","last_fullsized":"2024-04-24T23:59:17.519867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:48.926355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.762932+0000","last_change":"2024-04-24T23:59:16.515702+0000","last_active":"2024-04-24T23:59:17.762932+0000","last_peered":"2024-04-24T23:59:17.762932+0000","last_clean":"2024-04-24T23:59:17.762932+0000","last_became_active":"2024-04-24T23:59:16.515445+0000","last_became_peered":"2024-04-24T23:59:16.515445+0000","last_unstale":"2024-04-24T23:59:17.762932+0000","last_undegraded":"2024-04-24T23:59:17.762932+0000","last_fullsized":"2024-04-24T23:59:17.762932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:06:53.326484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518372+0000","last_change":"2024-04-24T23:59:15.487006+0000","last_active":"2024-04-24T23:59:17.518372+0000","last_peered":"2024-04-24T23:59:17.518372+0000","last_clean":"2024-04-24T23:59:17.518372+0000","last_became_active":"2024-04-24T23:59:15.486535+0000","last_became_peered":"2024-04-24T23:59:15.486535+0000","last_unstale":"2024-04-24T23:59:17.518372+0000","last_undegraded":"2024-04-24T23:59:17.518372+0000","last_fullsized":"2024-04-24T23:59:17.518372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:32.275871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767610+0000","last_change":"2024-04-24T23:59:16.526747+0000","last_active":"2024-04-24T23:59:17.767610+0000","last_peered":"2024-04-24T23:59:17.767610+0000","last_clean":"2024-04-24T23:59:17.767610+0000","last_became_active":"2024-04-24T23:59:16.526434+0000","last_became_peered":"2024-04-24T23:59:16.526434+0000","last_unstale":"2024-04-24T23:59:17.767610+0000","last_undegraded":"2024-04-24T23:59:17.767610+0000","last_fullsized":"2024-04-24T23:59:17.767610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:02.549589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764269+0000","last_change":"2024-04-24T23:59:15.496048+0000","last_active":"2024-04-24T23:59:17.764269+0000","last_peered":"2024-04-24T23:59:17.764269+0000","last_clean":"2024-04-24T23:59:17.764269+0000","last_became_active":"2024-04-24T23:59:15.495668+0000","last_became_peered":"2024-04-24T23:59:15.495668+0000","last_unstale":"2024-04-24T23:59:17.764269+0000","last_undegraded":"2024-04-24T23:59:17.764269+0000","last_fullsized":"2024-04-24T23:59:17.764269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:33.055582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765467+0000","last_change":"2024-04-24T23:59:16.524355+0000","last_active":"2024-04-24T23:59:17.765467+0000","last_peered":"2024-04-24T23:59:17.765467+0000","last_clean":"2024-04-24T23:59:17.765467+0000","last_became_active":"2024-04-24T23:59:16.524095+0000","last_became_peered":"2024-04-24T23:59:16.524095+0000","last_unstale":"2024-04-24T23:59:17.765467+0000","last_undegraded":"2024-04-24T23:59:17.765467+0000","last_fullsized":"2024-04-24T23:59:17.765467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.754570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.769123+0000","last_change":"2024-04-24T23:59:15.501587+0000","last_active":"2024-04-24T23:59:17.769123+0000","last_peered":"2024-04-24T23:59:17.769123+0000","last_clean":"2024-04-24T23:59:17.769123+0000","last_became_active":"2024-04-24T23:59:15.501335+0000","last_became_peered":"2024-04-24T23:59:15.501335+0000","last_unstale":"2024-04-24T23:59:17.769123+0000","last_undegraded":"2024-04-24T23:59:17.769123+0000","last_fullsized":"2024-04-24T23:59:17.769123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:12.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765774+0000","last_change":"2024-04-24T23:59:16.528530+0000","last_active":"2024-04-24T23:59:17.765774+0000","last_peered":"2024-04-24T23:59:17.765774+0000","last_clean":"2024-04-24T23:59:17.765774+0000","last_became_active":"2024-04-24T23:59:16.528226+0000","last_became_peered":"2024-04-24T23:59:16.528226+0000","last_unstale":"2024-04-24T23:59:17.765774+0000","last_undegraded":"2024-04-24T23:59:17.765774+0000","last_fullsized":"2024-04-24T23:59:17.765774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:49.518009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:18.499753+0000","last_change":"2024-04-24T23:59:15.487444+0000","last_active":"2024-04-24T23:59:18.499753+0000","last_peered":"2024-04-24T23:59:18.499753+0000","last_clean":"2024-04-24T23:59:18.499753+0000","last_became_active":"2024-04-24T23:59:15.487184+0000","last_became_peered":"2024-04-24T23:59:15.487184+0000","last_unstale":"2024-04-24T23:59:18.499753+0000","last_undegraded":"2024-04-24T23:59:18.499753+0000","last_fullsized":"2024-04-24T23:59:18.499753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:41.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515708+0000","last_change":"2024-04-24T23:59:16.524589+0000","last_active":"2024-04-24T23:59:17.515708+0000","last_peered":"2024-04-24T23:59:17.515708+0000","last_clean":"2024-04-24T23:59:17.515708+0000","last_became_active":"2024-04-24T23:59:16.523383+0000","last_became_peered":"2024-04-24T23:59:16.523383+0000","last_unstale":"2024-04-24T23:59:17.515708+0000","last_undegraded":"2024-04-24T23:59:17.515708+0000","last_fullsized":"2024-04-24T23:59:17.515708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:48.703131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767937+0000","last_change":"2024-04-24T23:59:15.486372+0000","last_active":"2024-04-24T23:59:17.767937+0000","last_peered":"2024-04-24T23:59:17.767937+0000","last_clean":"2024-04-24T23:59:17.767937+0000","last_became_active":"2024-04-24T23:59:15.486053+0000","last_became_peered":"2024-04-24T23:59:15.486053+0000","last_unstale":"2024-04-24T23:59:17.767937+0000","last_undegraded":"2024-04-24T23:59:17.767937+0000","last_fullsized":"2024-04-24T23:59:17.767937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:41.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.519616+0000","last_change":"2024-04-24T23:59:16.516553+0000","last_active":"2024-04-24T23:59:17.519616+0000","last_peered":"2024-04-24T23:59:17.519616+0000","last_clean":"2024-04-24T23:59:17.519616+0000","last_became_active":"2024-04-24T23:59:16.516204+0000","last_became_peered":"2024-04-24T23:59:16.516204+0000","last_unstale":"2024-04-24T23:59:17.519616+0000","last_undegraded":"2024-04-24T23:59:17.519616+0000","last_fullsized":"2024-04-24T23:59:17.519616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:41.444542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515905+0000","last_change":"2024-04-24T23:59:15.496109+0000","last_active":"2024-04-24T23:59:17.515905+0000","last_peered":"2024-04-24T23:59:17.515905+0000","last_clean":"2024-04-24T23:59:17.515905+0000","last_became_active":"2024-04-24T23:59:15.495266+0000","last_became_peered":"2024-04-24T23:59:15.495266+0000","last_unstale":"2024-04-24T23:59:17.515905+0000","last_undegraded":"2024-04-24T23:59:17.515905+0000","last_fullsized":"2024-04-24T23:59:17.515905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:13.718332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.515798+0000","last_change":"2024-04-24T23:59:16.515496+0000","last_active":"2024-04-24T23:59:17.515798+0000","last_peered":"2024-04-24T23:59:17.515798+0000","last_clean":"2024-04-24T23:59:17.515798+0000","last_became_active":"2024-04-24T23:59:16.515187+0000","last_became_peered":"2024-04-24T23:59:16.515187+0000","last_unstale":"2024-04-24T23:59:17.515798+0000","last_undegraded":"2024-04-24T23:59:17.515798+0000","last_fullsized":"2024-04-24T23:59:17.515798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:36.381503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.765607+0000","last_change":"2024-04-24T23:59:15.497169+0000","last_active":"2024-04-24T23:59:17.765607+0000","last_peered":"2024-04-24T23:59:17.765607+0000","last_clean":"2024-04-24T23:59:17.765607+0000","last_became_active":"2024-04-24T23:59:15.496868+0000","last_became_peered":"2024-04-24T23:59:15.496868+0000","last_unstale":"2024-04-24T23:59:17.765607+0000","last_undegraded":"2024-04-24T23:59:17.765607+0000","last_fullsized":"2024-04-24T23:59:17.765607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:08:58.686771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764525+0000","last_change":"2024-04-24T23:59:16.523485+0000","last_active":"2024-04-24T23:59:17.764525+0000","last_peered":"2024-04-24T23:59:17.764525+0000","last_clean":"2024-04-24T23:59:17.764525+0000","last_became_active":"2024-04-24T23:59:16.523247+0000","last_became_peered":"2024-04-24T23:59:16.523247+0000","last_unstale":"2024-04-24T23:59:17.764525+0000","last_undegraded":"2024-04-24T23:59:17.764525+0000","last_fullsized":"2024-04-24T23:59:17.764525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:51.111395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518677+0000","last_change":"2024-04-24T23:59:15.489667+0000","last_active":"2024-04-24T23:59:17.518677+0000","last_peered":"2024-04-24T23:59:17.518677+0000","last_clean":"2024-04-24T23:59:17.518677+0000","last_became_active":"2024-04-24T23:59:15.489250+0000","last_became_peered":"2024-04-24T23:59:15.489250+0000","last_unstale":"2024-04-24T23:59:17.518677+0000","last_undegraded":"2024-04-24T23:59:17.518677+0000","last_fullsized":"2024-04-24T23:59:17.518677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:54:51.965663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.518355+0000","last_change":"2024-04-24T23:59:16.519873+0000","last_active":"2024-04-24T23:59:17.518355+0000","last_peered":"2024-04-24T23:59:17.518355+0000","last_clean":"2024-04-24T23:59:17.518355+0000","last_became_active":"2024-04-24T23:59:16.519561+0000","last_became_peered":"2024-04-24T23:59:16.519561+0000","last_unstale":"2024-04-24T23:59:17.518355+0000","last_undegraded":"2024-04-24T23:59:17.518355+0000","last_fullsized":"2024-04-24T23:59:17.518355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:42.413115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.764763+0000","last_change":"2024-04-24T23:59:15.495057+0000","last_active":"2024-04-24T23:59:17.764763+0000","last_peered":"2024-04-24T23:59:17.764763+0000","last_clean":"2024-04-24T23:59:17.764763+0000","last_became_active":"2024-04-24T23:59:15.494712+0000","last_became_peered":"2024-04-24T23:59:15.494712+0000","last_unstale":"2024-04-24T23:59:17.764763+0000","last_undegraded":"2024-04-24T23:59:17.764763+0000","last_fullsized":"2024-04-24T23:59:17.764763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:40.431859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.768308+0000","last_change":"2024-04-24T23:59:16.519096+0000","last_active":"2024-04-24T23:59:17.768308+0000","last_peered":"2024-04-24T23:59:17.768308+0000","last_clean":"2024-04-24T23:59:17.768308+0000","last_became_active":"2024-04-24T23:59:16.518803+0000","last_became_peered":"2024-04-24T23:59:16.518803+0000","last_unstale":"2024-04-24T23:59:17.768308+0000","last_undegraded":"2024-04-24T23:59:17.768308+0000","last_fullsized":"2024-04-24T23:59:17.768308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:15.449570+0000","last_clean_scrub_stamp":"2024-04-24T23:59:15.449570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:27.394923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.517717+0000","last_change":"2024-04-24T23:59:15.498725+0000","last_active":"2024-04-24T23:59:17.517717+0000","last_peered":"2024-04-24T23:59:17.517717+0000","last_clean":"2024-04-24T23:59:17.517717+0000","last_became_active":"2024-04-24T23:59:15.498309+0000","last_became_peered":"2024-04-24T23:59:15.498309+0000","last_unstale":"2024-04-24T23:59:17.517717+0000","last_undegraded":"2024-04-24T23:59:17.517717+0000","last_fullsized":"2024-04-24T23:59:17.517717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:59:14.436887+0000","last_clean_scrub_stamp":"2024-04-24T23:59:14.436887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:07:17.983950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-24T23:59:17.767330+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:59:17.767330+0000","last_peered":"2024-04-24T23:59:17.767330+0000","last_clean":"2024-04-24T23:59:17.767330+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:59:17.767330+0000","last_undegraded":"2024-04-24T23:59:17.767330+0000","last_fullsized":"2024-04-24T23:59:17.767330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":737236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":737146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:59:21.448 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:59:21.448 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-24T23:59:21.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.699+0000 7f7febc00640 1 Processor -- start 2024-04-24T23:59:21.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.700+0000 7f7febc00640 1 -- start start 2024-04-24T23:59:21.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.701+0000 7f7febc00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fe415f3f0 0x7f7fe40ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.701+0000 7f7febc00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe4072bd0 con 0x7f7fe40ae9e0 2024-04-24T23:59:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.701+0000 7f7febc00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe40b4a90 con 0x7f7fe40727f0 2024-04-24T23:59:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.701+0000 7f7febc00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe40af260 con 0x7f7fe415f3f0 2024-04-24T23:59:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.702+0000 7f7fe9c00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7fe40ae9e0 0x7f7fe4154f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:56002/0 (socket says 172.21.15.96:56002) 2024-04-24T23:59:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.702+0000 7f7fe9c00640 1 -- 172.21.15.96:0/3620768220 learned_addr learned my addr 172.21.15.96:0/3620768220 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.702+0000 7f7fe3e00640 1 --2- 172.21.15.96:0/3620768220 >> v2:172.21.15.155:3300/0 conn(0x7f7fe415f3f0 0x7f7fe40ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.702+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219377452 0 0) 0x7f7fe4072bd0 con 0x7f7fe40ae9e0 2024-04-24T23:59:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.702+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fcc005730 con 0x7f7fe40ae9e0 2024-04-24T23:59:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1339826456 0 0) 0x7f7fcc005730 con 0x7f7fe40ae9e0 2024-04-24T23:59:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 >> v2:172.21.15.155:3300/0 conn(0x7f7fe415f3f0 msgr2=0x7f7fe40ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 --2- 172.21.15.96:0/3620768220 >> v2:172.21.15.155:3300/0 conn(0x7f7fe415f3f0 0x7f7fe40ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 >> v1:172.21.15.155:6789/0 conn(0x7f7fe40727f0 legacy=0x7f7fe415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe40b2cc0 con 0x7f7fe40ae9e0 2024-04-24T23:59:21.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f7fdc0019f0 con 0x7f7fe40ae9e0 2024-04-24T23:59:21.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 >> v1:172.21.15.96:6789/0 conn(0x7f7fe40ae9e0 legacy=0x7f7fe4154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fcc005c10 0x7f7fcc006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc006a10 0x7f7fcc006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fcc00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe40af260 con 0x7f7fcc0073d0 2024-04-24T23:59:21.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc00e2d0 con 0x7f7fcc006a10 2024-04-24T23:59:21.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7fcc00e4d0 con 0x7f7fcc005c10 2024-04-24T23:59:21.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.703+0000 7f7fe9c00640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fcc00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.704+0000 7f7fe3e00640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc006a10 0x7f7fcc006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.704+0000 7f7fe9c00640 1 -- 172.21.15.96:0/3620768220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fcc005c10 msgr2=0x7f7fcc006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:21.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.704+0000 7f7fe9c00640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fcc005c10 0x7f7fcc006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.704+0000 7f7fe9c00640 1 -- 172.21.15.96:0/3620768220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc006a10 msgr2=0x7f7fcc006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:21.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.704+0000 7f7fe9c00640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc006a10 0x7f7fcc006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.704+0000 7f7fe9c00640 1 -- 172.21.15.96:0/3620768220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc005730 con 0x7f7fcc0073d0 2024-04-24T23:59:21.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.705+0000 7f7fe9c00640 1 -- 172.21.15.96:0/3620768220 reap_dead start 2024-04-24T23:59:21.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.705+0000 7f7fe9c00640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fcc00dbd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00a790 tx=0x7f7fcc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03059c3abec00a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:21.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.705+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00a3b0 con 0x7f7fcc0073d0 2024-04-24T23:59:21.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.706+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fdc02f070 con 0x7f7fcc0073d0 2024-04-24T23:59:21.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.706+0000 7f7fe3400640 1 -- 172.21.15.96:0/3620768220 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc02bc20 con 0x7f7fcc0073d0 2024-04-24T23:59:21.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.706+0000 7f7febc00640 1 -- 172.21.15.96:0/3620768220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 msgr2=0x7f7fcc00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.706+0000 7f7febc00640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fcc00dbd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00a790 tx=0x7f7fcc007a40 comp rx=0 tx=0).stop 2024-04-24T23:59:21.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.706+0000 7f7febc00640 1 -- 172.21.15.96:0/3620768220 shutdown_connections 2024-04-24T23:59:21.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.706+0000 7f7febc00640 1 --2- 172.21.15.96:0/3620768220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fcc00dbd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.706+0000 7f7febc00640 1 -- 172.21.15.96:0/3620768220 >> 172.21.15.96:0/3620768220 conn(0x7f7fe40b19c0 msgr2=0x7f7fe40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:21.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.706+0000 7f7febc00640 1 -- 172.21.15.96:0/3620768220 shutdown_connections 2024-04-24T23:59:21.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.706+0000 7f7febc00640 1 -- 172.21.15.96:0/3620768220 wait complete. 2024-04-24T23:59:21.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.708+0000 7f7febc00640 1 Processor -- start 2024-04-24T23:59:21.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.708+0000 7f7febc00640 1 -- start start 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.709+0000 7f7febc00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fe4149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.709+0000 7f7febc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe4152f20 0x7f7fe415a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.709+0000 7f7febc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe41533a0 0x7f7fe415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.709+0000 7f7febc00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe40b3560 con 0x7f7fcc0073d0 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.709+0000 7f7febc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe40b3280 con 0x7f7fe4152f20 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.709+0000 7f7febc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe4070e10 con 0x7f7fe41533a0 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.709+0000 7f7fe9200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fe4149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.709+0000 7f7fe9200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fe4149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36026/0 (socket says 172.21.15.96:36026) 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.709+0000 7f7fe9200640 1 -- 172.21.15.96:0/40239003 learned_addr learned my addr 172.21.15.96:0/40239003 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.710+0000 7f7fe3e00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe4152f20 0x7f7fe415a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.710+0000 7f7fe9200640 1 -- 172.21.15.96:0/40239003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe41533a0 msgr2=0x7f7fe415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.710+0000 7f7fe9200640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe41533a0 0x7f7fe415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.710+0000 7f7fe9200640 1 -- 172.21.15.96:0/40239003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe4152f20 msgr2=0x7f7fe415a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.710+0000 7f7fe9200640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe4152f20 0x7f7fe415a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.710+0000 7f7fe9200640 1 -- 172.21.15.96:0/40239003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe414e4a0 con 0x7f7fcc0073d0 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.710+0000 7f7fe9200640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fe4149930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c560 tx=0x7f7fd800ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.711+0000 7f7fe0c00640 1 -- 172.21.15.96:0/40239003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80052d0 con 0x7f7fcc0073d0 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.711+0000 7f7fe0c00640 1 -- 172.21.15.96:0/40239003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd8012630 con 0x7f7fcc0073d0 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.711+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe414e780 con 0x7f7fcc0073d0 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.711+0000 7f7fe0c00640 1 -- 172.21.15.96:0/40239003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80054b0 con 0x7f7fcc0073d0 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.711+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe4149e70 con 0x7f7fcc0073d0 2024-04-24T23:59:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.712+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe4069110 con 0x7f7fcc0073d0 2024-04-24T23:59:21.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.713+0000 7f7fe0c00640 1 -- 172.21.15.96:0/40239003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fd8012a20 con 0x7f7fcc0073d0 2024-04-24T23:59:21.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.714+0000 7f7fe0c00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7fc406be30 0x7f7fc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:21.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.714+0000 7f7fe0c00640 1 -- 172.21.15.96:0/40239003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7fd808aab0 con 0x7f7fcc0073d0 2024-04-24T23:59:21.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.714+0000 7f7fe3e00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7fc406be30 0x7f7fc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:21.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.715+0000 7f7fe3e00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7fc406be30 0x7f7fc406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7fe406d470 tx=0x7f7fd0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:21.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.718+0000 7f7fe0c00640 1 -- 172.21.15.96:0/40239003 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7fd8059450 con 0x7f7fcc0073d0 2024-04-24T23:59:21.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.986+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f7fe406ecb0 con 0x7f7fcc0073d0 2024-04-24T23:59:21.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.991+0000 7f7fe0c00640 1 -- 172.21.15.96:0/40239003 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f7fd8058d50 con 0x7f7fcc0073d0 2024-04-24T23:59:21.992 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-04-24T23:59:21.992 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBNnClmJTIAHRAAQWQYHUYotRYXVJCsgrfvDg== 2024-04-24T23:59:21.992 INFO:teuthology.orchestra.run.smithi096.stdout: caps mds = "allow" 2024-04-24T23:59:21.992 INFO:teuthology.orchestra.run.smithi096.stdout: caps mon = "allow r" 2024-04-24T23:59:21.992 INFO:teuthology.orchestra.run.smithi096.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-24T23:59:21.992 INFO:teuthology.orchestra.run.smithi096.stderr:updated caps for client.0 2024-04-24T23:59:21.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7fc406be30 msgr2=0x7f7fc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7fc406be30 0x7f7fc406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7fe406d470 tx=0x7f7fd0008040 comp rx=0 tx=0).stop 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 msgr2=0x7f7fe4149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fe4149930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c560 tx=0x7f7fd800ca20 comp rx=0 tx=0).stop 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 shutdown_connections 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fe41533a0 0x7f7fe415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fe4152f20 0x7f7fe415a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7fc406be30 0x7f7fc406e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 --2- 172.21.15.96:0/40239003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fcc0073d0 0x7f7fe4149930 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.994+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 >> 172.21.15.96:0/40239003 conn(0x7f7fe40b19c0 msgr2=0x7f7fe406e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.995+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 shutdown_connections 2024-04-24T23:59:21.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:21.995+0000 7f7febc00640 1 -- 172.21.15.96:0/40239003 wait complete. 2024-04-24T23:59:22.013 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:59:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.202+0000 7fc6e8a00640 1 Processor -- start 2024-04-24T23:59:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.202+0000 7fc6e8a00640 1 -- start start 2024-04-24T23:59:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.203+0000 7fc6e8a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc6e40b4ec0 0x7fc6e40cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.203+0000 7fc6e8a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40ccc20 0x7fc6e4070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6e8a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e415fa90 con 0x7fc6e415f6b0 2024-04-24T23:59:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6e8a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc6e40b4a30 con 0x7fc6e40b4ec0 2024-04-24T23:59:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6e8a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e40b3e20 con 0x7fc6e40ccc20 2024-04-24T23:59:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6dbe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc6e40b4ec0 0x7fc6e40cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6dbe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc6e40b4ec0 0x7fc6e40cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36030/0 (socket says 172.21.15.96:36030) 2024-04-24T23:59:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6dbe00640 1 -- 172.21.15.96:0/3705385444 learned_addr learned my addr 172.21.15.96:0/3705385444 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6e3200640 1 --2- 172.21.15.96:0/3705385444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40ccc20 0x7fc6e4070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6dbe00640 1 -- 172.21.15.96:0/3705385444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40ccc20 msgr2=0x7fc6e4070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6dbe00640 1 --2- 172.21.15.96:0/3705385444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40ccc20 0x7fc6e4070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6dbe00640 1 -- 172.21.15.96:0/3705385444 >> v1:172.21.15.155:6789/0 conn(0x7fc6e415f6b0 legacy=0x7fc6e40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.204+0000 7fc6dbe00640 1 -- 172.21.15.96:0/3705385444 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e40b4100 con 0x7fc6e40b4ec0 2024-04-24T23:59:22.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.205+0000 7fc6dbe00640 1 --2- 172.21.15.96:0/3705385444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e40b4ec0 0x7fc6e40cc6e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009870 tx=0x7fc6cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4052177c99c18d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:22.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e1e00640 1 -- 172.21.15.96:0/3705385444 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc037070 con 0x7fc6e40b4ec0 2024-04-24T23:59:22.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e1e00640 1 -- 172.21.15.96:0/3705385444 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6cc032440 con 0x7fc6e40b4ec0 2024-04-24T23:59:22.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e1e00640 1 -- 172.21.15.96:0/3705385444 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc032810 con 0x7fc6e40b4ec0 2024-04-24T23:59:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e8a00640 1 -- 172.21.15.96:0/3705385444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e40b4ec0 msgr2=0x7fc6e40cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e8a00640 1 --2- 172.21.15.96:0/3705385444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e40b4ec0 0x7fc6e40cc6e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009870 tx=0x7fc6cc02a210 comp rx=0 tx=0).stop 2024-04-24T23:59:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e8a00640 1 -- 172.21.15.96:0/3705385444 shutdown_connections 2024-04-24T23:59:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e8a00640 1 --2- 172.21.15.96:0/3705385444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40ccc20 0x7fc6e4070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e8a00640 1 --2- 172.21.15.96:0/3705385444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e40b4ec0 0x7fc6e40cc6e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e8a00640 1 -- 172.21.15.96:0/3705385444 >> 172.21.15.96:0/3705385444 conn(0x7fc6e40b1f10 msgr2=0x7fc6e40cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e8a00640 1 -- 172.21.15.96:0/3705385444 shutdown_connections 2024-04-24T23:59:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.206+0000 7fc6e8a00640 1 -- 172.21.15.96:0/3705385444 wait complete. 2024-04-24T23:59:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.208+0000 7fc6e8a00640 1 Processor -- start 2024-04-24T23:59:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.208+0000 7fc6e8a00640 1 -- start start 2024-04-24T23:59:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.209+0000 7fc6e8a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40b4ec0 0x7fc6e409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.209+0000 7fc6e8a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6e40ccc20 0x7fc6e406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.209+0000 7fc6e8a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e415f6b0 0x7fc6e40caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.209+0000 7fc6e8a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e40cf1c0 con 0x7fc6e415f6b0 2024-04-24T23:59:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.209+0000 7fc6e8a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e40b46c0 con 0x7fc6e40ccc20 2024-04-24T23:59:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.209+0000 7fc6e8a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e40b3a40 con 0x7fc6e40b4ec0 2024-04-24T23:59:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.209+0000 7fc6e3200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e415f6b0 0x7fc6e40caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.209+0000 7fc6e3200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e415f6b0 0x7fc6e40caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36042/0 (socket says 172.21.15.96:36042) 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.209+0000 7fc6e3200640 1 -- 172.21.15.96:0/2535579251 learned_addr learned my addr 172.21.15.96:0/2535579251 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6dbe00640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6e40ccc20 0x7fc6e406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6e3200640 1 -- 172.21.15.96:0/2535579251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40b4ec0 msgr2=0x7fc6e409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6e2800640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40b4ec0 0x7fc6e409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6e3200640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40b4ec0 0x7fc6e409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6e3200640 1 -- 172.21.15.96:0/2535579251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6e40ccc20 msgr2=0x7fc6e406cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6e3200640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6e40ccc20 0x7fc6e406cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6e3200640 1 -- 172.21.15.96:0/2535579251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e406da60 con 0x7fc6e415f6b0 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6dbe00640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6e40ccc20 0x7fc6e406cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6e3200640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e415f6b0 0x7fc6e40caf20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00cd70 tx=0x7fc6dc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:22.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6daa00640 1 -- 172.21.15.96:0/2535579251 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc003b90 con 0x7fc6e415f6b0 2024-04-24T23:59:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6daa00640 1 -- 172.21.15.96:0/2535579251 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc003d30 con 0x7fc6e415f6b0 2024-04-24T23:59:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6daa00640 1 -- 172.21.15.96:0/2535579251 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc004240 con 0x7fc6e415f6b0 2024-04-24T23:59:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.210+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e406d1c0 con 0x7fc6e415f6b0 2024-04-24T23:59:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.211+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e406d780 con 0x7fc6e415f6b0 2024-04-24T23:59:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.211+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e4067e40 con 0x7fc6e415f6b0 2024-04-24T23:59:22.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.213+0000 7fc6daa00640 1 -- 172.21.15.96:0/2535579251 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6dc0043e0 con 0x7fc6e415f6b0 2024-04-24T23:59:22.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.213+0000 7fc6daa00640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc6c006be30 0x7fc6c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:22.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.214+0000 7fc6daa00640 1 -- 172.21.15.96:0/2535579251 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc6dc08b970 con 0x7fc6e415f6b0 2024-04-24T23:59:22.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.214+0000 7fc6e2800640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc6c006be30 0x7fc6c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:22.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.214+0000 7fc6e2800640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc6c006be30 0x7fc6c006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400a750 tx=0x7fc6d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:22.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.218+0000 7fc6daa00640 1 -- 172.21.15.96:0/2535579251 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc6e406da60 con 0x7fc6e415f6b0 2024-04-24T23:59:22.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.439+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6e40756b0 con 0x7fc6e415f6b0 2024-04-24T23:59:22.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.440+0000 7fc6daa00640 1 -- 172.21.15.96:0/2535579251 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7fc6dc05a310 con 0x7fc6e415f6b0 2024-04-24T23:59:22.441 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:22.441 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1875464528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1875464528},{"type":"v1","addr":"172.21.15.155:6835","nonce":1875464528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/2449705897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":2449705897},{"type":"v1","addr":"172.21.15.96:6837","nonce":2449705897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4160377725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4160377725},{"type":"v1","addr":"172.21.15.155:6833","nonce":4160377725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:59:15.923615+0000","modified":"2024-04-24T23:59:19.009098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.96:6835/3672280349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3672280349},{"type":"v1","addr":"172.21.15.96:6835","nonce":3672280349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5097,"qdb_cluster":[5097]},"id":2}]} 2024-04-24T23:59:22.441 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-04-24T23:59:22.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc6c006be30 msgr2=0x7fc6c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:22.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc6c006be30 0x7fc6c006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400a750 tx=0x7fc6d4008040 comp rx=0 tx=0).stop 2024-04-24T23:59:22.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e415f6b0 msgr2=0x7fc6e40caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:22.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e415f6b0 0x7fc6e40caf20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00cd70 tx=0x7fc6dc00a660 comp rx=0 tx=0).stop 2024-04-24T23:59:22.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 shutdown_connections 2024-04-24T23:59:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc6c006be30 0x7fc6c006e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e415f6b0 0x7fc6e40caf20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6e40ccc20 0x7fc6e406cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 --2- 172.21.15.96:0/2535579251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6e40b4ec0 0x7fc6e409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 >> 172.21.15.96:0/2535579251 conn(0x7fc6e40b1f10 msgr2=0x7fc6e4160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 shutdown_connections 2024-04-24T23:59:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:22.443+0000 7fc6e8a00640 1 -- 172.21.15.96:0/2535579251 wait complete. 2024-04-24T23:59:22.864 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:59:15.923615+0000', 'modified': '2024-04-24T23:59:19.009098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5097}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5097': {'gid': 5097, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.96:6835/3672280349', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6834', 'nonce': 3672280349}, {'type': 'v1', 'addr': '172.21.15.96:6835', 'nonce': 3672280349}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5097, 'qdb_cluster': [5097]} 2024-04-24T23:59:22.864 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:59:22.864 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-24T23:59:23.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.079+0000 7f36b2e00640 1 Processor -- start 2024-04-24T23:59:23.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.079+0000 7f36b2e00640 1 -- start start 2024-04-24T23:59:23.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.081+0000 7f36b2e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36ac15c230 0x7f36ac071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.081+0000 7f36b2e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac0af120 0x7f36ac06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.081+0000 7f36b2e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ac160b20 con 0x7f36ac0acda0 2024-04-24T23:59:23.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.081+0000 7f36b2e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f36ac15c610 con 0x7f36ac15c230 2024-04-24T23:59:23.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.081+0000 7f36b2e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac0ad230 con 0x7f36ac0af120 2024-04-24T23:59:23.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.081+0000 7f36a3400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f36ac0acda0 0x7f36ac0aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:56006/0 (socket says 172.21.15.96:56006) 2024-04-24T23:59:23.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.081+0000 7f36abe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36ac15c230 0x7f36ac071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.081+0000 7f36a3400640 1 -- 172.21.15.96:0/1074962756 learned_addr learned my addr 172.21.15.96:0/1074962756 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.082+0000 7f36abe00640 1 -- 172.21.15.96:0/1074962756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac0af120 msgr2=0x7f36ac06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.082+0000 7f36abe00640 1 --2- 172.21.15.96:0/1074962756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac0af120 0x7f36ac06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.082+0000 7f36abe00640 1 -- 172.21.15.96:0/1074962756 >> v1:172.21.15.96:6789/0 conn(0x7f36ac0acda0 legacy=0x7f36ac0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.082+0000 7f36ab400640 1 -- 172.21.15.96:0/1074962756 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627840808 0 0) 0x7f36ac160b20 con 0x7f36ac0acda0 2024-04-24T23:59:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.082+0000 7f36abe00640 1 -- 172.21.15.96:0/1074962756 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac15fd60 con 0x7f36ac15c230 2024-04-24T23:59:23.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.083+0000 7f36abe00640 1 --2- 172.21.15.96:0/1074962756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac15c230 0x7f36ac071800 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097a0 tx=0x7f369c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85399160f834c9f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.083+0000 7f36ab400640 1 -- 172.21.15.96:0/1074962756 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c037070 con 0x7f36ac15c230 2024-04-24T23:59:23.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.083+0000 7f36ab400640 1 -- 172.21.15.96:0/1074962756 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369c032440 con 0x7f36ac15c230 2024-04-24T23:59:23.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.083+0000 7f36ab400640 1 -- 172.21.15.96:0/1074962756 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c032810 con 0x7f36ac15c230 2024-04-24T23:59:23.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.084+0000 7f36b2e00640 1 -- 172.21.15.96:0/1074962756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac15c230 msgr2=0x7f36ac071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.084+0000 7f36b2e00640 1 --2- 172.21.15.96:0/1074962756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac15c230 0x7f36ac071800 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097a0 tx=0x7f369c02a180 comp rx=0 tx=0).stop 2024-04-24T23:59:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.084+0000 7f36b2e00640 1 -- 172.21.15.96:0/1074962756 shutdown_connections 2024-04-24T23:59:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.084+0000 7f36b2e00640 1 --2- 172.21.15.96:0/1074962756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac0af120 0x7f36ac06cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.084+0000 7f36b2e00640 1 --2- 172.21.15.96:0/1074962756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac15c230 0x7f36ac071800 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.084+0000 7f36b2e00640 1 -- 172.21.15.96:0/1074962756 >> 172.21.15.96:0/1074962756 conn(0x7f36ac0b19c0 msgr2=0x7f36ac0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.084+0000 7f36b2e00640 1 -- 172.21.15.96:0/1074962756 shutdown_connections 2024-04-24T23:59:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.084+0000 7f36b2e00640 1 -- 172.21.15.96:0/1074962756 wait complete. 2024-04-24T23:59:23.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.085+0000 7f36b2e00640 1 Processor -- start 2024-04-24T23:59:23.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.086+0000 7f36b2e00640 1 -- start start 2024-04-24T23:59:23.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.086+0000 7f36b2e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36ac0acda0 0x7f36ac09c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.086+0000 7f36b2e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac0af120 0x7f36ac06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36b2e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac15c230 0x7f36ac09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36b2e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac160600 con 0x7f36ac0af120 2024-04-24T23:59:23.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36b2e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac160320 con 0x7f36ac0acda0 2024-04-24T23:59:23.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36b2e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac0ad4d0 con 0x7f36ac15c230 2024-04-24T23:59:23.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36a3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac0af120 0x7f36ac06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36a3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac0af120 0x7f36ac06cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36062/0 (socket says 172.21.15.96:36062) 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36a3400640 1 -- 172.21.15.96:0/83725380 learned_addr learned my addr 172.21.15.96:0/83725380 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36b0e00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac15c230 0x7f36ac09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36abe00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36ac0acda0 0x7f36ac09c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36a3400640 1 -- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac15c230 msgr2=0x7f36ac09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36a3400640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac15c230 0x7f36ac09aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36a3400640 1 -- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36ac0acda0 msgr2=0x7f36ac09c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36a3400640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36ac0acda0 0x7f36ac09c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36a3400640 1 -- 172.21.15.96:0/83725380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac09c7c0 con 0x7f36ac0af120 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36b0e00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac15c230 0x7f36ac09aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.087+0000 7f36abe00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36ac0acda0 0x7f36ac09c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.088+0000 7f36a3400640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac0af120 0x7f36ac06cde0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f369400c430 tx=0x7f369400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.088+0000 7f36a8c00640 1 -- 172.21.15.96:0/83725380 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36940074e0 con 0x7f36ac0af120 2024-04-24T23:59:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.088+0000 7f36a8c00640 1 -- 172.21.15.96:0/83725380 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36940047e0 con 0x7f36ac0af120 2024-04-24T23:59:23.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.088+0000 7f36b2e00640 1 -- 172.21.15.96:0/83725380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac09ca60 con 0x7f36ac0af120 2024-04-24T23:59:23.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.088+0000 7f36a8c00640 1 -- 172.21.15.96:0/83725380 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694004bd0 con 0x7f36ac0af120 2024-04-24T23:59:23.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.088+0000 7f36b2e00640 1 -- 172.21.15.96:0/83725380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac09d020 con 0x7f36ac0af120 2024-04-24T23:59:23.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.090+0000 7f36a8c00640 1 -- 172.21.15.96:0/83725380 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3694011070 con 0x7f36ac0af120 2024-04-24T23:59:23.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.091+0000 7f36a8c00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f368806be30 0x7f368806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.091+0000 7f36a8c00640 1 -- 172.21.15.96:0/83725380 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f369408aae0 con 0x7f36ac0af120 2024-04-24T23:59:23.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.091+0000 7f36abe00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f368806be30 0x7f368806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.092+0000 7f36b5d80740 1 Processor -- start 2024-04-24T23:59:23.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.092+0000 7f36abe00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f368806be30 0x7f368806e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f369c034000 tx=0x7f369c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.092+0000 7f36b5d80740 1 -- start start 2024-04-24T23:59:23.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.093+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf97d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.093+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 0x55aecf99b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.093+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf9531f0 0x55aecf999470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.093+0000 7f36b5d80740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55aecf852ed0 con 0x55aecf9531f0 2024-04-24T23:59:23.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.093+0000 7f36b5d80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55aecf8b5df0 con 0x55aecf97d510 2024-04-24T23:59:23.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.093+0000 7f36b5d80740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55aecf85e8d0 con 0x55aecf99adb0 2024-04-24T23:59:23.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36b0e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf9531f0 0x55aecf999470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36b0e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf9531f0 0x55aecf999470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36076/0 (socket says 172.21.15.96:36076) 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36b0e00640 1 -- 172.21.15.96:0/1780215557 learned_addr learned my addr 172.21.15.96:0/1780215557 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36b0e00640 1 -- 172.21.15.96:0/1780215557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 msgr2=0x55aecf99b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36abe00640 1 --2- 172.21.15.96:0/1780215557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf97d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36b0e00640 1 --2- 172.21.15.96:0/1780215557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 0x55aecf99b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36b0e00640 1 -- 172.21.15.96:0/1780215557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 msgr2=0x55aecf97d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36b0e00640 1 --2- 172.21.15.96:0/1780215557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf97d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36b0e00640 1 -- 172.21.15.96:0/1780215557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aecf5ca2d0 con 0x55aecf9531f0 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.094+0000 7f36b0e00640 1 --2- 172.21.15.96:0/1780215557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf9531f0 0x55aecf999470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f36a4007ef0 tx=0x7f36a400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5210a466bcf1958d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36a0c00640 1 -- 172.21.15.96:0/1780215557 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a400e850 con 0x55aecf9531f0 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36a0c00640 1 -- 172.21.15.96:0/1780215557 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a400e9f0 con 0x55aecf9531f0 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36a0c00640 1 -- 172.21.15.96:0/1780215557 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a400ede0 con 0x55aecf9531f0 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36b5d80740 1 -- 172.21.15.96:0/1780215557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf9531f0 msgr2=0x55aecf999470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36b5d80740 1 --2- 172.21.15.96:0/1780215557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf9531f0 0x55aecf999470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f36a4007ef0 tx=0x7f36a400c730 comp rx=0 tx=0).stop 2024-04-24T23:59:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36b5d80740 1 -- 172.21.15.96:0/1780215557 shutdown_connections 2024-04-24T23:59:23.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36b5d80740 1 --2- 172.21.15.96:0/1780215557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf9531f0 0x55aecf999470 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36b5d80740 1 --2- 172.21.15.96:0/1780215557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 0x55aecf99b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36b5d80740 1 --2- 172.21.15.96:0/1780215557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf97d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36b5d80740 1 -- 172.21.15.96:0/1780215557 >> 172.21.15.96:0/1780215557 conn(0x55aecf94fb20 msgr2=0x55aecf998320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:23.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36b5d80740 1 -- 172.21.15.96:0/1780215557 shutdown_connections 2024-04-24T23:59:23.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.095+0000 7f36b5d80740 1 -- 172.21.15.96:0/1780215557 wait complete. 2024-04-24T23:59:23.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.096+0000 7f36b5d80740 1 -- start start 2024-04-24T23:59:23.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.096+0000 7f36b5d80740 1 Processor -- start 2024-04-24T23:59:23.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.097+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf9a8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.097+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf99adb0 0x55aecf9a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.097+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf97e1d0 0x55aecf9a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.097+0000 7f36b5d80740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55aecf871d20 con 0x55aecf99adb0 2024-04-24T23:59:23.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.097+0000 7f36b5d80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55aecf8b1db0 con 0x55aecf97d510 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.097+0000 7f36b5d80740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55aecf953f90 con 0x55aecf97e1d0 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.097+0000 7f36b5d80740 10 client.0 _ll_register_callbacks cb 0x55aecf8acf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36a3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf99adb0 0x55aecf9a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36a3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf99adb0 0x55aecf9a8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36082/0 (socket says 172.21.15.96:36082) 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36a3400640 1 -- 172.21.15.96:0/4273414309 learned_addr learned my addr 172.21.15.96:0/4273414309 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36abe00640 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf9a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36a3400640 1 -- 172.21.15.96:0/4273414309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf97e1d0 msgr2=0x55aecf9a92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36a3400640 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf97e1d0 0x55aecf9a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36a3400640 1 -- 172.21.15.96:0/4273414309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 msgr2=0x55aecf9a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36a3400640 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf9a8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36a3400640 1 -- 172.21.15.96:0/4273414309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aecf6946b0 con 0x55aecf99adb0 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36a3400640 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf99adb0 0x55aecf9a8d70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3694061430 tx=0x7f3694058e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c869fb862e2165 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f3699600640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-24T23:59:23.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f3699600640 1 -- 172.21.15.96:0/4273414309 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36940553f0 con 0x55aecf99adb0 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f3699600640 1 -- 172.21.15.96:0/4273414309 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f36940581d0 con 0x55aecf99adb0 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.098+0000 7f36b5d80740 1 -- 172.21.15.96:0/4273414309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a400e9f0 con 0x55aecf99adb0 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f3699600640 1 -- 172.21.15.96:0/4273414309 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f3694055590 con 0x55aecf99adb0 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f36b5d80740 10 client.5274 fetch_fsmap learned FSMap version 16 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f36b5d80740 1 -- 172.21.15.96:0/4273414309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55aecf99d020 con 0x55aecf99adb0 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f3699600640 1 -- 172.21.15.96:0/4273414309 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a400e9f0 con 0x55aecf99adb0 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f3699600640 1 -- 172.21.15.96:0/4273414309 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f369405f330 con 0x55aecf99adb0 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f36b5d80740 10 client.5274 fetch_fsmap finished waiting for FSMap version 16 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f36b5d80740 10 client.5274 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f36b5d80740 20 client.5274 populate_metadata read hostname 'smithi096' 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] conn(0x55aecf99d9d0 0x55aecf9b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f36b5d80740 4 client.5274 mds_command: new command op to 5097 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f36b5d80740 1 -- 172.21.15.96:0/4273414309 --> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aecf8c3330 con 0x55aecf99d9d0 2024-04-24T23:59:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.099+0000 7f36abe00640 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] conn(0x55aecf99d9d0 0x55aecf9b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.100+0000 7f36abe00640 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] conn(0x55aecf99d9d0 0x55aecf9b6d60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e69772452744159c server_cookie=125eedac63104ddc in_seq=0 out_seq=0 2024-04-24T23:59:23.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.100+0000 7f3699600640 10 client.5274 ms_handle_connect on v2:172.21.15.96:6834/3672280349 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f3699600640 1 -- 172.21.15.96:0/4273414309 <== mds.0 v2:172.21.15.96:6834/3672280349 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aecf8c3330 con 0x55aecf99d9d0 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f3699600640 10 client.5274 handle_command_reply: tid=0 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 client.5274 shutdown 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 -- 172.21.15.96:0/4273414309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf99adb0 msgr2=0x55aecf9a8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf99adb0 0x55aecf9a8d70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3694061430 tx=0x7f3694058e40 comp rx=0 tx=0).stop 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 -- 172.21.15.96:0/4273414309 shutdown_connections 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] conn(0x55aecf99d9d0 0x55aecf9b6d60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf97e1d0 0x55aecf9a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf99adb0 0x55aecf9a8d70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4273414309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf9a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 -- 172.21.15.96:0/4273414309 >> 172.21.15.96:0/4273414309 conn(0x55aecf9531f0 msgr2=0x55aecf952770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:23.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f3699600640 0 client.5274 ms_handle_reset on v2:172.21.15.96:6834/3672280349 2024-04-24T23:59:23.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 -- 172.21.15.96:0/4273414309 shutdown_connections 2024-04-24T23:59:23.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.101+0000 7f36b5d80740 1 -- 172.21.15.96:0/4273414309 wait complete. 2024-04-24T23:59:23.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.102+0000 7f36b5d80740 20 client.5274 trim_cache size 0 max 16384 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.121+0000 7f36b5d80740 1 Processor -- start 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.121+0000 7f36b5d80740 1 -- start start 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97d510 0x55aecf99f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97e1d0 0x55aecf9bc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 0x55aecf97f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36b5d80740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac1ff6b0 con 0x55aecf97d510 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36b5d80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac157310 con 0x55aecf97e1d0 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36b5d80740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac1ff060 con 0x55aecf99adb0 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36abe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97d510 0x55aecf99f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36abe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97d510 0x55aecf99f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36084/0 (socket says 172.21.15.96:36084) 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36abe00640 1 -- 172.21.15.96:0/4282497766 learned_addr learned my addr 172.21.15.96:0/4282497766 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36abe00640 1 -- 172.21.15.96:0/4282497766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 msgr2=0x55aecf97f6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-24T23:59:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36abe00640 1 --2- 172.21.15.96:0/4282497766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 0x55aecf97f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36abe00640 1 -- 172.21.15.96:0/4282497766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97e1d0 msgr2=0x55aecf9bc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36abe00640 1 --2- 172.21.15.96:0/4282497766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97e1d0 0x55aecf9bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.122+0000 7f36abe00640 1 -- 172.21.15.96:0/4282497766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aecf990080 con 0x55aecf97d510 2024-04-24T23:59:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.123+0000 7f36abe00640 1 --2- 172.21.15.96:0/4282497766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97d510 0x55aecf99f110 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f369c02a1c0 tx=0x7f369c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d76e2251a185848 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.123+0000 7f369be00640 1 -- 172.21.15.96:0/4282497766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c037040 con 0x55aecf97d510 2024-04-24T23:59:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.123+0000 7f369be00640 1 -- 172.21.15.96:0/4282497766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369c004230 con 0x55aecf97d510 2024-04-24T23:59:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.123+0000 7f369be00640 1 -- 172.21.15.96:0/4282497766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c04e1d0 con 0x55aecf97d510 2024-04-24T23:59:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 -- 172.21.15.96:0/4282497766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97d510 msgr2=0x55aecf99f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4282497766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97d510 0x55aecf99f110 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f369c02a1c0 tx=0x7f369c02c000 comp rx=0 tx=0).stop 2024-04-24T23:59:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 -- 172.21.15.96:0/4282497766 shutdown_connections 2024-04-24T23:59:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4282497766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 0x55aecf97f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4282497766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97e1d0 0x55aecf9bc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 --2- 172.21.15.96:0/4282497766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97d510 0x55aecf99f110 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 -- 172.21.15.96:0/4282497766 >> 172.21.15.96:0/4282497766 conn(0x55aecf9531f0 msgr2=0x55aecf954730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 -- 172.21.15.96:0/4282497766 shutdown_connections 2024-04-24T23:59:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 -- 172.21.15.96:0/4282497766 wait complete. 2024-04-24T23:59:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.124+0000 7f36b5d80740 1 -- start start 2024-04-24T23:59:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.125+0000 7f36b5d80740 1 Processor -- start 2024-04-24T23:59:23.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf998320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97e1d0 0x55aecf9fc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36b5d80740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 0x55aecf97f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36b5d80740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55aecf99d850 con 0x55aecf97e1d0 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36b5d80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55aecf99d360 con 0x55aecf97d510 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36b5d80740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55aecf9b3020 con 0x55aecf99adb0 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36b5d80740 10 client.0 _ll_register_callbacks cb 0x7f3694007760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36a3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97e1d0 0x55aecf9fc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36a3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97e1d0 0x55aecf9fc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36096/0 (socket says 172.21.15.96:36096) 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36a3400640 1 -- 172.21.15.96:0/404274232 learned_addr learned my addr 172.21.15.96:0/404274232 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36abe00640 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf998320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36a3400640 1 -- 172.21.15.96:0/404274232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 msgr2=0x55aecf97f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36a3400640 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 0x55aecf97f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36a3400640 1 -- 172.21.15.96:0/404274232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 msgr2=0x55aecf998320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36a3400640 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf998320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36a3400640 1 -- 172.21.15.96:0/404274232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aecf9a8620 con 0x55aecf97e1d0 2024-04-24T23:59:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f36a3400640 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97e1d0 0x55aecf9fc6d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f36940551e0 tx=0x7f3694000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37f6206b1ff0266 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.126+0000 7f3699600640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f3699600640 1 -- 172.21.15.96:0/404274232 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36940584f0 con 0x55aecf97e1d0 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f3699600640 1 -- 172.21.15.96:0/404274232 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f3694057c40 con 0x55aecf97e1d0 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36b5d80740 1 -- 172.21.15.96:0/404274232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f369c004230 con 0x55aecf97e1d0 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f3699600640 1 -- 172.21.15.96:0/404274232 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f3694059480 con 0x55aecf97e1d0 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36b5d80740 10 client.5280 fetch_fsmap learned FSMap version 16 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36b5d80740 1 -- 172.21.15.96:0/404274232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55aecf9a8190 con 0x55aecf97e1d0 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f3699600640 1 -- 172.21.15.96:0/404274232 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369c004230 con 0x55aecf97e1d0 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f3699600640 1 -- 172.21.15.96:0/404274232 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f3694077040 con 0x55aecf97e1d0 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36b5d80740 10 client.5280 fetch_fsmap finished waiting for FSMap version 16 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36b5d80740 10 client.5280 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36b5d80740 20 client.5280 populate_metadata read hostname 'smithi096' 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36b5d80740 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] conn(0x55aecf951bc0 0x55aecf9962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36b5d80740 4 client.5280 mds_command: new command op to 5097 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:59:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36b5d80740 1 -- 172.21.15.96:0/404274232 --> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] -- command(tid 0: {"prefix": "status"}) -- 0x55aecf8bd680 con 0x55aecf951bc0 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.127+0000 7f36abe00640 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] conn(0x55aecf951bc0 0x55aecf9962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36abe00640 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] conn(0x55aecf951bc0 0x55aecf9962f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c31dc6e423658289 server_cookie=6eb4426a3e192a70 in_seq=0 out_seq=0 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f3699600640 10 client.5280 ms_handle_connect on v2:172.21.15.96:6834/3672280349 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f3699600640 1 -- 172.21.15.96:0/404274232 <== mds.0 v2:172.21.15.96:6834/3672280349 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55aecf8bd680 con 0x55aecf951bc0 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f3699600640 10 client.5280 handle_command_reply: tid=0 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36b5d80740 1 client.5280 shutdown 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36b5d80740 1 -- 172.21.15.96:0/404274232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97e1d0 msgr2=0x55aecf9fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36b5d80740 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97e1d0 0x55aecf9fc6d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f36940551e0 tx=0x7f3694000ed0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36b5d80740 1 -- 172.21.15.96:0/404274232 shutdown_connections 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36b5d80740 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.96:6834/3672280349,v1:172.21.15.96:6835/3672280349] conn(0x55aecf951bc0 0x55aecf9962f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36b5d80740 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55aecf99adb0 0x55aecf97f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36b5d80740 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55aecf97e1d0 0x55aecf9fc6d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f3699600640 0 client.5280 ms_handle_reset on v2:172.21.15.96:6834/3672280349 2024-04-24T23:59:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36b5d80740 1 --2- 172.21.15.96:0/404274232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aecf97d510 0x55aecf998320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.128+0000 7f36b5d80740 1 -- 172.21.15.96:0/404274232 >> 172.21.15.96:0/404274232 conn(0x55aecf9531f0 msgr2=0x55aecf99eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.129+0000 7f36b5d80740 1 -- 172.21.15.96:0/404274232 shutdown_connections 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.129+0000 7f36b5d80740 1 -- 172.21.15.96:0/404274232 wait complete. 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.129+0000 7f36b5d80740 20 client.5280 trim_cache size 0 max 16384 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "c95ce1e9-7a69-4f8e-a964-bd4778092d3c", 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 5097, 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-04-24T23:59:23.133 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-04-24T23:59:23.134 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-04-24T23:59:23.134 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 6.6448133900000004, 2024-04-24T23:59:23.134 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 16, 2024-04-24T23:59:23.134 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 33, 2024-04-24T23:59:23.134 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 33, 2024-04-24T23:59:23.134 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 15.452783093000001 2024-04-24T23:59:23.134 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.129+0000 7f36b2e00640 1 -- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f368806be30 msgr2=0x7f368806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.129+0000 7f36b2e00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f368806be30 0x7f368806e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f369c034000 tx=0x7f369c02e000 comp rx=0 tx=0).stop 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.129+0000 7f36b2e00640 1 -- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac0af120 msgr2=0x7f36ac06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.129+0000 7f36b2e00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac0af120 0x7f36ac06cde0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f369400c430 tx=0x7f369400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.130+0000 7f36b2e00640 1 -- 172.21.15.96:0/83725380 shutdown_connections 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.130+0000 7f36b2e00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36ac15c230 0x7f36ac09aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.130+0000 7f36b2e00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f368806be30 0x7f368806e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.130+0000 7f36b2e00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36ac0af120 0x7f36ac06cde0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.130+0000 7f36b2e00640 1 --2- 172.21.15.96:0/83725380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36ac0acda0 0x7f36ac09c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.130+0000 7f36b2e00640 1 -- 172.21.15.96:0/83725380 >> 172.21.15.96:0/83725380 conn(0x7f36ac0b19c0 msgr2=0x7f36ac0af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.130+0000 7f36b2e00640 1 -- 172.21.15.96:0/83725380 shutdown_connections 2024-04-24T23:59:23.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.130+0000 7f36b2e00640 1 -- 172.21.15.96:0/83725380 wait complete. 2024-04-24T23:59:23.147 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:59:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.320+0000 7f78bea00640 1 Processor -- start 2024-04-24T23:59:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.320+0000 7f78bea00640 1 -- start start 2024-04-24T23:59:23.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78bea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b8070df0 0x7f78b815f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78bea00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f78b80b2cc0 0x7f78b80b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78bea00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b80713d0 con 0x7f78b815b220 2024-04-24T23:59:23.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78bea00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f78b80aee00 con 0x7f78b80b2cc0 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78bea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f78b80ae4d0 con 0x7f78b8070df0 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78b7e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f78b815b220 0x7f78b815ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:56014/0 (socket says 172.21.15.96:56014) 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78b7e00640 1 -- 172.21.15.96:0/2396363262 learned_addr learned my addr 172.21.15.96:0/2396363262 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78bca00640 1 --2- 172.21.15.96:0/2396363262 >> v2:172.21.15.96:3300/0 conn(0x7f78b80b2cc0 0x7f78b80b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78af400640 1 --2- 172.21.15.96:0/2396363262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b8070df0 0x7f78b815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.322+0000 7f78b7400640 1 -- 172.21.15.96:0/2396363262 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426522360 0 0) 0x7f78b80713d0 con 0x7f78b815b220 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.323+0000 7f78b7400640 1 -- 172.21.15.96:0/2396363262 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f789c003520 con 0x7f78b815b220 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.323+0000 7f78bca00640 1 -- 172.21.15.96:0/2396363262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b8070df0 msgr2=0x7f78b815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.323+0000 7f78bca00640 1 --2- 172.21.15.96:0/2396363262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b8070df0 0x7f78b815f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.323+0000 7f78bca00640 1 -- 172.21.15.96:0/2396363262 >> v1:172.21.15.96:6789/0 conn(0x7f78b815b220 legacy=0x7f78b815ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.323+0000 7f78bca00640 1 -- 172.21.15.96:0/2396363262 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b80ae7b0 con 0x7f78b80b2cc0 2024-04-24T23:59:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.323+0000 7f78af400640 1 --2- 172.21.15.96:0/2396363262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b8070df0 0x7f78b815f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.324+0000 7f78bca00640 1 --2- 172.21.15.96:0/2396363262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 0x7f78b80b3150 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009d90 tx=0x7f78b002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0fc02037de97b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.324+0000 7f78b7400640 1 -- 172.21.15.96:0/2396363262 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0007740 con 0x7f78b80b2cc0 2024-04-24T23:59:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.324+0000 7f78b7400640 1 -- 172.21.15.96:0/2396363262 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b00078e0 con 0x7f78b80b2cc0 2024-04-24T23:59:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.324+0000 7f78b7400640 1 -- 172.21.15.96:0/2396363262 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0007cb0 con 0x7f78b80b2cc0 2024-04-24T23:59:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.325+0000 7f78bea00640 1 -- 172.21.15.96:0/2396363262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 msgr2=0x7f78b80b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.325+0000 7f78bea00640 1 --2- 172.21.15.96:0/2396363262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 0x7f78b80b3150 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009d90 tx=0x7f78b002a660 comp rx=0 tx=0).stop 2024-04-24T23:59:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.325+0000 7f78bea00640 1 -- 172.21.15.96:0/2396363262 shutdown_connections 2024-04-24T23:59:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.325+0000 7f78bea00640 1 --2- 172.21.15.96:0/2396363262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 0x7f78b80b3150 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.325+0000 7f78bea00640 1 --2- 172.21.15.96:0/2396363262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b8070df0 0x7f78b815f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.325+0000 7f78bea00640 1 -- 172.21.15.96:0/2396363262 >> 172.21.15.96:0/2396363262 conn(0x7f78b80b19c0 msgr2=0x7f78b80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.325+0000 7f78bea00640 1 -- 172.21.15.96:0/2396363262 shutdown_connections 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.325+0000 7f78bea00640 1 -- 172.21.15.96:0/2396363262 wait complete. 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.327+0000 7f78bea00640 1 Processor -- start 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.327+0000 7f78bea00640 1 -- start start 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78bea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b8070df0 0x7f78b81438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78bea00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 0x7f78b814e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78bea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b815b220 0x7f78b809d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78bea00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f78b806ed10 con 0x7f78b80b2cc0 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78bea00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f78b806eb90 con 0x7f78b8070df0 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78bea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f78b815f8c0 con 0x7f78b815b220 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78af400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 0x7f78b814e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78af400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 0x7f78b814e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36108/0 (socket says 172.21.15.96:36108) 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78af400640 1 -- 172.21.15.96:0/2938170559 learned_addr learned my addr 172.21.15.96:0/2938170559 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78b7e00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b8070df0 0x7f78b81438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78bca00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b815b220 0x7f78b809d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78af400640 1 -- 172.21.15.96:0/2938170559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b815b220 msgr2=0x7f78b809d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78af400640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b815b220 0x7f78b809d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78af400640 1 -- 172.21.15.96:0/2938170559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b8070df0 msgr2=0x7f78b81438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78af400640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b8070df0 0x7f78b81438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.328+0000 7f78af400640 1 -- 172.21.15.96:0/2938170559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b809bf70 con 0x7f78b80b2cc0 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.329+0000 7f78af400640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 0x7f78b814e7e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f78a000e7e0 tx=0x7f78a000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.329+0000 7f78b4c00640 1 -- 172.21.15.96:0/2938170559 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a000f040 con 0x7f78b80b2cc0 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.329+0000 7f78b4c00640 1 -- 172.21.15.96:0/2938170559 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a0004030 con 0x7f78b80b2cc0 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.329+0000 7f78b4c00640 1 -- 172.21.15.96:0/2938170559 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0004400 con 0x7f78b80b2cc0 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.329+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b809c250 con 0x7f78b80b2cc0 2024-04-24T23:59:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.329+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b809c810 con 0x7f78b80b2cc0 2024-04-24T23:59:23.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.330+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b80b4be0 con 0x7f78b80b2cc0 2024-04-24T23:59:23.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.332+0000 7f78b4c00640 1 -- 172.21.15.96:0/2938170559 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78a000c6d0 con 0x7f78b80b2cc0 2024-04-24T23:59:23.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.332+0000 7f78b4c00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789406be30 0x7f789406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:23.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.333+0000 7f78b4c00640 1 -- 172.21.15.96:0/2938170559 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f78a008ac20 con 0x7f78b80b2cc0 2024-04-24T23:59:23.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.333+0000 7f78b7e00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789406be30 0x7f789406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:23.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.333+0000 7f78b7e00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789406be30 0x7f789406e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78a8007fd0 tx=0x7f78a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:23.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.337+0000 7f78b4c00640 1 -- 172.21.15.96:0/2938170559 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f78a0017020 con 0x7f78b80b2cc0 2024-04-24T23:59:23.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.565+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f78b806e610 con 0x7f78b80b2cc0 2024-04-24T23:59:23.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.566+0000 7f78b4c00640 1 -- 172.21.15.96:0/2938170559 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f78a00595d0 con 0x7f78b80b2cc0 2024-04-24T23:59:23.566 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:59:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.568+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789406be30 msgr2=0x7f789406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.568+0000 7f78bea00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789406be30 0x7f789406e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78a8007fd0 tx=0x7f78a8009040 comp rx=0 tx=0).stop 2024-04-24T23:59:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.568+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 msgr2=0x7f78b814e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.568+0000 7f78bea00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 0x7f78b814e7e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f78a000e7e0 tx=0x7f78a000eca0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.569+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 shutdown_connections 2024-04-24T23:59:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.569+0000 7f78bea00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b815b220 0x7f78b809d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.569+0000 7f78bea00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789406be30 0x7f789406e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.569+0000 7f78bea00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78b80b2cc0 0x7f78b814e7e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.569+0000 7f78bea00640 1 --2- 172.21.15.96:0/2938170559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b8070df0 0x7f78b81438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:23.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.569+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 >> 172.21.15.96:0/2938170559 conn(0x7f78b80b19c0 msgr2=0x7f78b80b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:23.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.569+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 shutdown_connections 2024-04-24T23:59:23.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23.569+0000 7f78bea00640 1 -- 172.21.15.96:0/2938170559 wait complete. 2024-04-24T23:59:23.586 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:59:23.586 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:59:23.587 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-04-24T23:59:23.587 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:59:23.587 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:59:23.587 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:59:23.587 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:59:23.587 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:59:23.587 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:59:23.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:23.587 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-04-24T23:59:23.633 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:23.634 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42522sec preferred_lft 42522sec 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 52:7e:61:df:15:52 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::5cd1:b8ff:fe39:23b3/64 scope link 2024-04-24T23:59:23.635 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:23.636 INFO:teuthology.orchestra.run.smithi096.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:59:23.636 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 52:7e:61:df:15:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:59:23.636 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::507e:61ff:fedf:1552/64 scope link 2024-04-24T23:59:23.636 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:23.636 INFO:teuthology.orchestra.run.smithi096.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:59:23.636 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether aa:45:1b:ae:1b:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:59:23.636 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::a845:1bff:feae:1bb7/64 scope link 2024-04-24T23:59:23.636 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:23.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:23.636 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:59:23.754 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-04-24T23:59:23.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:23.758 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-04-24T23:59:23.808 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-04-24T23:59:23.808 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:59:23.808 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:59:23.808 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:59:23.808 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:59:23.809 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:59:23.809 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-24T23:59:23.809 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:59:23.809 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:59:23.809 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:59:23.809 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-24T23:59:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:59:24.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:59:24.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:24.015 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-24T23:59:24.059 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:59:24.059 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:59:24.060 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:59:24.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:24.060 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2024-04-24T23:59:24.187 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:59:24.187 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:59:24.238 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:59:24.239 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:59:24.239 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:59:24.290 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-24T23:59:24.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:24.290 DEBUG:teuthology.orchestra.run.smithi096:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-24T23:59:24.416 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-24T23:59:24.416 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-24T23:59:24.416 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-04-24T23:59:24.438 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-24T23:59:24.438 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-24T23:59:24.438 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-04-24T23:59:24.438 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:59:24.438 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:59:24.464 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-24T23:59:24.464 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-24T23:59:24.464 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-04-24T23:59:24.464 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:59:24.464 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:59:24.464 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790" 2024-04-24T23:59:24.464 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2024-04-24T23:59:24.464 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c95ce1e9-7a69-4f8e-a964-bd4778092d3c" will pass to kernel 2024-04-24T23:59:24.466 INFO:teuthology.orchestra.run.smithi096.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:59:24.466 INFO:teuthology.orchestra.run.smithi096.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:59:24.466 INFO:teuthology.orchestra.run.smithi096.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:59:24.466 INFO:teuthology.orchestra.run.smithi096.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:59:24.466 INFO:teuthology.orchestra.run.smithi096.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:59:24.472 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:59:24.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:24.472 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:59:24.547 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:59:24.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:59:24.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:59:24.675 INFO:teuthology.orchestra.run.smithi096.stdout:client4759 2024-04-24T23:59:24.675 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:59:24.675 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:24.723 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:59:24.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.963+0000 7f14d1200640 1 Processor -- start 2024-04-24T23:59:24.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.963+0000 7f14d1200640 1 -- start start 2024-04-24T23:59:24.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.964+0000 7f14d1200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f14cc070df0 0x7f14cc15f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:24.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.964+0000 7f14d1200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f14cc0b2cc0 0x7f14cc0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:24.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.964+0000 7f14d1200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc0713d0 con 0x7f14cc15b220 2024-04-24T23:59:24.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.964+0000 7f14d1200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f14cc0aee00 con 0x7f14cc0b2cc0 2024-04-24T23:59:24.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.964+0000 7f14d1200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f14cc0ae4d0 con 0x7f14cc070df0 2024-04-24T23:59:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14c9e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f14cc15b220 0x7f14cc15ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:56016/0 (socket says 172.21.15.96:56016) 2024-04-24T23:59:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14c9e00640 1 -- 172.21.15.96:0/922803220 learned_addr learned my addr 172.21.15.96:0/922803220 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14ca800640 1 --2- 172.21.15.96:0/922803220 >> v2:172.21.15.96:3300/0 conn(0x7f14cc0b2cc0 0x7f14cc0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14c9400640 1 --2- 172.21.15.96:0/922803220 >> v2:172.21.15.155:3300/0 conn(0x7f14cc070df0 0x7f14cc15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14c8a00640 1 -- 172.21.15.96:0/922803220 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007898295 0 0) 0x7f14cc0713d0 con 0x7f14cc15b220 2024-04-24T23:59:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14c8a00640 1 -- 172.21.15.96:0/922803220 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14b0003520 con 0x7f14cc15b220 2024-04-24T23:59:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14ca800640 1 -- 172.21.15.96:0/922803220 >> v2:172.21.15.155:3300/0 conn(0x7f14cc070df0 msgr2=0x7f14cc15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14ca800640 1 --2- 172.21.15.96:0/922803220 >> v2:172.21.15.155:3300/0 conn(0x7f14cc070df0 0x7f14cc15f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14ca800640 1 -- 172.21.15.96:0/922803220 >> v1:172.21.15.96:6789/0 conn(0x7f14cc15b220 legacy=0x7f14cc15ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:24.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.965+0000 7f14ca800640 1 -- 172.21.15.96:0/922803220 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc0ae7b0 con 0x7f14cc0b2cc0 2024-04-24T23:59:24.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.966+0000 7f14ca800640 1 --2- 172.21.15.96:0/922803220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc0b2cc0 0x7f14cc0b3110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f14cc15ebd0 tx=0x7f14c402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70d6cebe8a19ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:24.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14c8a00640 1 -- 172.21.15.96:0/922803220 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4007740 con 0x7f14cc0b2cc0 2024-04-24T23:59:24.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14c8a00640 1 -- 172.21.15.96:0/922803220 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c40078e0 con 0x7f14cc0b2cc0 2024-04-24T23:59:24.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14c8a00640 1 -- 172.21.15.96:0/922803220 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4007cb0 con 0x7f14cc0b2cc0 2024-04-24T23:59:24.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14d1200640 1 -- 172.21.15.96:0/922803220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc0b2cc0 msgr2=0x7f14cc0b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:24.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14d1200640 1 --2- 172.21.15.96:0/922803220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc0b2cc0 0x7f14cc0b3110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f14cc15ebd0 tx=0x7f14c402a680 comp rx=0 tx=0).stop 2024-04-24T23:59:24.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14d1200640 1 -- 172.21.15.96:0/922803220 shutdown_connections 2024-04-24T23:59:24.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14d1200640 1 --2- 172.21.15.96:0/922803220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc0b2cc0 0x7f14cc0b3110 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14d1200640 1 --2- 172.21.15.96:0/922803220 >> v2:172.21.15.155:3300/0 conn(0x7f14cc070df0 0x7f14cc15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14d1200640 1 -- 172.21.15.96:0/922803220 >> 172.21.15.96:0/922803220 conn(0x7f14cc0b19c0 msgr2=0x7f14cc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.967+0000 7f14d1200640 1 -- 172.21.15.96:0/922803220 shutdown_connections 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.968+0000 7f14d1200640 1 -- 172.21.15.96:0/922803220 wait complete. 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.969+0000 7f14d1200640 1 Processor -- start 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.969+0000 7f14d1200640 1 -- start start 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.970+0000 7f14d1200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14cc070df0 0x7f14cc142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.970+0000 7f14d1200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14cc0b2cc0 0x7f14cc1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.970+0000 7f14d1200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc15b220 0x7f14cc142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:24.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.970+0000 7f14d1200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc06ed10 con 0x7f14cc15b220 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.970+0000 7f14d1200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc06eb90 con 0x7f14cc070df0 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.970+0000 7f14d1200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc15f8c0 con 0x7f14cc0b2cc0 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.970+0000 7f14ca800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc15b220 0x7f14cc142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.970+0000 7f14ca800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc15b220 0x7f14cc142090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36120/0 (socket says 172.21.15.96:36120) 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.970+0000 7f14ca800640 1 -- 172.21.15.96:0/3323971712 learned_addr learned my addr 172.21.15.96:0/3323971712 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.971+0000 7f14ca800640 1 -- 172.21.15.96:0/3323971712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14cc0b2cc0 msgr2=0x7f14cc1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.971+0000 7f14ca800640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14cc0b2cc0 0x7f14cc1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.971+0000 7f14ca800640 1 -- 172.21.15.96:0/3323971712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14cc070df0 msgr2=0x7f14cc142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.971+0000 7f14ca800640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14cc070df0 0x7f14cc142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.971+0000 7f14ca800640 1 -- 172.21.15.96:0/3323971712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc158950 con 0x7f14cc15b220 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.971+0000 7f14ca800640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc15b220 0x7f14cc142090 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f14c402ac70 tx=0x7f14c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:24.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.971+0000 7f14c2000640 1 -- 172.21.15.96:0/3323971712 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c403f070 con 0x7f14cc15b220 2024-04-24T23:59:24.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.971+0000 7f14c2000640 1 -- 172.21.15.96:0/3323971712 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c4031bc0 con 0x7f14cc15b220 2024-04-24T23:59:24.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.971+0000 7f14c2000640 1 -- 172.21.15.96:0/3323971712 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4009450 con 0x7f14cc15b220 2024-04-24T23:59:24.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.972+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc158ed0 con 0x7f14cc15b220 2024-04-24T23:59:24.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.972+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14cc154120 con 0x7f14cc15b220 2024-04-24T23:59:24.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.973+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14cc069110 con 0x7f14cc15b220 2024-04-24T23:59:24.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.974+0000 7f14c2000640 1 -- 172.21.15.96:0/3323971712 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14c403b410 con 0x7f14cc15b220 2024-04-24T23:59:24.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.974+0000 7f14c2000640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14ac06be30 0x7f14ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:24.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.975+0000 7f14c2000640 1 -- 172.21.15.96:0/3323971712 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f14c40ac630 con 0x7f14cc15b220 2024-04-24T23:59:24.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.975+0000 7f14c9e00640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14ac06be30 0x7f14ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:24.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.975+0000 7f14c9e00640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14ac06be30 0x7f14ac06e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14bc000f60 tx=0x7f14bc0078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:24.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:24.979+0000 7f14c2000640 1 -- 172.21.15.96:0/3323971712 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f14c407aeb0 con 0x7f14cc15b220 2024-04-24T23:59:25.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.215+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f14cc06cd90 con 0x7f14cc15b220 2024-04-24T23:59:25.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.216+0000 7f14c2000640 1 -- 172.21.15.96:0/3323971712 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f14c407a7b0 con 0x7f14cc15b220 2024-04-24T23:59:25.217 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:59:25.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14ac06be30 msgr2=0x7f14ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:25.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14ac06be30 0x7f14ac06e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14bc000f60 tx=0x7f14bc0078f0 comp rx=0 tx=0).stop 2024-04-24T23:59:25.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc15b220 msgr2=0x7f14cc142090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:25.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc15b220 0x7f14cc142090 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f14c402ac70 tx=0x7f14c4004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:25.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 shutdown_connections 2024-04-24T23:59:25.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f14ac06be30 0x7f14ac06e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:25.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14cc15b220 0x7f14cc142090 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:25.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14cc0b2cc0 0x7f14cc1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:25.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 --2- 172.21.15.96:0/3323971712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14cc070df0 0x7f14cc142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:25.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 >> 172.21.15.96:0/3323971712 conn(0x7f14cc0b19c0 msgr2=0x7f14cc0b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:25.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 shutdown_connections 2024-04-24T23:59:25.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:25.219+0000 7f14d1200640 1 -- 172.21.15.96:0/3323971712 wait complete. 2024-04-24T23:59:25.239 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:59:25.239 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:59:25.239 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-04-24T23:59:25.239 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-24T23:59:25.239 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-24T23:59:25.239 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:59:25.239 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:59:25.240 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:59:25.240 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-24T23:59:25.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:25.240 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-04-24T23:59:25.298 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:25.299 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42536sec preferred_lft 42536sec 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether a6:8e:d5:37:67:cc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::1888:7bff:fef8:7636/64 scope link 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether ca:04:72:29:52:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:59:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c804:72ff:fe29:5270/64 scope link 2024-04-24T23:59:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:25.301 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:59:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether a6:8e:d5:37:67:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-24T23:59:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::a48e:d5ff:fe37:67cc/64 scope link 2024-04-24T23:59:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:59:25.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:25.302 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:59:25.385 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-24T23:59:25.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:25.389 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-04-24T23:59:25.441 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-04-24T23:59:25.441 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:59:25.441 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:59:25.441 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:59:25.441 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:59:25.442 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:59:25.442 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-24T23:59:25.442 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:59:25.442 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:59:25.442 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:59:25.442 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-24T23:59:25.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:59:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:59:25.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:59:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:59:25.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:25.654 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-24T23:59:25.702 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-24T23:59:25.703 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-24T23:59:25.704 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-24T23:59:25.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:25.704 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-04-24T23:59:25.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:59:25.787 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-24T23:59:25.838 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-24T23:59:25.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:59:25.839 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-24T23:59:25.888 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-24T23:59:25.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:25.888 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-24T23:59:26.012 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-24T23:59:26.122 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-24T23:59:26.122 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2024-04-24T23:59:26.123 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-24T23:59:26.123 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790" 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.96:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c95ce1e9-7a69-4f8e-a964-bd4778092d3c" will pass to kernel 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:59:26.124 INFO:teuthology.orchestra.run.smithi155.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:59:26.125 INFO:teuthology.orchestra.run.smithi155.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:59:26.125 INFO:teuthology.orchestra.run.smithi155.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:59:26.125 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:59:26.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:26.125 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-24T23:59:26.210 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:59:26.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:59:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:59:26.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-24T23:59:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:59:26.330 INFO:teuthology.orchestra.run.smithi155.stdout:client5301 2024-04-24T23:59:26.331 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:59:26.331 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:26.383 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-24T23:59:26.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.598+0000 7fa712800640 1 Processor -- start 2024-04-24T23:59:26.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.599+0000 7fa712800640 1 -- start start 2024-04-24T23:59:26.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.600+0000 7fa712800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c1619e0 0x7fa70c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:26.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.600+0000 7fa712800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa70c0b6fa0 0x7fa70c0d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:26.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.600+0000 7fa712800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa70c161dc0 con 0x7fa70c0d0990 2024-04-24T23:59:26.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.600+0000 7fa712800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa70c0d28d0 con 0x7fa70c0b6fa0 2024-04-24T23:59:26.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.600+0000 7fa712800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa70c0d2bb0 con 0x7fa70c1619e0 2024-04-24T23:59:26.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.600+0000 7fa711e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa70c0d0990 0x7fa70c0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:56022/0 (socket says 172.21.15.96:56022) 2024-04-24T23:59:26.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.600+0000 7fa711e00640 1 -- 172.21.15.96:0/2538503916 learned_addr learned my addr 172.21.15.96:0/2538503916 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:26.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa710a00640 1 --2- 172.21.15.96:0/2538503916 >> v2:172.21.15.155:3300/0 conn(0x7fa70c0b6fa0 0x7fa70c0d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:26.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa711400640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c1619e0 0x7fa70c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:26.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3643770757 0 0) 0x7fa70c161dc0 con 0x7fa70c0d0990 2024-04-24T23:59:26.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6f4003520 con 0x7fa70c0d0990 2024-04-24T23:59:26.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 214026299 0 0) 0x7fa6f4003520 con 0x7fa70c0d0990 2024-04-24T23:59:26.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c1619e0 msgr2=0x7fa70c0b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c1619e0 0x7fa70c0b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 >> v2:172.21.15.155:3300/0 conn(0x7fa70c0b6fa0 msgr2=0x7fa70c0d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 --2- 172.21.15.96:0/2538503916 >> v2:172.21.15.155:3300/0 conn(0x7fa70c0b6fa0 0x7fa70c0d4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70c0d2e90 con 0x7fa70c0d0990 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fa704001670 con 0x7fa70c0d0990 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.601+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 >> v1:172.21.15.96:6789/0 conn(0x7fa70c0d0990 legacy=0x7fa70c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa70be00640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f40039b0 0x7fa6f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa70be00640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c1619e0 0x7fa6f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa70be00640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa6f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c0d28d0 con 0x7fa6f4004d40 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c0d2bb0 con 0x7fa6f40039b0 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f400b9c0 con 0x7fa70c1619e0 2024-04-24T23:59:26.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa711e00640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa6f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:26.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa711e00640 1 -- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c1619e0 msgr2=0x7fa6f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:26.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa710a00640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c1619e0 0x7fa6f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:26.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa711400640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f40039b0 0x7fa6f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:26.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa711e00640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c1619e0 0x7fa6f4004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:26.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa711e00640 1 -- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f40039b0 msgr2=0x7fa6f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:26.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa711e00640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f40039b0 0x7fa6f4003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:26.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.602+0000 7fa711e00640 1 -- 172.21.15.96:0/2538503916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f4003520 con 0x7fa6f4004d40 2024-04-24T23:59:26.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.603+0000 7fa711e00640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa6f40051c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa70400c240 tx=0x7fa6f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d472a3d2152087 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:26.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704007d50 con 0x7fa6f4004d40 2024-04-24T23:59:26.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa70402e070 con 0x7fa6f4004d40 2024-04-24T23:59:26.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa70be00640 1 -- 172.21.15.96:0/2538503916 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704005d30 con 0x7fa6f4004d40 2024-04-24T23:59:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa712800640 1 -- 172.21.15.96:0/2538503916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 msgr2=0x7fa6f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa712800640 1 --2- 172.21.15.96:0/2538503916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa6f40051c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa70400c240 tx=0x7fa6f4005830 comp rx=0 tx=0).stop 2024-04-24T23:59:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa711e00640 1 -- 172.21.15.96:0/2538503916 reap_dead start 2024-04-24T23:59:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa712800640 1 -- 172.21.15.96:0/2538503916 shutdown_connections 2024-04-24T23:59:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa712800640 1 -- 172.21.15.96:0/2538503916 >> 172.21.15.96:0/2538503916 conn(0x7fa70c09d420 msgr2=0x7fa70c0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa712800640 1 -- 172.21.15.96:0/2538503916 shutdown_connections 2024-04-24T23:59:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.604+0000 7fa712800640 1 -- 172.21.15.96:0/2538503916 wait complete. 2024-04-24T23:59:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.606+0000 7fa712800640 1 Processor -- start 2024-04-24T23:59:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.606+0000 7fa712800640 1 -- start start 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.607+0000 7fa712800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa70c15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.607+0000 7fa712800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c0c8670 0x7fa70c155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.607+0000 7fa712800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa70c0cb640 0x7fa70c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.607+0000 7fa712800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c0b4f60 con 0x7fa6f4004d40 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.607+0000 7fa712800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c0cec60 con 0x7fa70c0cb640 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.607+0000 7fa712800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa70c0b50e0 con 0x7fa70c0c8670 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.607+0000 7fa711400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa70c15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.607+0000 7fa711400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa70c15a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36140/0 (socket says 172.21.15.96:36140) 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.607+0000 7fa711400640 1 -- 172.21.15.96:0/2738620830 learned_addr learned my addr 172.21.15.96:0/2738620830 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:26.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa711400640 1 -- 172.21.15.96:0/2738620830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c0c8670 msgr2=0x7fa70c155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa711400640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c0c8670 0x7fa70c155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa711400640 1 -- 172.21.15.96:0/2738620830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa70c0cb640 msgr2=0x7fa70c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa711400640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa70c0cb640 0x7fa70c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa711400640 1 -- 172.21.15.96:0/2738620830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70c0c8bc0 con 0x7fa6f4004d40 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa711400640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa70c15a4b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa700007e60 tx=0x7fa70000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa709600640 1 -- 172.21.15.96:0/2738620830 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700018020 con 0x7fa6f4004d40 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa709600640 1 -- 172.21.15.96:0/2738620830 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7000145f0 con 0x7fa6f4004d40 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa709600640 1 -- 172.21.15.96:0/2738620830 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7000149c0 con 0x7fa6f4004d40 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.608+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa70c0c8ea0 con 0x7fa6f4004d40 2024-04-24T23:59:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.609+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa70c0c9460 con 0x7fa6f4004d40 2024-04-24T23:59:26.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.610+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa70c0756b0 con 0x7fa6f4004d40 2024-04-24T23:59:26.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.611+0000 7fa709600640 1 -- 172.21.15.96:0/2738620830 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa70001b020 con 0x7fa6f4004d40 2024-04-24T23:59:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.612+0000 7fa709600640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa6ec06be60 0x7fa6ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.612+0000 7fa709600640 1 -- 172.21.15.96:0/2738620830 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa70008b9f0 con 0x7fa6f4004d40 2024-04-24T23:59:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.612+0000 7fa710a00640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa6ec06be60 0x7fa6ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.613+0000 7fa710a00640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa6ec06be60 0x7fa6ec06e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0cdeb0 tx=0x7fa6f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:26.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.617+0000 7fa709600640 1 -- 172.21.15.96:0/2738620830 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa700022020 con 0x7fa6f4004d40 2024-04-24T23:59:26.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:26.859+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fa70c0d1700 con 0x7fa6f4004d40 2024-04-24T23:59:27.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.015+0000 7fa709600640 1 -- 172.21.15.96:0/2738620830 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) ==== 136+0+0 (secure 0 0 0) 0x7fa70005a300 con 0x7fa6f4004d40 2024-04-24T23:59:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.018+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa6ec06be60 msgr2=0x7fa6ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.018+0000 7fa712800640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa6ec06be60 0x7fa6ec06e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0cdeb0 tx=0x7fa6f8008040 comp rx=0 tx=0).stop 2024-04-24T23:59:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.018+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 msgr2=0x7fa70c15a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.018+0000 7fa712800640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa70c15a4b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa700007e60 tx=0x7fa70000f520 comp rx=0 tx=0).stop 2024-04-24T23:59:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.019+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 shutdown_connections 2024-04-24T23:59:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.019+0000 7fa712800640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa70c0cb640 0x7fa70c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.019+0000 7fa712800640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa70c0c8670 0x7fa70c155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.019+0000 7fa712800640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fa6ec06be60 0x7fa6ec06e320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.019+0000 7fa712800640 1 --2- 172.21.15.96:0/2738620830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6f4004d40 0x7fa70c15a4b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.019+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 >> 172.21.15.96:0/2738620830 conn(0x7fa70c09d420 msgr2=0x7fa70c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:27.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.019+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 shutdown_connections 2024-04-24T23:59:27.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.019+0000 7fa712800640 1 -- 172.21.15.96:0/2738620830 wait complete. 2024-04-24T23:59:27.040 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-24T23:59:27.180 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:59:27.188 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:59:27.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.240+0000 7f603f400640 1 Processor -- start 2024-04-24T23:59:27.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.241+0000 7f603f400640 1 -- start start 2024-04-24T23:59:27.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.242+0000 7f603f400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f603815b220 0x7f6038070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.242+0000 7f603f400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f603815f800 0x7f60380b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.242+0000 7f603f400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60380713d0 con 0x7f603815ec70 2024-04-24T23:59:27.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.242+0000 7f603f400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f60380aee00 con 0x7f603815f800 2024-04-24T23:59:27.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.242+0000 7f603f400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f60380ae4d0 con 0x7f603815b220 2024-04-24T23:59:27.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.242+0000 7f6037e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f603815ec70 0x7f603815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32790/0 (socket says 172.21.15.96:32790) 2024-04-24T23:59:27.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.242+0000 7f6037e00640 1 -- 172.21.15.96:0/691199226 learned_addr learned my addr 172.21.15.96:0/691199226 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:27.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.243+0000 7f603d400640 1 --2- 172.21.15.96:0/691199226 >> v2:172.21.15.96:3300/0 conn(0x7f603815f800 0x7f60380b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.243+0000 7f603ca00640 1 --2- 172.21.15.96:0/691199226 >> v2:172.21.15.155:3300/0 conn(0x7f603815b220 0x7f6038070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.243+0000 7f6037400640 1 -- 172.21.15.96:0/691199226 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2361257721 0 0) 0x7f60380713d0 con 0x7f603815ec70 2024-04-24T23:59:27.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.243+0000 7f6037400640 1 -- 172.21.15.96:0/691199226 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6020003520 con 0x7f603815ec70 2024-04-24T23:59:27.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.243+0000 7f603d400640 1 -- 172.21.15.96:0/691199226 >> v2:172.21.15.155:3300/0 conn(0x7f603815b220 msgr2=0x7f6038070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:27.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.243+0000 7f603d400640 1 --2- 172.21.15.96:0/691199226 >> v2:172.21.15.155:3300/0 conn(0x7f603815b220 0x7f6038070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.243+0000 7f603d400640 1 -- 172.21.15.96:0/691199226 >> v1:172.21.15.96:6789/0 conn(0x7f603815ec70 legacy=0x7f603815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.243+0000 7f603d400640 1 -- 172.21.15.96:0/691199226 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60380ae7b0 con 0x7f603815f800 2024-04-24T23:59:27.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.244+0000 7f603d400640 1 --2- 172.21.15.96:0/691199226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815f800 0x7f60380b2cc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f60380b27d0 tx=0x7f603002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590fa21e3e7bda45 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:27.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f6037400640 1 -- 172.21.15.96:0/691199226 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030007740 con 0x7f603815f800 2024-04-24T23:59:27.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f6037400640 1 -- 172.21.15.96:0/691199226 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60300078e0 con 0x7f603815f800 2024-04-24T23:59:27.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f6037400640 1 -- 172.21.15.96:0/691199226 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030007cb0 con 0x7f603815f800 2024-04-24T23:59:27.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f603f400640 1 -- 172.21.15.96:0/691199226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815f800 msgr2=0x7f60380b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f603f400640 1 --2- 172.21.15.96:0/691199226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815f800 0x7f60380b2cc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f60380b27d0 tx=0x7f603002a680 comp rx=0 tx=0).stop 2024-04-24T23:59:27.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f603f400640 1 -- 172.21.15.96:0/691199226 shutdown_connections 2024-04-24T23:59:27.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f603f400640 1 --2- 172.21.15.96:0/691199226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815f800 0x7f60380b2cc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f603f400640 1 --2- 172.21.15.96:0/691199226 >> v2:172.21.15.155:3300/0 conn(0x7f603815b220 0x7f6038070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f603f400640 1 -- 172.21.15.96:0/691199226 >> 172.21.15.96:0/691199226 conn(0x7f60380b19c0 msgr2=0x7f60380b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:27.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.245+0000 7f603f400640 1 -- 172.21.15.96:0/691199226 shutdown_connections 2024-04-24T23:59:27.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.246+0000 7f603f400640 1 -- 172.21.15.96:0/691199226 wait complete. 2024-04-24T23:59:27.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.247+0000 7f603f400640 1 Processor -- start 2024-04-24T23:59:27.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.247+0000 7f603f400640 1 -- start start 2024-04-24T23:59:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.248+0000 7f603f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603815b220 0x7f603809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.248+0000 7f603f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815ec70 0x7f603815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.248+0000 7f603f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603815f800 0x7f60381572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.248+0000 7f603f400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f603806ed10 con 0x7f603815ec70 2024-04-24T23:59:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f603f400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f603806eb90 con 0x7f603815b220 2024-04-24T23:59:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f603f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60380b3200 con 0x7f603815f800 2024-04-24T23:59:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f6037e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815ec70 0x7f603815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f6037e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815ec70 0x7f603815d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59984/0 (socket says 172.21.15.96:59984) 2024-04-24T23:59:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f6037e00640 1 -- 172.21.15.96:0/2020451797 learned_addr learned my addr 172.21.15.96:0/2020451797 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f603ca00640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603815b220 0x7f603809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f603d400640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603815f800 0x7f60381572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f6037e00640 1 -- 172.21.15.96:0/2020451797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603815f800 msgr2=0x7f60381572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f6037e00640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603815f800 0x7f60381572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f6037e00640 1 -- 172.21.15.96:0/2020451797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603815b220 msgr2=0x7f603809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f6037e00640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603815b220 0x7f603809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f6037e00640 1 -- 172.21.15.96:0/2020451797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603815d740 con 0x7f603815ec70 2024-04-24T23:59:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.249+0000 7f603ca00640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603815b220 0x7f603809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:27.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.250+0000 7f6037e00640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815ec70 0x7f603815d200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f602400c460 tx=0x7f602400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:27.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.250+0000 7f6034c00640 1 -- 172.21.15.96:0/2020451797 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024017070 con 0x7f603815ec70 2024-04-24T23:59:27.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.250+0000 7f6034c00640 1 -- 172.21.15.96:0/2020451797 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6024005ce0 con 0x7f603815ec70 2024-04-24T23:59:27.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.250+0000 7f6034c00640 1 -- 172.21.15.96:0/2020451797 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024007290 con 0x7f603815ec70 2024-04-24T23:59:27.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.250+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603809b0c0 con 0x7f603815ec70 2024-04-24T23:59:27.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.250+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f603809b680 con 0x7f603815ec70 2024-04-24T23:59:27.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.251+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603809bc90 con 0x7f603815ec70 2024-04-24T23:59:27.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.253+0000 7f6034c00640 1 -- 172.21.15.96:0/2020451797 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f602401a070 con 0x7f603815ec70 2024-04-24T23:59:27.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.254+0000 7f6034c00640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f601806be30 0x7f601806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.254+0000 7f6034c00640 1 -- 172.21.15.96:0/2020451797 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f602408a260 con 0x7f603815ec70 2024-04-24T23:59:27.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.254+0000 7f603ca00640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f601806be30 0x7f601806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.255+0000 7f603ca00640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f601806be30 0x7f601806e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f602c009b90 tx=0x7f602c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:27.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.258+0000 7f6034c00640 1 -- 172.21.15.96:0/2020451797 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6024058b70 con 0x7f603815ec70 2024-04-24T23:59:27.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.480+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f6038069110 con 0x7f601806be30 2024-04-24T23:59:27.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.483+0000 7f6034c00640 1 -- 172.21.15.96:0/2020451797 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f6038069110 con 0x7f601806be30 2024-04-24T23:59:27.483 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-04-24T23:59:27.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:27.483 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cephfs" 2024-04-24T23:59:27.483 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:27.483 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-04-24T23:59:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f601806be30 msgr2=0x7f601806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f601806be30 0x7f601806e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f602c009b90 tx=0x7f602c008040 comp rx=0 tx=0).stop 2024-04-24T23:59:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815ec70 msgr2=0x7f603815d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815ec70 0x7f603815d200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f602400c460 tx=0x7f602400c920 comp rx=0 tx=0).stop 2024-04-24T23:59:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 shutdown_connections 2024-04-24T23:59:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603815f800 0x7f60381572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f601806be30 0x7f601806e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f603815ec70 0x7f603815d200 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 --2- 172.21.15.96:0/2020451797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603815b220 0x7f603809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.485+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 >> 172.21.15.96:0/2020451797 conn(0x7f60380b19c0 msgr2=0x7f603815f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:27.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.486+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 shutdown_connections 2024-04-24T23:59:27.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.486+0000 7f603f400640 1 -- 172.21.15.96:0/2020451797 wait complete. 2024-04-24T23:59:27.505 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-24T23:59:27.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.709+0000 7f2696800640 1 Processor -- start 2024-04-24T23:59:27.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.709+0000 7f2696800640 1 -- start start 2024-04-24T23:59:27.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.711+0000 7f2696800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f269015b350 0x7f269006e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.711+0000 7f2696800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f269006ea70 0x7f26900b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.711+0000 7f2696800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26900b38a0 con 0x7f269015af70 2024-04-24T23:59:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.711+0000 7f2696800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f26900b3e60 con 0x7f269015b350 2024-04-24T23:59:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.711+0000 7f2696800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2690071ce0 con 0x7f269006ea70 2024-04-24T23:59:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.711+0000 7f268ea00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f269015b350 0x7f269006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.711+0000 7f268ea00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f269015b350 0x7f269006e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59992/0 (socket says 172.21.15.96:59992) 2024-04-24T23:59:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.711+0000 7f268ea00640 1 -- 172.21.15.96:0/1568947223 learned_addr learned my addr 172.21.15.96:0/1568947223 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.712+0000 7f268ea00640 1 -- 172.21.15.96:0/1568947223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f269006ea70 msgr2=0x7f26900b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.712+0000 7f268ea00640 1 --2- 172.21.15.96:0/1568947223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f269006ea70 0x7f26900b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.712+0000 7f268ea00640 1 -- 172.21.15.96:0/1568947223 >> v1:172.21.15.155:6789/0 conn(0x7f269015af70 legacy=0x7f2690072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.712+0000 7f268ea00640 1 -- 172.21.15.96:0/1568947223 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26900b3b80 con 0x7f269015b350 2024-04-24T23:59:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.713+0000 7f268ea00640 1 --2- 172.21.15.96:0/1568947223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015b350 0x7f269006e530 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f267800d150 tx=0x7f267802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76388ddb1cf1d3d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.713+0000 7f268e000640 1 -- 172.21.15.96:0/1568947223 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267800b2e0 con 0x7f269015b350 2024-04-24T23:59:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.713+0000 7f268e000640 1 -- 172.21.15.96:0/1568947223 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2678009600 con 0x7f269015b350 2024-04-24T23:59:27.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.713+0000 7f268e000640 1 -- 172.21.15.96:0/1568947223 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267800b480 con 0x7f269015b350 2024-04-24T23:59:27.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.714+0000 7f2696800640 1 -- 172.21.15.96:0/1568947223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015b350 msgr2=0x7f269006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.714+0000 7f2696800640 1 --2- 172.21.15.96:0/1568947223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015b350 0x7f269006e530 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f267800d150 tx=0x7f267802c8e0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.714+0000 7f2696800640 1 -- 172.21.15.96:0/1568947223 shutdown_connections 2024-04-24T23:59:27.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.714+0000 7f2696800640 1 --2- 172.21.15.96:0/1568947223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f269006ea70 0x7f26900b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.714+0000 7f2696800640 1 --2- 172.21.15.96:0/1568947223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015b350 0x7f269006e530 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.714+0000 7f2696800640 1 -- 172.21.15.96:0/1568947223 >> 172.21.15.96:0/1568947223 conn(0x7f26900b19c0 msgr2=0x7f26900b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:27.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.714+0000 7f2696800640 1 -- 172.21.15.96:0/1568947223 shutdown_connections 2024-04-24T23:59:27.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.714+0000 7f2696800640 1 -- 172.21.15.96:0/1568947223 wait complete. 2024-04-24T23:59:27.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.716+0000 7f2696800640 1 Processor -- start 2024-04-24T23:59:27.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.716+0000 7f2696800640 1 -- start start 2024-04-24T23:59:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.717+0000 7f2696800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269006ea70 0x7f2690159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.717+0000 7f2696800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015af70 0x7f269014b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.717+0000 7f2696800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f269015b350 0x7f2690153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.717+0000 7f2696800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2690072a00 con 0x7f269015af70 2024-04-24T23:59:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.717+0000 7f2696800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2690072880 con 0x7f269006ea70 2024-04-24T23:59:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.717+0000 7f2696800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f26900b3200 con 0x7f269015b350 2024-04-24T23:59:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.717+0000 7f268ea00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015af70 0x7f269014b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.717+0000 7f268ea00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015af70 0x7f269014b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60008/0 (socket says 172.21.15.96:60008) 2024-04-24T23:59:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.717+0000 7f268ea00640 1 -- 172.21.15.96:0/828637555 learned_addr learned my addr 172.21.15.96:0/828637555 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.718+0000 7f268ea00640 1 -- 172.21.15.96:0/828637555 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f269015b350 msgr2=0x7f2690153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.718+0000 7f268ea00640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f269015b350 0x7f2690153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.718+0000 7f268ea00640 1 -- 172.21.15.96:0/828637555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269006ea70 msgr2=0x7f2690159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.718+0000 7f268f400640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269006ea70 0x7f2690159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.718+0000 7f268ea00640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269006ea70 0x7f2690159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.718+0000 7f268ea00640 1 -- 172.21.15.96:0/828637555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269015a760 con 0x7f269015af70 2024-04-24T23:59:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.718+0000 7f268ea00640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015af70 0x7f269014b670 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f267802ced0 tx=0x7f2678004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.718+0000 7f2687400640 1 -- 172.21.15.96:0/828637555 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2678041030 con 0x7f269015af70 2024-04-24T23:59:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.718+0000 7f2687400640 1 -- 172.21.15.96:0/828637555 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267803d650 con 0x7f269015af70 2024-04-24T23:59:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.719+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2690159ec0 con 0x7f269015af70 2024-04-24T23:59:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.719+0000 7f2687400640 1 -- 172.21.15.96:0/828637555 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267803da40 con 0x7f269015af70 2024-04-24T23:59:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.719+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269015a480 con 0x7f269015af70 2024-04-24T23:59:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.720+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26900726a0 con 0x7f269015af70 2024-04-24T23:59:27.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.721+0000 7f2687400640 1 -- 172.21.15.96:0/828637555 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2678044030 con 0x7f269015af70 2024-04-24T23:59:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.722+0000 7f2687400640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f266c06be30 0x7f266c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.722+0000 7f2687400640 1 -- 172.21.15.96:0/828637555 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f2678030020 con 0x7f269015af70 2024-04-24T23:59:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.722+0000 7f268f400640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f266c06be30 0x7f266c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.723+0000 7f268f400640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f266c06be30 0x7f266c06e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2690156e70 tx=0x7f2680009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.727+0000 7f2687400640 1 -- 172.21.15.96:0/828637555 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f26900726a0 con 0x7f269015af70 2024-04-24T23:59:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.926+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2690075750 con 0x7f269015af70 2024-04-24T23:59:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.927+0000 7f2687400640 1 -- 172.21.15.96:0/828637555 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f267804b030 con 0x7f269015af70 2024-04-24T23:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.930+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f266c06be30 msgr2=0x7f266c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.930+0000 7f2696800640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f266c06be30 0x7f266c06e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2690156e70 tx=0x7f2680009040 comp rx=0 tx=0).stop 2024-04-24T23:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.930+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015af70 msgr2=0x7f269014b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.930+0000 7f2696800640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015af70 0x7f269014b670 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f267802ced0 tx=0x7f2678004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.931+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 shutdown_connections 2024-04-24T23:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.931+0000 7f2696800640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f269015b350 0x7f2690153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.931+0000 7f2696800640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f266c06be30 0x7f266c06e2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.931+0000 7f2696800640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f269015af70 0x7f269014b670 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.931+0000 7f2696800640 1 --2- 172.21.15.96:0/828637555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269006ea70 0x7f2690159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.931+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 >> 172.21.15.96:0/828637555 conn(0x7f26900b19c0 msgr2=0x7f269006d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.931+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 shutdown_connections 2024-04-24T23:59:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:27.931+0000 7f2696800640 1 -- 172.21.15.96:0/828637555 wait complete. 2024-04-24T23:59:27.950 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp74280 2024-04-24T23:59:28.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.156+0000 7f689fe00640 1 Processor -- start 2024-04-24T23:59:28.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.156+0000 7f689fe00640 1 -- start start 2024-04-24T23:59:28.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.158+0000 7f689fe00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68a015cfe0 0x7f68a00cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.158+0000 7f689fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a01415d0 0x7f68a0141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.158+0000 7f689fe00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a00ce620 con 0x7f68a013ef60 2024-04-24T23:59:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.158+0000 7f689fe00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f68a00ce900 con 0x7f68a015cfe0 2024-04-24T23:59:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.158+0000 7f689fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f68a00cebe0 con 0x7f68a01415d0 2024-04-24T23:59:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.158+0000 7f689ea00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f68a013ef60 0x7f68a00cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32800/0 (socket says 172.21.15.96:32800) 2024-04-24T23:59:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689ea00640 1 -- 172.21.15.96:0/1309155674 learned_addr learned my addr 172.21.15.96:0/1309155674 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462099430 0 0) 0x7f68a00ce620 con 0x7f68a013ef60 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6884003520 con 0x7f68a013ef60 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689f400640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a01415d0 0x7f68a0141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f6897e00640 1 --2- 172.21.15.96:0/1309155674 >> v2:172.21.15.155:3300/0 conn(0x7f68a015cfe0 0x7f68a00cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1532143985 0 0) 0x7f6884003520 con 0x7f68a013ef60 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a01415d0 msgr2=0x7f68a0141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689e000640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a01415d0 0x7f68a0141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 >> v2:172.21.15.155:3300/0 conn(0x7f68a015cfe0 msgr2=0x7f68a00cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689e000640 1 --2- 172.21.15.96:0/1309155674 >> v2:172.21.15.155:3300/0 conn(0x7f68a015cfe0 0x7f68a00cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.159+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a00ccb10 con 0x7f68a013ef60 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f6890001670 con 0x7f68a013ef60 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689f400640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a01415d0 0x7f68a0141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 >> v1:172.21.15.96:6789/0 conn(0x7f68a013ef60 legacy=0x7f68a00cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689e000640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840039b0 0x7f6884003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689e000640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6884004800 0x7f6884004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689e000640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a01415d0 0x7f68840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00ce900 con 0x7f68840039b0 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00cebe0 con 0x7f6884004800 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f688400ba40 con 0x7f68a01415d0 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.160+0000 7f689ea00640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840039b0 0x7f6884003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.161+0000 7f689ea00640 1 -- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a01415d0 msgr2=0x7f68840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:28.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.161+0000 7f689ea00640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68a01415d0 0x7f68840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.161+0000 7f689ea00640 1 -- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6884004800 msgr2=0x7f6884004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:28.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.161+0000 7f689ea00640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6884004800 0x7f6884004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.161+0000 7f689ea00640 1 -- 172.21.15.96:0/1309155674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6884003520 con 0x7f68840039b0 2024-04-24T23:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.162+0000 7f689ea00640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840039b0 0x7f6884003dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f689000c210 tx=0x7f6884005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9a09d5019195d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.162+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890007d50 con 0x7f68840039b0 2024-04-24T23:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.162+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6890005af0 con 0x7f68840039b0 2024-04-24T23:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.162+0000 7f689e000640 1 -- 172.21.15.96:0/1309155674 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890007070 con 0x7f68840039b0 2024-04-24T23:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.162+0000 7f689fe00640 1 -- 172.21.15.96:0/1309155674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840039b0 msgr2=0x7f6884003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.162+0000 7f689fe00640 1 --2- 172.21.15.96:0/1309155674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840039b0 0x7f6884003dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f689000c210 tx=0x7f6884005830 comp rx=0 tx=0).stop 2024-04-24T23:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.162+0000 7f689f400640 1 -- 172.21.15.96:0/1309155674 reap_dead start 2024-04-24T23:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.163+0000 7f689fe00640 1 -- 172.21.15.96:0/1309155674 shutdown_connections 2024-04-24T23:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.163+0000 7f689fe00640 1 -- 172.21.15.96:0/1309155674 >> 172.21.15.96:0/1309155674 conn(0x7f68a00b18b0 msgr2=0x7f68a00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:28.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.163+0000 7f689fe00640 1 -- 172.21.15.96:0/1309155674 shutdown_connections 2024-04-24T23:59:28.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.163+0000 7f689fe00640 1 -- 172.21.15.96:0/1309155674 wait complete. 2024-04-24T23:59:28.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.165+0000 7f689fe00640 1 Processor -- start 2024-04-24T23:59:28.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.165+0000 7f689fe00640 1 -- start start 2024-04-24T23:59:28.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.166+0000 7f689fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68840039b0 0x7f68a0153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.166+0000 7f689fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68a01544a0 0x7f68a00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.166+0000 7f689fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a013b820 0x7f68a00b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.166+0000 7f689fe00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f68a0141be0 con 0x7f68a013b820 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.166+0000 7f689fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68a0141a60 con 0x7f68a01544a0 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.166+0000 7f689fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f68a0141d60 con 0x7f68840039b0 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a013b820 0x7f68a00b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a013b820 0x7f68a00b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60022/0 (socket says 172.21.15.96:60022) 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689f400640 1 -- 172.21.15.96:0/692765245 learned_addr learned my addr 172.21.15.96:0/692765245 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689ea00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68840039b0 0x7f68a0153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f6897e00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68a01544a0 0x7f68a00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689f400640 1 -- 172.21.15.96:0/692765245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68840039b0 msgr2=0x7f68a0153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689f400640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68840039b0 0x7f68a0153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689f400640 1 -- 172.21.15.96:0/692765245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68a01544a0 msgr2=0x7f68a00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689f400640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68a01544a0 0x7f68a00afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689f400640 1 -- 172.21.15.96:0/692765245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a015adf0 con 0x7f68a013b820 2024-04-24T23:59:28.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689ea00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68840039b0 0x7f68a0153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:28.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.167+0000 7f689f400640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a013b820 0x7f68a00b0000 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f68a006eeb0 tx=0x7f689800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:28.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.168+0000 7f6896a00640 1 -- 172.21.15.96:0/692765245 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689801a070 con 0x7f68a013b820 2024-04-24T23:59:28.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.168+0000 7f6896a00640 1 -- 172.21.15.96:0/692765245 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689800ddb0 con 0x7f68a013b820 2024-04-24T23:59:28.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.168+0000 7f6896a00640 1 -- 172.21.15.96:0/692765245 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898003bd0 con 0x7f68a013b820 2024-04-24T23:59:28.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.168+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a015b0d0 con 0x7f68a013b820 2024-04-24T23:59:28.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.168+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a015b690 con 0x7f68a013b820 2024-04-24T23:59:28.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.169+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a00755d0 con 0x7f68a013b820 2024-04-24T23:59:28.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.171+0000 7f6896a00640 1 -- 172.21.15.96:0/692765245 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f689801d070 con 0x7f68a013b820 2024-04-24T23:59:28.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.171+0000 7f6896a00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f687c06be30 0x7f687c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.172+0000 7f6896a00640 1 -- 172.21.15.96:0/692765245 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f689808acb0 con 0x7f68a013b820 2024-04-24T23:59:28.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.172+0000 7f689ea00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f687c06be30 0x7f687c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.173+0000 7f689ea00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f687c06be30 0x7f687c06e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f689000c210 tx=0x7f6890009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:28.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.176+0000 7f6896a00640 1 -- 172.21.15.96:0/692765245 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6898010070 con 0x7f68a013b820 2024-04-24T23:59:28.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.404+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp74280", "target": ["mon-mgr", ""]}) -- 0x7f68a015c170 con 0x7f687c06be30 2024-04-24T23:59:28.412 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:28.412+0000 7fd166200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:28.413 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:28.412+0000 7fd166200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:28.413 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:28.412+0000 7fd166200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:28.413 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:28.412+0000 7fd166200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:28.413 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:28.412+0000 7fd166200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:28.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.439+0000 7f6896a00640 1 -- 172.21.15.96:0/692765245 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f68a015c170 con 0x7f687c06be30 2024-04-24T23:59:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f687c06be30 msgr2=0x7f687c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f687c06be30 0x7f687c06e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f689000c210 tx=0x7f6890009030 comp rx=0 tx=0).stop 2024-04-24T23:59:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a013b820 msgr2=0x7f68a00b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a013b820 0x7f68a00b0000 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f68a006eeb0 tx=0x7f689800d4a0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 shutdown_connections 2024-04-24T23:59:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f687c06be30 0x7f687c06e2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a013b820 0x7f68a00b0000 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68a01544a0 0x7f68a00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 --2- 172.21.15.96:0/692765245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68840039b0 0x7f68a0153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 >> 172.21.15.96:0/692765245 conn(0x7f68a00b18b0 msgr2=0x7f68a006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 shutdown_connections 2024-04-24T23:59:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.442+0000 7f689fe00640 1 -- 172.21.15.96:0/692765245 wait complete. 2024-04-24T23:59:28.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol55520 --group_name subvol_grp74280 2024-04-24T23:59:28.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.655+0000 7f8db2c00640 1 Processor -- start 2024-04-24T23:59:28.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.656+0000 7f8db2c00640 1 -- start start 2024-04-24T23:59:28.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.657+0000 7f8db2c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8dac0727f0 0x7f8dac15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.657+0000 7f8db2c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8dac15f220 0x7f8dac0ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.657+0000 7f8db2c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac072bd0 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.657+0000 7f8db2c00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f8dac15f680 con 0x7f8dac0727f0 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.657+0000 7f8db2c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8dac0b4a90 con 0x7f8dac15f220 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.658+0000 7f8dabe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8dac0727f0 0x7f8dac15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.658+0000 7f8dabe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8dac0727f0 0x7f8dac15ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60038/0 (socket says 172.21.15.96:60038) 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.658+0000 7f8dabe00640 1 -- 172.21.15.96:0/1620796385 learned_addr learned my addr 172.21.15.96:0/1620796385 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.658+0000 7f8da3e00640 1 --2- 172.21.15.96:0/1620796385 >> v2:172.21.15.155:3300/0 conn(0x7f8dac15f220 0x7f8dac0ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.658+0000 7f8dabe00640 1 -- 172.21.15.96:0/1620796385 >> v2:172.21.15.155:3300/0 conn(0x7f8dac15f220 msgr2=0x7f8dac0ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.658+0000 7f8dabe00640 1 --2- 172.21.15.96:0/1620796385 >> v2:172.21.15.155:3300/0 conn(0x7f8dac15f220 0x7f8dac0ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.658+0000 7f8dabe00640 1 -- 172.21.15.96:0/1620796385 >> v1:172.21.15.155:6789/0 conn(0x7f8dac0ae9e0 legacy=0x7f8dac154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.658+0000 7f8dabe00640 1 -- 172.21.15.96:0/1620796385 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac0af260 con 0x7f8dac0727f0 2024-04-24T23:59:28.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.658+0000 7f8da3e00640 1 --2- 172.21.15.96:0/1620796385 >> v2:172.21.15.155:3300/0 conn(0x7f8dac15f220 0x7f8dac0ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:28.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.659+0000 7f8dabe00640 1 --2- 172.21.15.96:0/1620796385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0727f0 0x7f8dac15ece0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0d0d00 tx=0x7f8d9c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d5098421750823 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.659+0000 7f8dab400640 1 -- 172.21.15.96:0/1620796385 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c037070 con 0x7f8dac0727f0 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.659+0000 7f8dab400640 1 -- 172.21.15.96:0/1620796385 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9c032440 con 0x7f8dac0727f0 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.660+0000 7f8dab400640 1 -- 172.21.15.96:0/1620796385 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c032810 con 0x7f8dac0727f0 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.660+0000 7f8db2c00640 1 -- 172.21.15.96:0/1620796385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0727f0 msgr2=0x7f8dac15ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.660+0000 7f8db2c00640 1 --2- 172.21.15.96:0/1620796385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0727f0 0x7f8dac15ece0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0d0d00 tx=0x7f8d9c02a230 comp rx=0 tx=0).stop 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.660+0000 7f8db2c00640 1 -- 172.21.15.96:0/1620796385 shutdown_connections 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.660+0000 7f8db2c00640 1 --2- 172.21.15.96:0/1620796385 >> v2:172.21.15.155:3300/0 conn(0x7f8dac15f220 0x7f8dac0ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.660+0000 7f8db2c00640 1 --2- 172.21.15.96:0/1620796385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0727f0 0x7f8dac15ece0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.660+0000 7f8db2c00640 1 -- 172.21.15.96:0/1620796385 >> 172.21.15.96:0/1620796385 conn(0x7f8dac0b19c0 msgr2=0x7f8dac0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.660+0000 7f8db2c00640 1 -- 172.21.15.96:0/1620796385 shutdown_connections 2024-04-24T23:59:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.661+0000 7f8db2c00640 1 -- 172.21.15.96:0/1620796385 wait complete. 2024-04-24T23:59:28.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.662+0000 7f8db2c00640 1 Processor -- start 2024-04-24T23:59:28.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.662+0000 7f8db2c00640 1 -- start start 2024-04-24T23:59:28.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.663+0000 7f8db2c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dac0727f0 0x7f8dac159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.663+0000 7f8db2c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0ae9e0 0x7f8dac15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.663+0000 7f8db2c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dac15f220 0x7f8dac0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.663+0000 7f8db2c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac0b3280 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.663+0000 7f8db2c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac0b2fa0 con 0x7f8dac0727f0 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.663+0000 7f8db2c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8dac0b3560 con 0x7f8dac15f220 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8da3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0ae9e0 0x7f8dac15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8da3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0ae9e0 0x7f8dac15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60040/0 (socket says 172.21.15.96:60040) 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8da3e00640 1 -- 172.21.15.96:0/406431637 learned_addr learned my addr 172.21.15.96:0/406431637 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8dabe00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dac0727f0 0x7f8dac159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8db0c00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dac15f220 0x7f8dac0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8da3e00640 1 -- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dac15f220 msgr2=0x7f8dac0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8da3e00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dac15f220 0x7f8dac0cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8da3e00640 1 -- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dac0727f0 msgr2=0x7f8dac159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8da3e00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dac0727f0 0x7f8dac159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8da3e00640 1 -- 172.21.15.96:0/406431637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac0cda50 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8dabe00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dac0727f0 0x7f8dac159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.664+0000 7f8db0c00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dac15f220 0x7f8dac0cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.665+0000 7f8da3e00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0ae9e0 0x7f8dac15af00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c820 tx=0x7f8d9400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.665+0000 7f8da8c00640 1 -- 172.21.15.96:0/406431637 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94015070 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.665+0000 7f8da8c00640 1 -- 172.21.15.96:0/406431637 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d94007a30 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.665+0000 7f8da8c00640 1 -- 172.21.15.96:0/406431637 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94007de0 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.665+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac1598b0 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.665+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dac159e70 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.666+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dac069110 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.667+0000 7f8da8c00640 1 -- 172.21.15.96:0/406431637 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d94018070 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.668+0000 7f8da8c00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8d8806be30 0x7f8d8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:28.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.669+0000 7f8da8c00640 1 -- 172.21.15.96:0/406431637 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8d9408add0 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.669+0000 7f8dabe00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8d8806be30 0x7f8d8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:28.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.670+0000 7f8dabe00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8d8806be30 0x7f8d8806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c034000 tx=0x7f8d9c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:28.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.673+0000 7f8da8c00640 1 -- 172.21.15.96:0/406431637 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8d940596e0 con 0x7f8dac0ae9e0 2024-04-24T23:59:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.899+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol55520", "group_name": "subvol_grp74280", "target": ["mon-mgr", ""]}) -- 0x7f8dac06ecb0 con 0x7f8d8806be30 2024-04-24T23:59:28.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.944+0000 7f8da8c00640 1 -- 172.21.15.96:0/406431637 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8dac06ecb0 con 0x7f8d8806be30 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.947+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8d8806be30 msgr2=0x7f8d8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.947+0000 7f8db2c00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8d8806be30 0x7f8d8806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c034000 tx=0x7f8d9c02e000 comp rx=0 tx=0).stop 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.947+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0ae9e0 msgr2=0x7f8dac15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.947+0000 7f8db2c00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0ae9e0 0x7f8dac15af00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c820 tx=0x7f8d9400cce0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.948+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 shutdown_connections 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.948+0000 7f8db2c00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dac15f220 0x7f8dac0cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.948+0000 7f8db2c00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8d8806be30 0x7f8d8806e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.948+0000 7f8db2c00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0ae9e0 0x7f8dac15af00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.948+0000 7f8db2c00640 1 --2- 172.21.15.96:0/406431637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dac0727f0 0x7f8dac159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.948+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 >> 172.21.15.96:0/406431637 conn(0x7f8dac0b19c0 msgr2=0x7f8dac070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:28.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.948+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 shutdown_connections 2024-04-24T23:59:28.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:28.948+0000 7f8db2c00640 1 -- 172.21.15.96:0/406431637 wait complete. 2024-04-24T23:59:28.967 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol96171 --group_name subvol_grp74280 2024-04-24T23:59:29.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.174+0000 7fe51ee00640 1 Processor -- start 2024-04-24T23:59:29.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.174+0000 7fe51ee00640 1 -- start start 2024-04-24T23:59:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.176+0000 7fe51ee00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe5180b2c50 0x7fe51815f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.176+0000 7fe51ee00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe51806ea10 con 0x7fe51815b1a0 2024-04-24T23:59:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.176+0000 7fe51ee00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5180cde50 con 0x7fe518070d80 2024-04-24T23:59:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.176+0000 7fe51ee00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe5180b30b0 con 0x7fe5180b2c50 2024-04-24T23:59:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe51da00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe51815b1a0 0x7fe51806e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32814/0 (socket says 172.21.15.96:32814) 2024-04-24T23:59:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe51da00640 1 -- 172.21.15.96:0/2786659898 learned_addr learned my addr 172.21.15.96:0/2786659898 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe51d000640 1 --2- 172.21.15.96:0/2786659898 >> v2:172.21.15.155:3300/0 conn(0x7fe5180b2c50 0x7fe51815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912770654 0 0) 0x7fe51806ea10 con 0x7fe51815b1a0 2024-04-24T23:59:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe500003520 con 0x7fe51815b1a0 2024-04-24T23:59:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3819531805 0 0) 0x7fe500003520 con 0x7fe51815b1a0 2024-04-24T23:59:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 >> v2:172.21.15.155:3300/0 conn(0x7fe5180b2c50 msgr2=0x7fe51815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe517e00640 1 --2- 172.21.15.96:0/2786659898 >> v2:172.21.15.155:3300/0 conn(0x7fe5180b2c50 0x7fe51815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 >> v1:172.21.15.155:6789/0 conn(0x7fe518070d80 legacy=0x7fe5180ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.177+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5180ce130 con 0x7fe51815b1a0 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fe50c001670 con 0x7fe51815b1a0 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 >> v1:172.21.15.96:6789/0 conn(0x7fe51815b1a0 legacy=0x7fe51806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe517e00640 1 --2- 172.21.15.96:0/2786659898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5000039b0 0x7fe500003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe517e00640 1 --2- 172.21.15.96:0/2786659898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe500004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe517e00640 1 --2- 172.21.15.96:0/2786659898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5000051c0 0x7fe50000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe50000c130 con 0x7fe500004800 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe50000c2e0 con 0x7fe5000039b0 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe50000c4e0 con 0x7fe5000051c0 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe51d000640 1 --2- 172.21.15.96:0/2786659898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe500004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe51d000640 1 -- 172.21.15.96:0/2786659898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5000051c0 msgr2=0x7fe50000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe51d000640 1 --2- 172.21.15.96:0/2786659898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5000051c0 0x7fe50000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe51d000640 1 -- 172.21.15.96:0/2786659898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5000039b0 msgr2=0x7fe500003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:29.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe51d000640 1 --2- 172.21.15.96:0/2786659898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5000039b0 0x7fe500003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe51d000640 1 -- 172.21.15.96:0/2786659898 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe500003520 con 0x7fe500004800 2024-04-24T23:59:29.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.178+0000 7fe51e400640 1 -- 172.21.15.96:0/2786659898 reap_dead start 2024-04-24T23:59:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.179+0000 7fe51d000640 1 --2- 172.21.15.96:0/2786659898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe500004c80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe504009ac0 tx=0x7fe500005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36112c046ab5675 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.180+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504036070 con 0x7fe500004800 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.180+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe504031400 con 0x7fe500004800 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.180+0000 7fe517e00640 1 -- 172.21.15.96:0/2786659898 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504009690 con 0x7fe500004800 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.180+0000 7fe51ee00640 1 -- 172.21.15.96:0/2786659898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 msgr2=0x7fe500004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.180+0000 7fe51ee00640 1 --2- 172.21.15.96:0/2786659898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe500004c80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe504009ac0 tx=0x7fe500005830 comp rx=0 tx=0).stop 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.180+0000 7fe51ee00640 1 -- 172.21.15.96:0/2786659898 shutdown_connections 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.180+0000 7fe51ee00640 1 --2- 172.21.15.96:0/2786659898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe500004c80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.180+0000 7fe51ee00640 1 -- 172.21.15.96:0/2786659898 >> 172.21.15.96:0/2786659898 conn(0x7fe5180b1f80 msgr2=0x7fe5180cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.181+0000 7fe51ee00640 1 -- 172.21.15.96:0/2786659898 shutdown_connections 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.181+0000 7fe51ee00640 1 -- 172.21.15.96:0/2786659898 wait complete. 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.182+0000 7fe51ee00640 1 Processor -- start 2024-04-24T23:59:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.182+0000 7fe51ee00640 1 -- start start 2024-04-24T23:59:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.183+0000 7fe51ee00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe51814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.183+0000 7fe51ee00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe51809aa70 0x7fe51809aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.183+0000 7fe51ee00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51809ccb0 0x7fe51809d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.183+0000 7fe51ee00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe51815f700 con 0x7fe500004800 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.183+0000 7fe51ee00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe5180cdc00 con 0x7fe51809ccb0 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.183+0000 7fe51ee00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe51815f880 con 0x7fe51809aa70 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51da00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe51814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51da00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe51814c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60054/0 (socket says 172.21.15.96:60054) 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51da00640 1 -- 172.21.15.96:0/153610399 learned_addr learned my addr 172.21.15.96:0/153610399 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51d000640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe51809aa70 0x7fe51809aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51e400640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51809ccb0 0x7fe51809d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51da00640 1 -- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe51809aa70 msgr2=0x7fe51809aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51da00640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe51809aa70 0x7fe51809aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51da00640 1 -- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51809ccb0 msgr2=0x7fe51809d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51da00640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51809ccb0 0x7fe51809d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51da00640 1 -- 172.21.15.96:0/153610399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51814ce20 con 0x7fe500004800 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51e400640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51809ccb0 0x7fe51809d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51d000640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe51809aa70 0x7fe51809aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.184+0000 7fe51da00640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe51814c8e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00c7a0 tx=0x7fe50c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.185+0000 7fe515600640 1 -- 172.21.15.96:0/153610399 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c018070 con 0x7fe500004800 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.185+0000 7fe515600640 1 -- 172.21.15.96:0/153610399 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe50c0074e0 con 0x7fe500004800 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.185+0000 7fe515600640 1 -- 172.21.15.96:0/153610399 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c004a20 con 0x7fe500004800 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.185+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe51815b580 con 0x7fe500004800 2024-04-24T23:59:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.185+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5180c9d60 con 0x7fe500004800 2024-04-24T23:59:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.186+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe518067e40 con 0x7fe500004800 2024-04-24T23:59:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.187+0000 7fe515600640 1 -- 172.21.15.96:0/153610399 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe50c004bc0 con 0x7fe500004800 2024-04-24T23:59:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.188+0000 7fe515600640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe4f806be60 0x7fe4f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.188+0000 7fe515600640 1 -- 172.21.15.96:0/153610399 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe50c08a3c0 con 0x7fe500004800 2024-04-24T23:59:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.188+0000 7fe51d000640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe4f806be60 0x7fe4f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.189+0000 7fe51d000640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe4f806be60 0x7fe4f806e320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe504033000 tx=0x7fe504008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.192+0000 7fe515600640 1 -- 172.21.15.96:0/153610399 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe50c058cd0 con 0x7fe500004800 2024-04-24T23:59:29.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.417+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol96171", "group_name": "subvol_grp74280", "target": ["mon-mgr", ""]}) -- 0x7fe5180d0980 con 0x7fe4f806be60 2024-04-24T23:59:29.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.458+0000 7fe515600640 1 -- 172.21.15.96:0/153610399 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe5180d0980 con 0x7fe4f806be60 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe4f806be60 msgr2=0x7fe4f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe4f806be60 0x7fe4f806e320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe504033000 tx=0x7fe504008030 comp rx=0 tx=0).stop 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 msgr2=0x7fe51814c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe51814c8e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00c7a0 tx=0x7fe50c00cc60 comp rx=0 tx=0).stop 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 shutdown_connections 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51809ccb0 0x7fe51809d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe51809aa70 0x7fe51809aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe4f806be60 0x7fe4f806e320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 --2- 172.21.15.96:0/153610399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500004800 0x7fe51814c8e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 >> 172.21.15.96:0/153610399 conn(0x7fe5180b1f80 msgr2=0x7fe5180af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 shutdown_connections 2024-04-24T23:59:29.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.461+0000 7fe51ee00640 1 -- 172.21.15.96:0/153610399 wait complete. 2024-04-24T23:59:29.480 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol39212 --group_name subvol_grp74280 2024-04-24T23:59:29.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.679+0000 7fd5de600640 1 Processor -- start 2024-04-24T23:59:29.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.679+0000 7fd5de600640 1 -- start start 2024-04-24T23:59:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.680+0000 7fd5de600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd5d8161780 0x7fd5d80d4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.680+0000 7fd5de600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d8161b60 0x7fd5d80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.680+0000 7fd5de600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d80cff20 con 0x7fd5d80d1e60 2024-04-24T23:59:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5de600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d80cf680 con 0x7fd5d8161780 2024-04-24T23:59:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5de600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d80cf960 con 0x7fd5d8161b60 2024-04-24T23:59:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5dd200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd5d8161780 0x7fd5d80d4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5ddc00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd5d80d1e60 0x7fd5d80d2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32822/0 (socket says 172.21.15.96:32822) 2024-04-24T23:59:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5ddc00640 1 -- 172.21.15.96:0/1243354974 learned_addr learned my addr 172.21.15.96:0/1243354974 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5d7e00640 1 --2- 172.21.15.96:0/1243354974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d8161b60 0x7fd5d80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5dd200640 1 -- 172.21.15.96:0/1243354974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d8161b60 msgr2=0x7fd5d80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5dd200640 1 --2- 172.21.15.96:0/1243354974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d8161b60 0x7fd5d80b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5dd200640 1 -- 172.21.15.96:0/1243354974 >> v1:172.21.15.96:6789/0 conn(0x7fd5d80d1e60 legacy=0x7fd5d80d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5dd200640 1 -- 172.21.15.96:0/1243354974 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d80cfc40 con 0x7fd5d8161780 2024-04-24T23:59:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.681+0000 7fd5d7e00640 1 --2- 172.21.15.96:0/1243354974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d8161b60 0x7fd5d80b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.682+0000 7fd5dd200640 1 --2- 172.21.15.96:0/1243354974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 0x7fd5d80d4ba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0097a0 tx=0x7fd5cc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd4e9ea893f5efb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.683+0000 7fd5d7400640 1 -- 172.21.15.96:0/1243354974 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc037070 con 0x7fd5d8161780 2024-04-24T23:59:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.683+0000 7fd5d7400640 1 -- 172.21.15.96:0/1243354974 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc02ae50 con 0x7fd5d8161780 2024-04-24T23:59:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.683+0000 7fd5d7400640 1 -- 172.21.15.96:0/1243354974 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc032660 con 0x7fd5d8161780 2024-04-24T23:59:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.683+0000 7fd5de600640 1 -- 172.21.15.96:0/1243354974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 msgr2=0x7fd5d80d4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.683+0000 7fd5de600640 1 --2- 172.21.15.96:0/1243354974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 0x7fd5d80d4ba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0097a0 tx=0x7fd5cc02a100 comp rx=0 tx=0).stop 2024-04-24T23:59:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.684+0000 7fd5de600640 1 -- 172.21.15.96:0/1243354974 shutdown_connections 2024-04-24T23:59:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.684+0000 7fd5de600640 1 --2- 172.21.15.96:0/1243354974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d8161b60 0x7fd5d80b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.684+0000 7fd5de600640 1 --2- 172.21.15.96:0/1243354974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 0x7fd5d80d4ba0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.684+0000 7fd5de600640 1 -- 172.21.15.96:0/1243354974 >> 172.21.15.96:0/1243354974 conn(0x7fd5d80d4080 msgr2=0x7fd5d80d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.684+0000 7fd5de600640 1 -- 172.21.15.96:0/1243354974 shutdown_connections 2024-04-24T23:59:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.684+0000 7fd5de600640 1 -- 172.21.15.96:0/1243354974 wait complete. 2024-04-24T23:59:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.685+0000 7fd5de600640 1 Processor -- start 2024-04-24T23:59:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.686+0000 7fd5de600640 1 -- start start 2024-04-24T23:59:29.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.686+0000 7fd5de600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d80d1e60 0x7fd5d80b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5de600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 0x7fd5d815c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5de600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d8161b60 0x7fd5d81f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5de600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d80d2d70 con 0x7fd5d8161780 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5de600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d80d22f0 con 0x7fd5d8161b60 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5de600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d80d2ef0 con 0x7fd5d80d1e60 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5d7e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 0x7fd5d815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5d7e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 0x7fd5d815c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60072/0 (socket says 172.21.15.96:60072) 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5d7e00640 1 -- 172.21.15.96:0/377987062 learned_addr learned my addr 172.21.15.96:0/377987062 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5d7e00640 1 -- 172.21.15.96:0/377987062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d80d1e60 msgr2=0x7fd5d80b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5d7e00640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d80d1e60 0x7fd5d80b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5d7e00640 1 -- 172.21.15.96:0/377987062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d8161b60 msgr2=0x7fd5d81f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5d7e00640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d8161b60 0x7fd5d81f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.687+0000 7fd5d7e00640 1 -- 172.21.15.96:0/377987062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d81f4080 con 0x7fd5d8161780 2024-04-24T23:59:29.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.688+0000 7fd5d7e00640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 0x7fd5d815c850 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400c7f0 tx=0x7fd5c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:29.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.688+0000 7fd5d4c00640 1 -- 172.21.15.96:0/377987062 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4015070 con 0x7fd5d8161780 2024-04-24T23:59:29.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.688+0000 7fd5d4c00640 1 -- 172.21.15.96:0/377987062 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c4007a30 con 0x7fd5d8161780 2024-04-24T23:59:29.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.688+0000 7fd5d4c00640 1 -- 172.21.15.96:0/377987062 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4007e00 con 0x7fd5d8161780 2024-04-24T23:59:29.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.688+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d81f4340 con 0x7fd5d8161780 2024-04-24T23:59:29.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.688+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d81f4900 con 0x7fd5d8161780 2024-04-24T23:59:29.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.689+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d80756b0 con 0x7fd5d8161780 2024-04-24T23:59:29.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.690+0000 7fd5d4c00640 1 -- 172.21.15.96:0/377987062 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5c4018070 con 0x7fd5d8161780 2024-04-24T23:59:29.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.691+0000 7fd5d4c00640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd5b806be30 0x7fd5b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:29.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.691+0000 7fd5d4c00640 1 -- 172.21.15.96:0/377987062 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd5c408ae60 con 0x7fd5d8161780 2024-04-24T23:59:29.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.692+0000 7fd5dd200640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd5b806be30 0x7fd5b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:29.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.692+0000 7fd5dd200640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd5b806be30 0x7fd5b806e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034000 tx=0x7fd5cc02c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.696+0000 7fd5d4c00640 1 -- 172.21.15.96:0/377987062 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd5c4059800 con 0x7fd5d8161780 2024-04-24T23:59:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.921+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol39212", "group_name": "subvol_grp74280", "target": ["mon-mgr", ""]}) -- 0x7fd5d81f4ca0 con 0x7fd5b806be30 2024-04-24T23:59:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.983+0000 7fd5d4c00640 1 -- 172.21.15.96:0/377987062 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd5d81f4ca0 con 0x7fd5b806be30 2024-04-24T23:59:29.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd5b806be30 msgr2=0x7fd5b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd5b806be30 0x7fd5b806e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034000 tx=0x7fd5cc02c000 comp rx=0 tx=0).stop 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 msgr2=0x7fd5d815c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 0x7fd5d815c850 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400c7f0 tx=0x7fd5c400cbf0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 shutdown_connections 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d8161b60 0x7fd5d81f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd5b806be30 0x7fd5b806e2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d8161780 0x7fd5d815c850 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 --2- 172.21.15.96:0/377987062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d80d1e60 0x7fd5d80b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 >> 172.21.15.96:0/377987062 conn(0x7fd5d80d4080 msgr2=0x7fd5d80b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 shutdown_connections 2024-04-24T23:59:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:29.987+0000 7fd5de600640 1 -- 172.21.15.96:0/377987062 wait complete. 2024-04-24T23:59:30.007 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol55520 subvol_grp74280 2024-04-24T23:59:30.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.203+0000 7fbfda200640 1 Processor -- start 2024-04-24T23:59:30.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.203+0000 7fbfda200640 1 -- start start 2024-04-24T23:59:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.205+0000 7fbfda200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbfd4071d10 0x7fbfd40720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.205+0000 7fbfda200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbfd406e650 0x7fbfd415b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.205+0000 7fbfda200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd4072630 con 0x7fbfd40b3940 2024-04-24T23:59:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.205+0000 7fbfda200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd4071470 con 0x7fbfd4071d10 2024-04-24T23:59:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.205+0000 7fbfda200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd40aeda0 con 0x7fbfd406e650 2024-04-24T23:59:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.205+0000 7fbfd3400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbfd4071d10 0x7fbfd40720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:30.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.205+0000 7fbfd3e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbfd40b3940 0x7fbfd40b3dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32834/0 (socket says 172.21.15.96:32834) 2024-04-24T23:59:30.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.205+0000 7fbfd3e00640 1 -- 172.21.15.96:0/56046391 learned_addr learned my addr 172.21.15.96:0/56046391 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:30.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.206+0000 7fbfd3400640 1 -- 172.21.15.96:0/56046391 >> v2:172.21.15.155:3300/0 conn(0x7fbfd406e650 msgr2=0x7fbfd415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:30.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.206+0000 7fbfd3400640 1 --2- 172.21.15.96:0/56046391 >> v2:172.21.15.155:3300/0 conn(0x7fbfd406e650 0x7fbfd415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.206+0000 7fbfd3400640 1 -- 172.21.15.96:0/56046391 >> v1:172.21.15.96:6789/0 conn(0x7fbfd40b3940 legacy=0x7fbfd40b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.206+0000 7fbfd3400640 1 -- 172.21.15.96:0/56046391 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd40af080 con 0x7fbfd4071d10 2024-04-24T23:59:30.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.207+0000 7fbfd3400640 1 --2- 172.21.15.96:0/56046391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd4071d10 0x7fbfd40720f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40097a0 tx=0x7fbfc402a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fc42f00f2ef450 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:30.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.207+0000 7fbfd2000640 1 -- 172.21.15.96:0/56046391 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4037070 con 0x7fbfd4071d10 2024-04-24T23:59:30.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.207+0000 7fbfd2000640 1 -- 172.21.15.96:0/56046391 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc4032440 con 0x7fbfd4071d10 2024-04-24T23:59:30.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.207+0000 7fbfd2000640 1 -- 172.21.15.96:0/56046391 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4032810 con 0x7fbfd4071d10 2024-04-24T23:59:30.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.207+0000 7fbfda200640 1 -- 172.21.15.96:0/56046391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd4071d10 msgr2=0x7fbfd40720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.207+0000 7fbfda200640 1 --2- 172.21.15.96:0/56046391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd4071d10 0x7fbfd40720f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40097a0 tx=0x7fbfc402a1d0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.208+0000 7fbfda200640 1 -- 172.21.15.96:0/56046391 shutdown_connections 2024-04-24T23:59:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.208+0000 7fbfda200640 1 --2- 172.21.15.96:0/56046391 >> v2:172.21.15.155:3300/0 conn(0x7fbfd406e650 0x7fbfd415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.208+0000 7fbfda200640 1 --2- 172.21.15.96:0/56046391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd4071d10 0x7fbfd40720f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.208+0000 7fbfda200640 1 -- 172.21.15.96:0/56046391 >> 172.21.15.96:0/56046391 conn(0x7fbfd40b19c0 msgr2=0x7fbfd40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.208+0000 7fbfda200640 1 -- 172.21.15.96:0/56046391 shutdown_connections 2024-04-24T23:59:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.208+0000 7fbfda200640 1 -- 172.21.15.96:0/56046391 wait complete. 2024-04-24T23:59:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.209+0000 7fbfda200640 1 Processor -- start 2024-04-24T23:59:30.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.210+0000 7fbfda200640 1 -- start start 2024-04-24T23:59:30.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.210+0000 7fbfda200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd406e650 0x7fbfd41385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.210+0000 7fbfda200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfd4071d10 0x7fbfd41513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.210+0000 7fbfda200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfd40b3940 0x7fbfd41518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.210+0000 7fbfda200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd40718b0 con 0x7fbfd406e650 2024-04-24T23:59:30.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.210+0000 7fbfda200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd4071100 con 0x7fbfd4071d10 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.210+0000 7fbfda200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd415b970 con 0x7fbfd40b3940 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.211+0000 7fbfd3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd406e650 0x7fbfd41385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.211+0000 7fbfd3400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd406e650 0x7fbfd41385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60090/0 (socket says 172.21.15.96:60090) 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.211+0000 7fbfd3400640 1 -- 172.21.15.96:0/1757099408 learned_addr learned my addr 172.21.15.96:0/1757099408 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.211+0000 7fbfd3400640 1 -- 172.21.15.96:0/1757099408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfd40b3940 msgr2=0x7fbfd41518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.211+0000 7fbfd3400640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfd40b3940 0x7fbfd41518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.211+0000 7fbfd3400640 1 -- 172.21.15.96:0/1757099408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfd4071d10 msgr2=0x7fbfd41513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.211+0000 7fbfd3400640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfd4071d10 0x7fbfd41513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.211+0000 7fbfd3400640 1 -- 172.21.15.96:0/1757099408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd41506e0 con 0x7fbfd406e650 2024-04-24T23:59:30.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.211+0000 7fbfd3400640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd406e650 0x7fbfd41385c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4000c00 tx=0x7fbfc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:30.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.212+0000 7fbfcb400640 1 -- 172.21.15.96:0/1757099408 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4037040 con 0x7fbfd406e650 2024-04-24T23:59:30.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.212+0000 7fbfcb400640 1 -- 172.21.15.96:0/1757099408 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc4042070 con 0x7fbfd406e650 2024-04-24T23:59:30.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.212+0000 7fbfcb400640 1 -- 172.21.15.96:0/1757099408 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4030a70 con 0x7fbfd406e650 2024-04-24T23:59:30.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.212+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd41509c0 con 0x7fbfd406e650 2024-04-24T23:59:30.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.212+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd4150f80 con 0x7fbfd406e650 2024-04-24T23:59:30.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.213+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd4069110 con 0x7fbfd406e650 2024-04-24T23:59:30.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.214+0000 7fbfcb400640 1 -- 172.21.15.96:0/1757099408 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfc4030c10 con 0x7fbfd406e650 2024-04-24T23:59:30.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.215+0000 7fbfcb400640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfb406be30 0x7fbfb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.215+0000 7fbfcb400640 1 -- 172.21.15.96:0/1757099408 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbfc40aba50 con 0x7fbfd406e650 2024-04-24T23:59:30.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.215+0000 7fbfd2a00640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfb406be30 0x7fbfb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:30.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.216+0000 7fbfd2a00640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfb406be30 0x7fbfb406e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4151310 tx=0x7fbfc0006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:30.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.219+0000 7fbfcb400640 1 -- 172.21.15.96:0/1757099408 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbfc4045360 con 0x7fbfd406e650 2024-04-24T23:59:30.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.452+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol55520", "group_name": "subvol_grp74280", "target": ["mon-mgr", ""]}) -- 0x7fbfd40cf8e0 con 0x7fbfb406be30 2024-04-24T23:59:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.477+0000 7fbfcb400640 1 -- 172.21.15.96:0/1757099408 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbfd40cf8e0 con 0x7fbfb406be30 2024-04-24T23:59:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfb406be30 msgr2=0x7fbfb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfb406be30 0x7fbfb406e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4151310 tx=0x7fbfc0006c90 comp rx=0 tx=0).stop 2024-04-24T23:59:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd406e650 msgr2=0x7fbfd41385c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd406e650 0x7fbfd41385c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4000c00 tx=0x7fbfc40046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 shutdown_connections 2024-04-24T23:59:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfd40b3940 0x7fbfd41518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfd4071d10 0x7fbfd41513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fbfb406be30 0x7fbfb406e2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 --2- 172.21.15.96:0/1757099408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd406e650 0x7fbfd41385c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.479+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 >> 172.21.15.96:0/1757099408 conn(0x7fbfd40b19c0 msgr2=0x7fbfd406d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.480+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 shutdown_connections 2024-04-24T23:59:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.480+0000 7fbfda200640 1 -- 172.21.15.96:0/1757099408 wait complete. 2024-04-24T23:59:30.485 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.485+0000 7fd169400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.485 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.485+0000 7fd169400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.485 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.485+0000 7fd169400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.485 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.485+0000 7fd169400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.485 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.485+0000 7fd169400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.501 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol96171 subvol_grp74280 2024-04-24T23:59:30.506 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.506+0000 7fd169e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.506 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.506+0000 7fd169e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.506 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.506+0000 7fd169e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.506 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.506+0000 7fd169e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.507 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-24T23:59:30.506+0000 7fd169e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-24T23:59:30.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.680+0000 7f9adb000640 1 Processor -- start 2024-04-24T23:59:30.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.681+0000 7f9adb000640 1 -- start start 2024-04-24T23:59:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.682+0000 7f9adb000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ad4071490 0x7f9ad40b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.682+0000 7f9adb000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9ad40b4a30 0x7f9ad406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.682+0000 7f9adb000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad40b3060 con 0x7f9ad4163820 2024-04-24T23:59:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.682+0000 7f9adb000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad40b4ec0 con 0x7f9ad40b4a30 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.682+0000 7f9adb000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad4163c00 con 0x7f9ad4071490 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9ad9000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9ad40b4a30 0x7f9ad406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9ad9000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9ad40b4a30 0x7f9ad406ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60130/0 (socket says 172.21.15.96:60130) 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9ad9000640 1 -- 172.21.15.96:0/2296658392 learned_addr learned my addr 172.21.15.96:0/2296658392 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9ad3e00640 1 --1- 172.21.15.96:0/2296658392 >> v1:172.21.15.96:6789/0 conn(0x7f9ad4163820 0x7f9ad4070d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32848/0 (socket says 172.21.15.96:32848) 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9acb400640 1 --2- 172.21.15.96:0/2296658392 >> v2:172.21.15.155:3300/0 conn(0x7f9ad4071490 0x7f9ad40b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9ad9000640 1 -- 172.21.15.96:0/2296658392 >> v2:172.21.15.155:3300/0 conn(0x7f9ad4071490 msgr2=0x7f9ad40b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9ad9000640 1 --2- 172.21.15.96:0/2296658392 >> v2:172.21.15.155:3300/0 conn(0x7f9ad4071490 0x7f9ad40b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9ad9000640 1 -- 172.21.15.96:0/2296658392 >> v1:172.21.15.96:6789/0 conn(0x7f9ad4163820 legacy=0x7f9ad4070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9ad9000640 1 -- 172.21.15.96:0/2296658392 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad40b32d0 con 0x7f9ad40b4a30 2024-04-24T23:59:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.683+0000 7f9ad3400640 1 -- 172.21.15.96:0/2296658392 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729066680 0 0) 0x7f9ad40b3060 con 0x7f9ad4163820 2024-04-24T23:59:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.684+0000 7f9ad9000640 1 --2- 172.21.15.96:0/2296658392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad40b4a30 0x7f9ad406ccb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ad406cbc0 tx=0x7f9acc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ac80d897cd616e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.685+0000 7f9ad3400640 1 -- 172.21.15.96:0/2296658392 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc036070 con 0x7f9ad40b4a30 2024-04-24T23:59:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.685+0000 7f9ad3400640 1 -- 172.21.15.96:0/2296658392 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc031600 con 0x7f9ad40b4a30 2024-04-24T23:59:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.685+0000 7f9ad3400640 1 -- 172.21.15.96:0/2296658392 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0319d0 con 0x7f9ad40b4a30 2024-04-24T23:59:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.685+0000 7f9adb000640 1 -- 172.21.15.96:0/2296658392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad40b4a30 msgr2=0x7f9ad406ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.685+0000 7f9adb000640 1 --2- 172.21.15.96:0/2296658392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad40b4a30 0x7f9ad406ccb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ad406cbc0 tx=0x7f9acc02a730 comp rx=0 tx=0).stop 2024-04-24T23:59:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.685+0000 7f9adb000640 1 -- 172.21.15.96:0/2296658392 shutdown_connections 2024-04-24T23:59:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.685+0000 7f9adb000640 1 --2- 172.21.15.96:0/2296658392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad40b4a30 0x7f9ad406ccb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.685+0000 7f9adb000640 1 --2- 172.21.15.96:0/2296658392 >> v2:172.21.15.155:3300/0 conn(0x7f9ad4071490 0x7f9ad40b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.685+0000 7f9adb000640 1 -- 172.21.15.96:0/2296658392 >> 172.21.15.96:0/2296658392 conn(0x7f9ad40b19c0 msgr2=0x7f9ad40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.686+0000 7f9adb000640 1 -- 172.21.15.96:0/2296658392 shutdown_connections 2024-04-24T23:59:30.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.686+0000 7f9adb000640 1 -- 172.21.15.96:0/2296658392 wait complete. 2024-04-24T23:59:30.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.687+0000 7f9adb000640 1 Processor -- start 2024-04-24T23:59:30.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.687+0000 7f9adb000640 1 -- start start 2024-04-24T23:59:30.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.688+0000 7f9adb000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad4071490 0x7f9ad415c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.688+0000 7f9adb000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40b4a30 0x7f9ad409c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.688+0000 7f9adb000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad4163820 0x7f9ad414ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.688+0000 7f9adb000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40b3b70 con 0x7f9ad4071490 2024-04-24T23:59:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.688+0000 7f9adb000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40b3890 con 0x7f9ad4163820 2024-04-24T23:59:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.688+0000 7f9adb000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad40b4090 con 0x7f9ad40b4a30 2024-04-24T23:59:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9ad3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad4071490 0x7f9ad415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9ad3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad4071490 0x7f9ad415c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60146/0 (socket says 172.21.15.96:60146) 2024-04-24T23:59:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9ad3e00640 1 -- 172.21.15.96:0/2549091212 learned_addr learned my addr 172.21.15.96:0/2549091212 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9ad9000640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad4163820 0x7f9ad414ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9acb400640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40b4a30 0x7f9ad409c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9ad3e00640 1 -- 172.21.15.96:0/2549091212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40b4a30 msgr2=0x7f9ad409c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9ad3e00640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40b4a30 0x7f9ad409c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9ad3e00640 1 -- 172.21.15.96:0/2549091212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad4163820 msgr2=0x7f9ad414ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9ad3e00640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad4163820 0x7f9ad414ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.689+0000 7f9ad3e00640 1 -- 172.21.15.96:0/2549091212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad409ce40 con 0x7f9ad4071490 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.690+0000 7f9ad3e00640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad4071490 0x7f9ad415c670 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400c4d0 tx=0x7f9ac400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.690+0000 7f9ad0c00640 1 -- 172.21.15.96:0/2549091212 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4018070 con 0x7f9ad4071490 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.690+0000 7f9ad0c00640 1 -- 172.21.15.96:0/2549091212 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac4007500 con 0x7f9ad4071490 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.690+0000 7f9ad0c00640 1 -- 172.21.15.96:0/2549091212 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4004a20 con 0x7f9ad4071490 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.690+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad409d120 con 0x7f9ad4071490 2024-04-24T23:59:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.690+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad4149050 con 0x7f9ad4071490 2024-04-24T23:59:30.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.691+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad409d4c0 con 0x7f9ad4071490 2024-04-24T23:59:30.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.692+0000 7f9ad0c00640 1 -- 172.21.15.96:0/2549091212 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ac4004bc0 con 0x7f9ad4071490 2024-04-24T23:59:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.693+0000 7f9ad0c00640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ab006be30 0x7f9ab006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.693+0000 7f9ad0c00640 1 -- 172.21.15.96:0/2549091212 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9ac408a140 con 0x7f9ad4071490 2024-04-24T23:59:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.693+0000 7f9acb400640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ab006be30 0x7f9ab006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.694+0000 7f9acb400640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ab006be30 0x7f9ab006e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9abc006fd0 tx=0x7f9abc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:30.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.698+0000 7f9ad0c00640 1 -- 172.21.15.96:0/2549091212 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9ad409d4c0 con 0x7f9ad4071490 2024-04-24T23:59:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:30.924+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol96171", "group_name": "subvol_grp74280", "target": ["mon-mgr", ""]}) -- 0x7f9ad4069110 con 0x7f9ab006be30 2024-04-24T23:59:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:31.058+0000 7f9ad0c00640 1 -- 172.21.15.96:0/2549091212 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f9ac4054a50 con 0x7f9ad4071490 2024-04-24T23:59:32.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.730+0000 7f9ad0c00640 1 -- 172.21.15.96:0/2549091212 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9ad4069110 con 0x7f9ab006be30 2024-04-24T23:59:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.733+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ab006be30 msgr2=0x7f9ab006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.733+0000 7f9adb000640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ab006be30 0x7f9ab006e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9abc006fd0 tx=0x7f9abc008040 comp rx=0 tx=0).stop 2024-04-24T23:59:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.733+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad4071490 msgr2=0x7f9ad415c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.733+0000 7f9adb000640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad4071490 0x7f9ad415c670 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400c4d0 tx=0x7f9ac400c990 comp rx=0 tx=0).stop 2024-04-24T23:59:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.734+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 shutdown_connections 2024-04-24T23:59:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.734+0000 7f9adb000640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad4163820 0x7f9ad414ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.734+0000 7f9adb000640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40b4a30 0x7f9ad409c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.734+0000 7f9adb000640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f9ab006be30 0x7f9ab006e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.734+0000 7f9adb000640 1 --2- 172.21.15.96:0/2549091212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ad4071490 0x7f9ad415c670 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.734+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 >> 172.21.15.96:0/2549091212 conn(0x7f9ad40b19c0 msgr2=0x7f9ad4160200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.734+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 shutdown_connections 2024-04-24T23:59:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.734+0000 7f9adb000640 1 -- 172.21.15.96:0/2549091212 wait complete. 2024-04-24T23:59:32.758 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol39212 subvol_grp74280 2024-04-24T23:59:32.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.953+0000 7f928be00640 1 Processor -- start 2024-04-24T23:59:32.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.954+0000 7f928be00640 1 -- start start 2024-04-24T23:59:32.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.955+0000 7f928be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9284163820 0x7f9284070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:32.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.955+0000 7f928be00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f92840712c0 0x7f92840b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.955+0000 7f928be00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92840b3060 con 0x7f92840b4a30 2024-04-24T23:59:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.955+0000 7f928be00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9284071720 con 0x7f92840712c0 2024-04-24T23:59:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.955+0000 7f928be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f92840b4ec0 con 0x7f9284163820 2024-04-24T23:59:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9289e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f92840b4a30 0x7f9284166320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32862/0 (socket says 172.21.15.96:32862) 2024-04-24T23:59:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9289e00640 1 -- 172.21.15.96:0/3627660317 learned_addr learned my addr 172.21.15.96:0/3627660317 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9289400640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9284163820 0x7f9284070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9288a00640 1 --2- 172.21.15.96:0/3627660317 >> v2:172.21.15.155:3300/0 conn(0x7f92840712c0 0x7f92840b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757856898 0 0) 0x7f92840b3060 con 0x7f92840b4a30 2024-04-24T23:59:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f926c003520 con 0x7f92840b4a30 2024-04-24T23:59:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2930523482 0 0) 0x7f926c003520 con 0x7f92840b4a30 2024-04-24T23:59:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9284163820 msgr2=0x7f9284070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9283e00640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9284163820 0x7f9284070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 >> v2:172.21.15.155:3300/0 conn(0x7f92840712c0 msgr2=0x7f92840b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9283e00640 1 --2- 172.21.15.96:0/3627660317 >> v2:172.21.15.155:3300/0 conn(0x7f92840712c0 0x7f92840b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9284163c00 con 0x7f92840b4a30 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.956+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f927c0019f0 con 0x7f92840b4a30 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 >> v1:172.21.15.96:6789/0 conn(0x7f92840b4a30 legacy=0x7f9284166320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9283e00640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f926c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9283e00640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c004800 0x7f926c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9283e00640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9284163820 0x7f926c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f92840b4ec0 con 0x7f926c0039b0 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f926c00b9c0 con 0x7f926c004800 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f926c00bb40 con 0x7f9284163820 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9288a00640 1 --2- 172.21.15.96:0/3627660317 >> v2:172.21.15.155:3300/0 conn(0x7f92840712c0 0x7f92840b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9289400640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f926c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9289400640 1 -- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9284163820 msgr2=0x7f926c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9289400640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9284163820 0x7f926c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9289400640 1 -- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c004800 msgr2=0x7f926c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9288a00640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c004800 0x7f926c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9289400640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c004800 0x7f926c004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.957+0000 7f9289400640 1 -- 172.21.15.96:0/3627660317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926c003520 con 0x7f926c0039b0 2024-04-24T23:59:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.958+0000 7f9289400640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f926c003dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9278009ac0 tx=0x7f926c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586a1c97db4f6d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.959+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278036070 con 0x7f926c0039b0 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.959+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9278031400 con 0x7f926c0039b0 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.959+0000 7f9283e00640 1 -- 172.21.15.96:0/3627660317 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278009690 con 0x7f926c0039b0 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.959+0000 7f928be00640 1 -- 172.21.15.96:0/3627660317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 msgr2=0x7f926c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.959+0000 7f928be00640 1 --2- 172.21.15.96:0/3627660317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f926c003dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9278009ac0 tx=0x7f926c005830 comp rx=0 tx=0).stop 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.959+0000 7f9289e00640 1 -- 172.21.15.96:0/3627660317 reap_dead start 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.960+0000 7f928be00640 1 -- 172.21.15.96:0/3627660317 shutdown_connections 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.960+0000 7f928be00640 1 -- 172.21.15.96:0/3627660317 >> 172.21.15.96:0/3627660317 conn(0x7f92840b19c0 msgr2=0x7f92840b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.960+0000 7f928be00640 1 -- 172.21.15.96:0/3627660317 shutdown_connections 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.960+0000 7f928be00640 1 -- 172.21.15.96:0/3627660317 wait complete. 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.961+0000 7f928be00640 1 Processor -- start 2024-04-24T23:59:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.962+0000 7f928be00640 1 -- start start 2024-04-24T23:59:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.962+0000 7f928be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f9284154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.962+0000 7f928be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92840addf0 0x7f92840ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.962+0000 7f928be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92840af6f0 0x7f92840afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.962+0000 7f928be00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f92840b3890 con 0x7f926c0039b0 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.962+0000 7f928be00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f92840b35b0 con 0x7f92840addf0 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.962+0000 7f928be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f92840b3b70 con 0x7f92840af6f0 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.963+0000 7f9289400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f9284154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.963+0000 7f9289400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f9284154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60154/0 (socket says 172.21.15.96:60154) 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.963+0000 7f9289400640 1 -- 172.21.15.96:0/2854570191 learned_addr learned my addr 172.21.15.96:0/2854570191 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.963+0000 7f9289400640 1 -- 172.21.15.96:0/2854570191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92840af6f0 msgr2=0x7f92840afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.963+0000 7f9289400640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92840af6f0 0x7f92840afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.963+0000 7f9289400640 1 -- 172.21.15.96:0/2854570191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92840addf0 msgr2=0x7f92840ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.963+0000 7f9289400640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92840addf0 0x7f92840ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.963+0000 7f9289400640 1 -- 172.21.15.96:0/2854570191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92840b0300 con 0x7f926c0039b0 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.964+0000 7f9289400640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f9284154e70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9278034040 tx=0x7f9278004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.964+0000 7f9281600640 1 -- 172.21.15.96:0/2854570191 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278040020 con 0x7f926c0039b0 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.964+0000 7f9281600640 1 -- 172.21.15.96:0/2854570191 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92780038d0 con 0x7f926c0039b0 2024-04-24T23:59:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.964+0000 7f9281600640 1 -- 172.21.15.96:0/2854570191 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278036040 con 0x7f926c0039b0 2024-04-24T23:59:32.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.964+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92840b05e0 con 0x7f926c0039b0 2024-04-24T23:59:32.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.964+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92840b0ba0 con 0x7f926c0039b0 2024-04-24T23:59:32.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.965+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9284069110 con 0x7f926c0039b0 2024-04-24T23:59:32.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.967+0000 7f9281600640 1 -- 172.21.15.96:0/2854570191 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f9278043020 con 0x7f926c0039b0 2024-04-24T23:59:32.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.967+0000 7f9281600640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f926406bef0 0x7f926406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.968+0000 7f9281600640 1 -- 172.21.15.96:0/2854570191 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f92780ab0c0 con 0x7f926c0039b0 2024-04-24T23:59:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.968+0000 7f9288a00640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f926406bef0 0x7f926406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.969+0000 7f9288a00640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f926406bef0 0x7f926406e3b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9270006e80 tx=0x7f9270006e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:32.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:32.973+0000 7f9281600640 1 -- 172.21.15.96:0/2854570191 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f927804a070 con 0x7f926c0039b0 2024-04-24T23:59:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.070+0000 7f9281600640 1 -- 172.21.15.96:0/2854570191 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f92780758f0 con 0x7f926c0039b0 2024-04-24T23:59:33.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.203+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol39212", "group_name": "subvol_grp74280", "target": ["mon-mgr", ""]}) -- 0x7f92840b00b0 con 0x7f926406bef0 2024-04-24T23:59:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.243+0000 7f9281600640 1 -- 172.21.15.96:0/2854570191 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f92840b00b0 con 0x7f926406bef0 2024-04-24T23:59:33.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f926406bef0 msgr2=0x7f926406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:33.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f926406bef0 0x7f926406e3b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9270006e80 tx=0x7f9270006e10 comp rx=0 tx=0).stop 2024-04-24T23:59:33.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 msgr2=0x7f9284154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:33.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f9284154e70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9278034040 tx=0x7f9278004730 comp rx=0 tx=0).stop 2024-04-24T23:59:33.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 shutdown_connections 2024-04-24T23:59:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92840af6f0 0x7f92840afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92840addf0 0x7f92840ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f926406bef0 0x7f926406e3b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 --2- 172.21.15.96:0/2854570191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f926c0039b0 0x7f9284154e70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 >> 172.21.15.96:0/2854570191 conn(0x7f92840b19c0 msgr2=0x7f9284164d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 shutdown_connections 2024-04-24T23:59:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.246+0000 7f928be00640 1 -- 172.21.15.96:0/2854570191 wait complete. 2024-04-24T23:59:33.269 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp74280 2024-04-24T23:59:33.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.454+0000 7fdafda00640 1 Processor -- start 2024-04-24T23:59:33.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.454+0000 7fdafda00640 1 -- start start 2024-04-24T23:59:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.456+0000 7fdafda00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf80af190 0x7fdaf80acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.456+0000 7fdafda00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf8160c00 con 0x7fdaf815c2d0 2024-04-24T23:59:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.456+0000 7fdafda00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf80ad430 con 0x7fdaf8160770 2024-04-24T23:59:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.456+0000 7fdafda00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf806e2c0 con 0x7fdaf80af190 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.456+0000 7fdaf6a00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdaf815c2d0 0x7fdaf80aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32874/0 (socket says 172.21.15.96:32874) 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.456+0000 7fdaf6a00640 1 -- 172.21.15.96:0/3989154691 learned_addr learned my addr 172.21.15.96:0/3989154691 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf6000640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf80af190 0x7fdaf80acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385796725 0 0) 0x7fdaf8160c00 con 0x7fdaf815c2d0 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdad8003520 con 0x7fdaf815c2d0 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 177300243 0 0) 0x7fdad8003520 con 0x7fdaf815c2d0 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf80af190 msgr2=0x7fdaf80acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf80af190 0x7fdaf80acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 >> v1:172.21.15.155:6789/0 conn(0x7fdaf8160770 legacy=0x7fdaf80711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf806e5a0 con 0x7fdaf815c2d0 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fdae8001670 con 0x7fdaf815c2d0 2024-04-24T23:59:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 >> v1:172.21.15.96:6789/0 conn(0x7fdaf815c2d0 legacy=0x7fdaf80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad80039e0 0x7fdad8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.457+0000 7fdaf5600640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf80af190 0x7fdad8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf5600640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdad80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf806e2c0 con 0x7fdad8004d40 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdad800bb50 con 0x7fdad80039e0 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdad800bd20 con 0x7fdaf80af190 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf7400640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdad80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf6a00640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad80039e0 0x7fdad8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf6000640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf80af190 0x7fdad8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf7400640 1 -- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf80af190 msgr2=0x7fdad8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf7400640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf80af190 0x7fdad8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf7400640 1 -- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad80039e0 msgr2=0x7fdad8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf7400640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdad80039e0 0x7fdad8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.458+0000 7fdaf7400640 1 -- 172.21.15.96:0/3989154691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad8003520 con 0x7fdad8004d40 2024-04-24T23:59:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.460+0000 7fdaf7400640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdad80051c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0001780 tx=0x7fdad8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9742c7386541e688 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.460+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0001370 con 0x7fdad8004d40 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.460+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf00052d0 con 0x7fdad8004d40 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.460+0000 7fdaf5600640 1 -- 172.21.15.96:0/3989154691 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf002ac00 con 0x7fdad8004d40 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.460+0000 7fdafda00640 1 -- 172.21.15.96:0/3989154691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 msgr2=0x7fdad80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.460+0000 7fdafda00640 1 --2- 172.21.15.96:0/3989154691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdad80051c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0001780 tx=0x7fdad8005830 comp rx=0 tx=0).stop 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.460+0000 7fdaf7400640 1 -- 172.21.15.96:0/3989154691 reap_dead start 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.460+0000 7fdafda00640 1 -- 172.21.15.96:0/3989154691 shutdown_connections 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.460+0000 7fdafda00640 1 -- 172.21.15.96:0/3989154691 >> 172.21.15.96:0/3989154691 conn(0x7fdaf80b19c0 msgr2=0x7fdaf80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.461+0000 7fdafda00640 1 -- 172.21.15.96:0/3989154691 shutdown_connections 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.461+0000 7fdafda00640 1 -- 172.21.15.96:0/3989154691 wait complete. 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.462+0000 7fdafda00640 1 Processor -- start 2024-04-24T23:59:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.463+0000 7fdafda00640 1 -- start start 2024-04-24T23:59:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.463+0000 7fdafda00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdaf8159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.463+0000 7fdafda00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf81476d0 0x7fdaf809ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.463+0000 7fdafda00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf809d410 0x7fdaf8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.463+0000 7fdafda00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf80acf20 con 0x7fdad8004d40 2024-04-24T23:59:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.463+0000 7fdafda00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf80acda0 con 0x7fdaf809d410 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.463+0000 7fdafda00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf80ad0a0 con 0x7fdaf81476d0 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf6a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdaf8159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf6a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdaf8159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60174/0 (socket says 172.21.15.96:60174) 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf6a00640 1 -- 172.21.15.96:0/1146843551 learned_addr learned my addr 172.21.15.96:0/1146843551 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf7400640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf809d410 0x7fdaf8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf6000640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf81476d0 0x7fdaf809ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf6a00640 1 -- 172.21.15.96:0/1146843551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf81476d0 msgr2=0x7fdaf809ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf6a00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf81476d0 0x7fdaf809ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf6a00640 1 -- 172.21.15.96:0/1146843551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf809d410 msgr2=0x7fdaf8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf6a00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf809d410 0x7fdaf8159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf6a00640 1 -- 172.21.15.96:0/1146843551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf81583d0 con 0x7fdad8004d40 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.464+0000 7fdaf7400640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf809d410 0x7fdaf8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.465+0000 7fdaf6a00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdaf8159470 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e850 tx=0x7fdae800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.465+0000 7fdaeea00640 1 -- 172.21.15.96:0/1146843551 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae800c8d0 con 0x7fdad8004d40 2024-04-24T23:59:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.465+0000 7fdaeea00640 1 -- 172.21.15.96:0/1146843551 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae8018070 con 0x7fdad8004d40 2024-04-24T23:59:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.465+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf81586b0 con 0x7fdad8004d40 2024-04-24T23:59:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.465+0000 7fdaeea00640 1 -- 172.21.15.96:0/1146843551 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae800ccb0 con 0x7fdad8004d40 2024-04-24T23:59:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.465+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf8158c70 con 0x7fdad8004d40 2024-04-24T23:59:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.466+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf8075750 con 0x7fdad8004d40 2024-04-24T23:59:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.467+0000 7fdaeea00640 1 -- 172.21.15.96:0/1146843551 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fdae801d460 con 0x7fdad8004d40 2024-04-24T23:59:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.468+0000 7fdaeea00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdad406bfe0 0x7fdad406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.468+0000 7fdaeea00640 1 -- 172.21.15.96:0/1146843551 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fdae808b0a0 con 0x7fdad8004d40 2024-04-24T23:59:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.468+0000 7fdaf6000640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdad406bfe0 0x7fdad406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:33.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.469+0000 7fdaf6000640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdad406bfe0 0x7fdad406e4a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8157ea0 tx=0x7fdae000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.473+0000 7fdaeea00640 1 -- 172.21.15.96:0/1146843551 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdae8059170 con 0x7fdad8004d40 2024-04-24T23:59:33.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.697+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp74280", "target": ["mon-mgr", ""]}) -- 0x7fdaf809d7f0 con 0x7fdad406bfe0 2024-04-24T23:59:33.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.706+0000 7fdaeea00640 1 -- 172.21.15.96:0/1146843551 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdaf809d7f0 con 0x7fdad406bfe0 2024-04-24T23:59:33.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdad406bfe0 msgr2=0x7fdad406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:33.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdad406bfe0 0x7fdad406e4a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8157ea0 tx=0x7fdae000b040 comp rx=0 tx=0).stop 2024-04-24T23:59:33.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 msgr2=0x7fdaf8159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:33.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdaf8159470 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e850 tx=0x7fdae800ed10 comp rx=0 tx=0).stop 2024-04-24T23:59:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 shutdown_connections 2024-04-24T23:59:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf809d410 0x7fdaf8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdaf81476d0 0x7fdaf809ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdad406bfe0 0x7fdad406e4a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 --2- 172.21.15.96:0/1146843551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdad8004d40 0x7fdaf8159470 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 >> 172.21.15.96:0/1146843551 conn(0x7fdaf80b19c0 msgr2=0x7fdaf815ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 shutdown_connections 2024-04-24T23:59:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33.709+0000 7fdafda00640 1 -- 172.21.15.96:0/1146843551 wait complete. 2024-04-24T23:59:33.729 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-04-24T23:59:33.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:59:33.829 INFO:teuthology.orchestra.run.smithi096.stdout:2 2024-04-24T23:59:33.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:59:33.838 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:59:33.839 DEBUG:teuthology.orchestra.run.smithi096:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:59:33.937 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:59:34.051 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:59:34.051 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:59:34.051 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:59:34.052 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:34.111 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:59:34.111 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:34.162 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:34.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.410+0000 7f7201000640 1 Processor -- start 2024-04-24T23:59:34.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.410+0000 7f7201000640 1 -- start start 2024-04-24T23:59:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.412+0000 7f7201000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71fc15f450 0x7f71fc0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.412+0000 7f7201000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f71fc0b4590 0x7f71fc0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.412+0000 7f7201000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71fc0b3070 con 0x7f71fc1551c0 2024-04-24T23:59:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.412+0000 7f7201000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f71fc0b4f40 con 0x7f71fc0b4590 2024-04-24T23:59:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.412+0000 7f7201000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc0b3960 con 0x7f71fc15f450 2024-04-24T23:59:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.412+0000 7f71fa800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f71fc0b4590 0x7f71fc0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.412+0000 7f71fa800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f71fc0b4590 0x7f71fc0b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60176/0 (socket says 172.21.15.96:60176) 2024-04-24T23:59:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.413+0000 7f71fa800640 1 -- 172.21.15.96:0/1274383921 learned_addr learned my addr 172.21.15.96:0/1274383921 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.413+0000 7f71f9400640 1 --2- 172.21.15.96:0/1274383921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71fc15f450 0x7f71fc0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.413+0000 7f71fa800640 1 -- 172.21.15.96:0/1274383921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71fc15f450 msgr2=0x7f71fc0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.413+0000 7f71fa800640 1 --2- 172.21.15.96:0/1274383921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71fc15f450 0x7f71fc0b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.413+0000 7f71fa800640 1 -- 172.21.15.96:0/1274383921 >> v1:172.21.15.155:6789/0 conn(0x7f71fc1551c0 legacy=0x7f71fc070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:34.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.413+0000 7f71fa800640 1 -- 172.21.15.96:0/1274383921 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc0b3310 con 0x7f71fc0b4590 2024-04-24T23:59:34.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.415+0000 7f71fa800640 1 --2- 172.21.15.96:0/1274383921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 0x7f71fc0b4a00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f71f4009e50 tx=0x7f71f402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d11df7c0c88b58e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:34.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.415+0000 7f71f8a00640 1 -- 172.21.15.96:0/1274383921 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4036070 con 0x7f71fc0b4590 2024-04-24T23:59:34.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.415+0000 7f71f8a00640 1 -- 172.21.15.96:0/1274383921 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f4031600 con 0x7f71fc0b4590 2024-04-24T23:59:34.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.415+0000 7f71f8a00640 1 -- 172.21.15.96:0/1274383921 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f40319d0 con 0x7f71fc0b4590 2024-04-24T23:59:34.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.416+0000 7f7201000640 1 -- 172.21.15.96:0/1274383921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 msgr2=0x7f71fc0b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:34.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.416+0000 7f7201000640 1 --2- 172.21.15.96:0/1274383921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 0x7f71fc0b4a00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f71f4009e50 tx=0x7f71f402a680 comp rx=0 tx=0).stop 2024-04-24T23:59:34.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.416+0000 7f7201000640 1 -- 172.21.15.96:0/1274383921 shutdown_connections 2024-04-24T23:59:34.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.416+0000 7f7201000640 1 --2- 172.21.15.96:0/1274383921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 0x7f71fc0b4a00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.416+0000 7f7201000640 1 --2- 172.21.15.96:0/1274383921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71fc15f450 0x7f71fc0b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.416+0000 7f7201000640 1 -- 172.21.15.96:0/1274383921 >> 172.21.15.96:0/1274383921 conn(0x7f71fc0b19c0 msgr2=0x7f71fc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:34.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.416+0000 7f7201000640 1 -- 172.21.15.96:0/1274383921 shutdown_connections 2024-04-24T23:59:34.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.416+0000 7f7201000640 1 -- 172.21.15.96:0/1274383921 wait complete. 2024-04-24T23:59:34.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.417+0000 7f7201000640 1 Processor -- start 2024-04-24T23:59:34.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.418+0000 7f7201000640 1 -- start start 2024-04-24T23:59:34.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.418+0000 7f7201000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 0x7f71fc147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f7201000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc1551c0 0x7f71fc09bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f7201000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71fc15f450 0x7f71fc156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f7201000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc1555a0 con 0x7f71fc0b4590 2024-04-24T23:59:34.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f7201000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc071500 con 0x7f71fc1551c0 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f7201000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc155720 con 0x7f71fc15f450 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 0x7f71fc147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 0x7f71fc147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60192/0 (socket says 172.21.15.96:60192) 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f71f9e00640 1 -- 172.21.15.96:0/3016152774 learned_addr learned my addr 172.21.15.96:0/3016152774 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f71f9400640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc1551c0 0x7f71fc09bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f71f9e00640 1 -- 172.21.15.96:0/3016152774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71fc15f450 msgr2=0x7f71fc156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f71f9e00640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71fc15f450 0x7f71fc156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f71f9e00640 1 -- 172.21.15.96:0/3016152774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc1551c0 msgr2=0x7f71fc09bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f71f9e00640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc1551c0 0x7f71fc09bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.419+0000 7f71f9e00640 1 -- 172.21.15.96:0/3016152774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc1ea300 con 0x7f71fc0b4590 2024-04-24T23:59:34.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.420+0000 7f71f9e00640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 0x7f71fc147630 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c400 tx=0x7f71ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:34.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.420+0000 7f71f2000640 1 -- 172.21.15.96:0/3016152774 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0052d0 con 0x7f71fc0b4590 2024-04-24T23:59:34.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.420+0000 7f71f2000640 1 -- 172.21.15.96:0/3016152774 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ec005490 con 0x7f71fc0b4590 2024-04-24T23:59:34.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.420+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc09aa70 con 0x7f71fc0b4590 2024-04-24T23:59:34.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.420+0000 7f71f2000640 1 -- 172.21.15.96:0/3016152774 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec007260 con 0x7f71fc0b4590 2024-04-24T23:59:34.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.420+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc09b030 con 0x7f71fc0b4590 2024-04-24T23:59:34.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.421+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc0b2560 con 0x7f71fc0b4590 2024-04-24T23:59:34.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.422+0000 7f71f2000640 1 -- 172.21.15.96:0/3016152774 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f71ec007400 con 0x7f71fc0b4590 2024-04-24T23:59:34.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.423+0000 7f71f2000640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f71dc06bfe0 0x7f71dc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.423+0000 7f71f2000640 1 -- 172.21.15.96:0/3016152774 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f71ec08a6c0 con 0x7f71fc0b4590 2024-04-24T23:59:34.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.423+0000 7f71f9400640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f71dc06bfe0 0x7f71dc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.424+0000 7f71f9400640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f71dc06bfe0 0x7f71dc06e4a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f71e8006fd0 tx=0x7f71e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:34.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.428+0000 7f71f2000640 1 -- 172.21.15.96:0/3016152774 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f71fc0b2560 con 0x7f71fc0b4590 2024-04-24T23:59:34.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.631+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71fc06e8d0 con 0x7f71fc0b4590 2024-04-24T23:59:34.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.634+0000 7f71f2000640 1 -- 172.21.15.96:0/3016152774 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16621 (secure 0 0 0) 0x7f71ec058de0 con 0x7f71fc0b4590 2024-04-24T23:59:34.634 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:34.635 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":33,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:17.499374+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:59:13.640002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T23:59:14.952491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:34.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f71dc06bfe0 msgr2=0x7f71dc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:34.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f71dc06bfe0 0x7f71dc06e4a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f71e8006fd0 tx=0x7f71e8008040 comp rx=0 tx=0).stop 2024-04-24T23:59:34.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 msgr2=0x7f71fc147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:34.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 0x7f71fc147630 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c400 tx=0x7f71ec00c8c0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 shutdown_connections 2024-04-24T23:59:34.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71fc15f450 0x7f71fc156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc1551c0 0x7f71fc09bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f71dc06bfe0 0x7f71dc06e4a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 --2- 172.21.15.96:0/3016152774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71fc0b4590 0x7f71fc147630 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 >> 172.21.15.96:0/3016152774 conn(0x7f71fc0b19c0 msgr2=0x7f71fc0afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:34.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 shutdown_connections 2024-04-24T23:59:34.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.637+0000 7f7201000640 1 -- 172.21.15.96:0/3016152774 wait complete. 2024-04-24T23:59:34.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:59:13.640002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:59:14.952491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:59:34.657 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:59:34.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.863+0000 7f2a08400640 1 Processor -- start 2024-04-24T23:59:34.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.864+0000 7f2a08400640 1 -- start start 2024-04-24T23:59:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.865+0000 7f2a08400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a0015d290 0x7f2a0006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.865+0000 7f2a08400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2a000720e0 0x7f2a000ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.865+0000 7f2a08400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0015c4e0 con 0x7f2a0006c0d0 2024-04-24T23:59:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.865+0000 7f2a08400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2a000725f0 con 0x7f2a0015d290 2024-04-24T23:59:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.865+0000 7f2a08400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0015c7b0 con 0x7f2a000720e0 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a05000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a0015d290 0x7f2a0006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a05000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a0015d290 0x7f2a0006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60202/0 (socket says 172.21.15.96:60202) 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a05000640 1 -- 172.21.15.96:0/1384277579 learned_addr learned my addr 172.21.15.96:0/1384277579 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a05a00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2a0006c0d0 0x7f2a0006c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32886/0 (socket says 172.21.15.96:32886) 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a06400640 1 --2- 172.21.15.96:0/1384277579 >> v2:172.21.15.155:3300/0 conn(0x7f2a000720e0 0x7f2a000ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a05000640 1 -- 172.21.15.96:0/1384277579 >> v2:172.21.15.155:3300/0 conn(0x7f2a000720e0 msgr2=0x7f2a000ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a05000640 1 --2- 172.21.15.96:0/1384277579 >> v2:172.21.15.155:3300/0 conn(0x7f2a000720e0 0x7f2a000ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a05000640 1 -- 172.21.15.96:0/1384277579 >> v1:172.21.15.96:6789/0 conn(0x7f2a0006c0d0 legacy=0x7f2a0006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a05000640 1 -- 172.21.15.96:0/1384277579 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0015ca90 con 0x7f2a0015d290 2024-04-24T23:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.866+0000 7f2a06400640 1 --2- 172.21.15.96:0/1384277579 >> v2:172.21.15.155:3300/0 conn(0x7f2a000720e0 0x7f2a000ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:34.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.867+0000 7f2a05000640 1 --2- 172.21.15.96:0/1384277579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0015d290 0x7f2a0006fa10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2a000b30b0 tx=0x7f29ec02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2dc413109106b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.867+0000 7f29ffe00640 1 -- 172.21.15.96:0/1384277579 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec036070 con 0x7f2a0015d290 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f29ffe00640 1 -- 172.21.15.96:0/1384277579 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec031600 con 0x7f2a0015d290 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f29ffe00640 1 -- 172.21.15.96:0/1384277579 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0319d0 con 0x7f2a0015d290 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f2a08400640 1 -- 172.21.15.96:0/1384277579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0015d290 msgr2=0x7f2a0006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f2a08400640 1 --2- 172.21.15.96:0/1384277579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0015d290 0x7f2a0006fa10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2a000b30b0 tx=0x7f29ec02a730 comp rx=0 tx=0).stop 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f2a08400640 1 -- 172.21.15.96:0/1384277579 shutdown_connections 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f2a08400640 1 --2- 172.21.15.96:0/1384277579 >> v2:172.21.15.155:3300/0 conn(0x7f2a000720e0 0x7f2a000ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f2a08400640 1 --2- 172.21.15.96:0/1384277579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0015d290 0x7f2a0006fa10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f2a08400640 1 -- 172.21.15.96:0/1384277579 >> 172.21.15.96:0/1384277579 conn(0x7f2a000715c0 msgr2=0x7f2a000719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f2a08400640 1 -- 172.21.15.96:0/1384277579 shutdown_connections 2024-04-24T23:59:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.868+0000 7f2a08400640 1 -- 172.21.15.96:0/1384277579 wait complete. 2024-04-24T23:59:34.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.870+0000 7f2a08400640 1 Processor -- start 2024-04-24T23:59:34.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.870+0000 7f2a08400640 1 -- start start 2024-04-24T23:59:34.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.871+0000 7f2a08400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0006c0d0 0x7f2a001481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.871+0000 7f2a08400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000720e0 0x7f2a0006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.871+0000 7f2a08400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a0015d290 0x7f2a000cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.871+0000 7f2a08400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00156880 con 0x7f2a0006c0d0 2024-04-24T23:59:34.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.871+0000 7f2a08400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0006ff50 con 0x7f2a000720e0 2024-04-24T23:59:34.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.871+0000 7f2a08400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2a00156a00 con 0x7f2a0015d290 2024-04-24T23:59:34.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.871+0000 7f2a05a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0006c0d0 0x7f2a001481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a05a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0006c0d0 0x7f2a001481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60206/0 (socket says 172.21.15.96:60206) 2024-04-24T23:59:34.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a05a00640 1 -- 172.21.15.96:0/3289090989 learned_addr learned my addr 172.21.15.96:0/3289090989 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:34.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a06400640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a0015d290 0x7f2a000cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a05a00640 1 -- 172.21.15.96:0/3289090989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a0015d290 msgr2=0x7f2a000cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:34.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a05a00640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a0015d290 0x7f2a000cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a05a00640 1 -- 172.21.15.96:0/3289090989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000720e0 msgr2=0x7f2a0006d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:34.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a05a00640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000720e0 0x7f2a0006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:34.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a05a00640 1 -- 172.21.15.96:0/3289090989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a000b4b50 con 0x7f2a0006c0d0 2024-04-24T23:59:34.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a06400640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a0015d290 0x7f2a000cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:34.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.872+0000 7f2a05a00640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0006c0d0 0x7f2a001481c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c430 tx=0x7f29f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:34.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.873+0000 7f29fd600640 1 -- 172.21.15.96:0/3289090989 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00074e0 con 0x7f2a0006c0d0 2024-04-24T23:59:34.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.873+0000 7f29fd600640 1 -- 172.21.15.96:0/3289090989 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f0007680 con 0x7f2a0006c0d0 2024-04-24T23:59:34.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.873+0000 7f29fd600640 1 -- 172.21.15.96:0/3289090989 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0004a00 con 0x7f2a0006c0d0 2024-04-24T23:59:34.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.873+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a000b4e30 con 0x7f2a0006c0d0 2024-04-24T23:59:34.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.873+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0014f6e0 con 0x7f2a0006c0d0 2024-04-24T23:59:34.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.874+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a00069110 con 0x7f2a0006c0d0 2024-04-24T23:59:34.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.875+0000 7f29fd600640 1 -- 172.21.15.96:0/3289090989 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f29f001a020 con 0x7f2a0006c0d0 2024-04-24T23:59:34.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.876+0000 7f29fd600640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29e006bfe0 0x7f29e006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:34.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.876+0000 7f29fd600640 1 -- 172.21.15.96:0/3289090989 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f29f008aa20 con 0x7f2a0006c0d0 2024-04-24T23:59:34.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.876+0000 7f2a05000640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29e006bfe0 0x7f29e006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:34.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.877+0000 7f2a05000640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29e006bfe0 0x7f29e006e4a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29ec033000 tx=0x7f29ec02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:34.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:34.880+0000 7f29fd600640 1 -- 172.21.15.96:0/3289090989 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f29f00590b0 con 0x7f2a0006c0d0 2024-04-24T23:59:35.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.077+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a0014f020 con 0x7f2a0006c0d0 2024-04-24T23:59:35.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.078+0000 7f29fd600640 1 -- 172.21.15.96:0/3289090989 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7f29f00589b0 con 0x7f2a0006c0d0 2024-04-24T23:59:35.079 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:59:35.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29e006bfe0 msgr2=0x7f29e006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29e006bfe0 0x7f29e006e4a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29ec033000 tx=0x7f29ec02e000 comp rx=0 tx=0).stop 2024-04-24T23:59:35.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0006c0d0 msgr2=0x7f2a001481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0006c0d0 0x7f2a001481c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c430 tx=0x7f29f000c8f0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 shutdown_connections 2024-04-24T23:59:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a0015d290 0x7f2a000cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000720e0 0x7f2a0006d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f29e006bfe0 0x7f29e006e4a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 --2- 172.21.15.96:0/3289090989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a0006c0d0 0x7f2a001481c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 >> 172.21.15.96:0/3289090989 conn(0x7f2a000715c0 msgr2=0x7f2a0014a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 shutdown_connections 2024-04-24T23:59:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.081+0000 7f2a08400640 1 -- 172.21.15.96:0/3289090989 wait complete. 2024-04-24T23:59:35.099 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:59:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.304+0000 7ff119200640 1 Processor -- start 2024-04-24T23:59:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.305+0000 7ff119200640 1 -- start start 2024-04-24T23:59:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.306+0000 7ff119200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff11415e2f0 0x7ff1140d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.306+0000 7ff119200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff1140d4bc0 0x7ff1140cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.306+0000 7ff119200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1140d1900 con 0x7ff1140cef50 2024-04-24T23:59:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.306+0000 7ff119200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff1140cf890 con 0x7ff1140d4bc0 2024-04-24T23:59:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.306+0000 7ff119200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff1140cfb70 con 0x7ff11415e2f0 2024-04-24T23:59:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.306+0000 7ff112a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff1140d4bc0 0x7ff1140cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.306+0000 7ff112a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff1140d4bc0 0x7ff1140cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60212/0 (socket says 172.21.15.96:60212) 2024-04-24T23:59:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.306+0000 7ff112a00640 1 -- 172.21.15.96:0/3092007625 learned_addr learned my addr 172.21.15.96:0/3092007625 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.307+0000 7ff113400640 1 --2- 172.21.15.96:0/3092007625 >> v2:172.21.15.155:3300/0 conn(0x7ff11415e2f0 0x7ff1140d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.307+0000 7ff112a00640 1 -- 172.21.15.96:0/3092007625 >> v2:172.21.15.155:3300/0 conn(0x7ff11415e2f0 msgr2=0x7ff1140d4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.307+0000 7ff112a00640 1 --2- 172.21.15.96:0/3092007625 >> v2:172.21.15.155:3300/0 conn(0x7ff11415e2f0 0x7ff1140d4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.307+0000 7ff112a00640 1 -- 172.21.15.96:0/3092007625 >> v1:172.21.15.155:6789/0 conn(0x7ff1140cef50 legacy=0x7ff1140d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.307+0000 7ff112a00640 1 -- 172.21.15.96:0/3092007625 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1140b3660 con 0x7ff1140d4bc0 2024-04-24T23:59:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.308+0000 7ff112a00640 1 --2- 172.21.15.96:0/3092007625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140d4bc0 0x7ff1140cea10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff11408c650 tx=0x7ff10402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb444cfdf5773d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.308+0000 7ff112000640 1 -- 172.21.15.96:0/3092007625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff104036070 con 0x7ff1140d4bc0 2024-04-24T23:59:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.308+0000 7ff112000640 1 -- 172.21.15.96:0/3092007625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff104031600 con 0x7ff1140d4bc0 2024-04-24T23:59:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.308+0000 7ff112000640 1 -- 172.21.15.96:0/3092007625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1040319d0 con 0x7ff1140d4bc0 2024-04-24T23:59:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.309+0000 7ff119200640 1 -- 172.21.15.96:0/3092007625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140d4bc0 msgr2=0x7ff1140cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.309+0000 7ff119200640 1 --2- 172.21.15.96:0/3092007625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140d4bc0 0x7ff1140cea10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff11408c650 tx=0x7ff10402a660 comp rx=0 tx=0).stop 2024-04-24T23:59:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.309+0000 7ff119200640 1 -- 172.21.15.96:0/3092007625 shutdown_connections 2024-04-24T23:59:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.309+0000 7ff119200640 1 --2- 172.21.15.96:0/3092007625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140d4bc0 0x7ff1140cea10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.309+0000 7ff119200640 1 --2- 172.21.15.96:0/3092007625 >> v2:172.21.15.155:3300/0 conn(0x7ff11415e2f0 0x7ff1140d4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.309+0000 7ff119200640 1 -- 172.21.15.96:0/3092007625 >> 172.21.15.96:0/3092007625 conn(0x7ff11409d260 msgr2=0x7ff1140d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:35.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.309+0000 7ff119200640 1 -- 172.21.15.96:0/3092007625 shutdown_connections 2024-04-24T23:59:35.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.309+0000 7ff119200640 1 -- 172.21.15.96:0/3092007625 wait complete. 2024-04-24T23:59:35.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.311+0000 7ff119200640 1 Processor -- start 2024-04-24T23:59:35.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.311+0000 7ff119200640 1 -- start start 2024-04-24T23:59:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff119200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140cef50 0x7ff114161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff119200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1140d4bc0 0x7ff1140cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff119200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11415e2f0 0x7ff1140cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff119200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff11415e850 con 0x7ff1140cef50 2024-04-24T23:59:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff119200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff11415e6d0 con 0x7ff11415e2f0 2024-04-24T23:59:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff119200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1140cf3a0 con 0x7ff1140d4bc0 2024-04-24T23:59:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff113400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140cef50 0x7ff114161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff113400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140cef50 0x7ff114161590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60226/0 (socket says 172.21.15.96:60226) 2024-04-24T23:59:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff113400640 1 -- 172.21.15.96:0/76033066 learned_addr learned my addr 172.21.15.96:0/76033066 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff113e00640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11415e2f0 0x7ff1140cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff113400640 1 -- 172.21.15.96:0/76033066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1140d4bc0 msgr2=0x7ff1140cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff113400640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1140d4bc0 0x7ff1140cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff113400640 1 -- 172.21.15.96:0/76033066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11415e2f0 msgr2=0x7ff1140cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff113400640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11415e2f0 0x7ff1140cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.312+0000 7ff113400640 1 -- 172.21.15.96:0/76033066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1140b91d0 con 0x7ff1140cef50 2024-04-24T23:59:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.313+0000 7ff113400640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140cef50 0x7ff114161590 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00d5f0 tx=0x7ff0fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.313+0000 7ff10b400640 1 -- 172.21.15.96:0/76033066 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0125f0 con 0x7ff1140cef50 2024-04-24T23:59:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.313+0000 7ff10b400640 1 -- 172.21.15.96:0/76033066 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc019070 con 0x7ff1140cef50 2024-04-24T23:59:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.313+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1140b94b0 con 0x7ff1140cef50 2024-04-24T23:59:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.313+0000 7ff10b400640 1 -- 172.21.15.96:0/76033066 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0129d0 con 0x7ff1140cef50 2024-04-24T23:59:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.313+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1140cddb0 con 0x7ff1140cef50 2024-04-24T23:59:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.314+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1140755d0 con 0x7ff1140cef50 2024-04-24T23:59:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.315+0000 7ff10b400640 1 -- 172.21.15.96:0/76033066 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff0fc012b70 con 0x7ff1140cef50 2024-04-24T23:59:35.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.316+0000 7ff10b400640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0f006bfe0 0x7ff0f006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.316+0000 7ff10b400640 1 -- 172.21.15.96:0/76033066 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff0fc08b620 con 0x7ff1140cef50 2024-04-24T23:59:35.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.316+0000 7ff112a00640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0f006bfe0 0x7ff0f006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:35.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.317+0000 7ff112a00640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0f006bfe0 0x7ff0f006e4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff104033000 tx=0x7ff10402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:35.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.321+0000 7ff10b400640 1 -- 172.21.15.96:0/76033066 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff0fc059cb0 con 0x7ff1140cef50 2024-04-24T23:59:35.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.521+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff1140ce280 con 0x7ff1140cef50 2024-04-24T23:59:35.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.522+0000 7ff10b400640 1 -- 172.21.15.96:0/76033066 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7ff0fc0595b0 con 0x7ff1140cef50 2024-04-24T23:59:35.522 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:59:35.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.524+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0f006bfe0 msgr2=0x7ff0f006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.524+0000 7ff119200640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0f006bfe0 0x7ff0f006e4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff104033000 tx=0x7ff10402e000 comp rx=0 tx=0).stop 2024-04-24T23:59:35.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.524+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140cef50 msgr2=0x7ff114161590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.524+0000 7ff119200640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140cef50 0x7ff114161590 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00d5f0 tx=0x7ff0fc00dab0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.525+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 shutdown_connections 2024-04-24T23:59:35.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.525+0000 7ff119200640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11415e2f0 0x7ff1140cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.525+0000 7ff119200640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1140d4bc0 0x7ff1140cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.525+0000 7ff119200640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff0f006bfe0 0x7ff0f006e4a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.525+0000 7ff119200640 1 --2- 172.21.15.96:0/76033066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1140cef50 0x7ff114161590 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.525+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 >> 172.21.15.96:0/76033066 conn(0x7ff11409d260 msgr2=0x7ff1140b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:35.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.525+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 shutdown_connections 2024-04-24T23:59:35.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.525+0000 7ff119200640 1 -- 172.21.15.96:0/76033066 wait complete. 2024-04-24T23:59:35.544 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:59:35.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.742+0000 7f4397e00640 1 Processor -- start 2024-04-24T23:59:35.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.742+0000 7f4397e00640 1 -- start start 2024-04-24T23:59:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.743+0000 7f4397e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f43980b3c30 0x7f4398071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f4397e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43980b40d0 con 0x7f439815a5d0 2024-04-24T23:59:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f4397e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439815a9b0 con 0x7f439806d9c0 2024-04-24T23:59:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f4397e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4398070e40 con 0x7f43980b3c30 2024-04-24T23:59:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f4396a00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f439815a5d0 0x7f439806d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32902/0 (socket says 172.21.15.96:32902) 2024-04-24T23:59:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f4396a00640 1 -- 172.21.15.96:0/371336543 learned_addr learned my addr 172.21.15.96:0/371336543 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f438e000640 1 --2- 172.21.15.96:0/371336543 >> v2:172.21.15.96:3300/0 conn(0x7f43980b3c30 0x7f4398071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f438e000640 1 -- 172.21.15.96:0/371336543 >> v1:172.21.15.155:6789/0 conn(0x7f439806d9c0 legacy=0x7f4398072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f438e000640 1 -- 172.21.15.96:0/371336543 >> v1:172.21.15.96:6789/0 conn(0x7f439815a5d0 legacy=0x7f439806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f438e000640 1 -- 172.21.15.96:0/371336543 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4398071120 con 0x7f43980b3c30 2024-04-24T23:59:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.744+0000 7f4396000640 1 -- 172.21.15.96:0/371336543 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195824950 0 0) 0x7f4388001110 con 0x7f439815a5d0 2024-04-24T23:59:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.745+0000 7f438e000640 1 --2- 172.21.15.96:0/371336543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43980b3c30 0x7f4398071c00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f438000a940 tx=0x7f438002b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a39124b48fe65 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.746+0000 7f4396000640 1 -- 172.21.15.96:0/371336543 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438000b040 con 0x7f43980b3c30 2024-04-24T23:59:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.746+0000 7f4396000640 1 -- 172.21.15.96:0/371336543 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4380030710 con 0x7f43980b3c30 2024-04-24T23:59:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.746+0000 7f4396000640 1 -- 172.21.15.96:0/371336543 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4380030ae0 con 0x7f43980b3c30 2024-04-24T23:59:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.746+0000 7f4397e00640 1 -- 172.21.15.96:0/371336543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43980b3c30 msgr2=0x7f4398071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.746+0000 7f4397e00640 1 --2- 172.21.15.96:0/371336543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43980b3c30 0x7f4398071c00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f438000a940 tx=0x7f438002b510 comp rx=0 tx=0).stop 2024-04-24T23:59:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.746+0000 7f4397e00640 1 -- 172.21.15.96:0/371336543 shutdown_connections 2024-04-24T23:59:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.746+0000 7f4397e00640 1 --2- 172.21.15.96:0/371336543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43980b3c30 0x7f4398071c00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.746+0000 7f4397e00640 1 -- 172.21.15.96:0/371336543 >> 172.21.15.96:0/371336543 conn(0x7f43980b18b0 msgr2=0x7f43980b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.747+0000 7f4397e00640 1 -- 172.21.15.96:0/371336543 shutdown_connections 2024-04-24T23:59:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.747+0000 7f4397e00640 1 -- 172.21.15.96:0/371336543 wait complete. 2024-04-24T23:59:35.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.748+0000 7f4397e00640 1 Processor -- start 2024-04-24T23:59:35.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.748+0000 7f4397e00640 1 -- start start 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.749+0000 7f4397e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439806d9c0 0x7f4398145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.749+0000 7f4397e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43980b3c30 0x7f43981529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.749+0000 7f4397e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f439815a5d0 0x7f43981510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.749+0000 7f4397e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f439806e180 con 0x7f439806d9c0 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.749+0000 7f4397e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f439806e000 con 0x7f43980b3c30 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.749+0000 7f4397e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f43980b2d40 con 0x7f439815a5d0 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.749+0000 7f4396a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439806d9c0 0x7f4398145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f4396a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439806d9c0 0x7f4398145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60246/0 (socket says 172.21.15.96:60246) 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f4396a00640 1 -- 172.21.15.96:0/1417879496 learned_addr learned my addr 172.21.15.96:0/1417879496 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f4396a00640 1 -- 172.21.15.96:0/1417879496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f439815a5d0 msgr2=0x7f43981510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f4396a00640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f439815a5d0 0x7f43981510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f4396a00640 1 -- 172.21.15.96:0/1417879496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43980b3c30 msgr2=0x7f43981529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f4396a00640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43980b3c30 0x7f43981529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f4396a00640 1 -- 172.21.15.96:0/1417879496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4398152f00 con 0x7f439806d9c0 2024-04-24T23:59:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f4396a00640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439806d9c0 0x7f4398145a90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f438800c460 tx=0x7f438800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f438f400640 1 -- 172.21.15.96:0/1417879496 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388018070 con 0x7f439806d9c0 2024-04-24T23:59:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f438f400640 1 -- 172.21.15.96:0/1417879496 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388007500 con 0x7f439806d9c0 2024-04-24T23:59:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.750+0000 7f438f400640 1 -- 172.21.15.96:0/1417879496 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388004a20 con 0x7f439806d9c0 2024-04-24T23:59:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.751+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43981531d0 con 0x7f439806d9c0 2024-04-24T23:59:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.751+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4398153790 con 0x7f439806d9c0 2024-04-24T23:59:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.752+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43980b4e30 con 0x7f439806d9c0 2024-04-24T23:59:35.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.753+0000 7f438f400640 1 -- 172.21.15.96:0/1417879496 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f438801b070 con 0x7f439806d9c0 2024-04-24T23:59:35.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.754+0000 7f438f400640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f437406bfe0 0x7f437406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:35.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.754+0000 7f438f400640 1 -- 172.21.15.96:0/1417879496 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f438808a430 con 0x7f439806d9c0 2024-04-24T23:59:35.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.754+0000 7f438e000640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f437406bfe0 0x7f437406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.755+0000 7f438e000640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f437406bfe0 0x7f437406e4a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4380035000 tx=0x7f438002f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:35.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.758+0000 7f438f400640 1 -- 172.21.15.96:0/1417879496 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f43980b4e30 con 0x7f439806d9c0 2024-04-24T23:59:35.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.954+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f43980755d0 con 0x7f439806d9c0 2024-04-24T23:59:35.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.955+0000 7f438f400640 1 -- 172.21.15.96:0/1417879496 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f43980b40d0 con 0x7f439806d9c0 2024-04-24T23:59:35.955 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f437406bfe0 msgr2=0x7f437406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f437406bfe0 0x7f437406e4a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4380035000 tx=0x7f438002f000 comp rx=0 tx=0).stop 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439806d9c0 msgr2=0x7f4398145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439806d9c0 0x7f4398145a90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f438800c460 tx=0x7f438800c920 comp rx=0 tx=0).stop 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 shutdown_connections 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f439815a5d0 0x7f43981510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43980b3c30 0x7f43981529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f437406bfe0 0x7f437406e4a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 --2- 172.21.15.96:0/1417879496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439806d9c0 0x7f4398145a90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.957+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 >> 172.21.15.96:0/1417879496 conn(0x7f43980b18b0 msgr2=0x7f43980af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:35.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.958+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 shutdown_connections 2024-04-24T23:59:35.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:35.958+0000 7f4397e00640 1 -- 172.21.15.96:0/1417879496 wait complete. 2024-04-24T23:59:35.976 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:59:36.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.176+0000 7f23a8c00640 1 Processor -- start 2024-04-24T23:59:36.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.176+0000 7f23a8c00640 1 -- start start 2024-04-24T23:59:36.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.177+0000 7f23a8c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a415f6b0 0x7f23a40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.177+0000 7f23a8c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f23a40b4ec0 0x7f23a40cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f23a8c00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a415fa90 con 0x7f23a40ccc20 2024-04-24T23:59:36.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f23a8c00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f23a40b4a30 con 0x7f23a40b4ec0 2024-04-24T23:59:36.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f23a8c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f23a40b3e20 con 0x7f23a415f6b0 2024-04-24T23:59:36.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f239be00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f23a40b4ec0 0x7f23a40cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:36.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f23a3e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f23a40ccc20 0x7f23a415fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:32918/0 (socket says 172.21.15.96:32918) 2024-04-24T23:59:36.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f23a3e00640 1 -- 172.21.15.96:0/4257340635 learned_addr learned my addr 172.21.15.96:0/4257340635 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:36.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f239be00640 1 -- 172.21.15.96:0/4257340635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a415f6b0 msgr2=0x7f23a40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:36.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f239be00640 1 --2- 172.21.15.96:0/4257340635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a415f6b0 0x7f23a40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f239be00640 1 -- 172.21.15.96:0/4257340635 >> v1:172.21.15.96:6789/0 conn(0x7f23a40ccc20 legacy=0x7f23a415fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f239be00640 1 -- 172.21.15.96:0/4257340635 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a40b4100 con 0x7f23a40b4ec0 2024-04-24T23:59:36.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.178+0000 7f23a2a00640 1 -- 172.21.15.96:0/4257340635 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679428773 0 0) 0x7f23a415fa90 con 0x7f23a40ccc20 2024-04-24T23:59:36.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.179+0000 7f239be00640 1 --2- 172.21.15.96:0/4257340635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40b4ec0 0x7f23a40cc6e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f238c0097a0 tx=0x7f238c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e221ccb6a98a4a58 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a2a00640 1 -- 172.21.15.96:0/4257340635 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c037070 con 0x7f23a40b4ec0 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a2a00640 1 -- 172.21.15.96:0/4257340635 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c032440 con 0x7f23a40b4ec0 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a2a00640 1 -- 172.21.15.96:0/4257340635 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c032810 con 0x7f23a40b4ec0 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a8c00640 1 -- 172.21.15.96:0/4257340635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40b4ec0 msgr2=0x7f23a40cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a8c00640 1 --2- 172.21.15.96:0/4257340635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40b4ec0 0x7f23a40cc6e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f238c0097a0 tx=0x7f238c02a180 comp rx=0 tx=0).stop 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a8c00640 1 -- 172.21.15.96:0/4257340635 shutdown_connections 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a8c00640 1 --2- 172.21.15.96:0/4257340635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40b4ec0 0x7f23a40cc6e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a8c00640 1 --2- 172.21.15.96:0/4257340635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a415f6b0 0x7f23a40ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a8c00640 1 -- 172.21.15.96:0/4257340635 >> 172.21.15.96:0/4257340635 conn(0x7f23a40b1f10 msgr2=0x7f23a40cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a8c00640 1 -- 172.21.15.96:0/4257340635 shutdown_connections 2024-04-24T23:59:36.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.180+0000 7f23a8c00640 1 -- 172.21.15.96:0/4257340635 wait complete. 2024-04-24T23:59:36.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.182+0000 7f23a8c00640 1 Processor -- start 2024-04-24T23:59:36.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.182+0000 7f23a8c00640 1 -- start start 2024-04-24T23:59:36.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.183+0000 7f23a8c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a40b4ec0 0x7f23a4158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.183+0000 7f23a8c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a40ccc20 0x7f23a409b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.183+0000 7f23a8c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a415f6b0 0x7f23a40acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.183+0000 7f23a8c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f23a40ceb20 con 0x7f23a415f6b0 2024-04-24T23:59:36.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.183+0000 7f23a8c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23a40b46c0 con 0x7f23a40b4ec0 2024-04-24T23:59:36.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.183+0000 7f23a8c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f23a40cf1c0 con 0x7f23a40ccc20 2024-04-24T23:59:36.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f23a3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a415f6b0 0x7f23a40acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:36.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f23a3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a415f6b0 0x7f23a40acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60276/0 (socket says 172.21.15.96:60276) 2024-04-24T23:59:36.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f23a3e00640 1 -- 172.21.15.96:0/388181431 learned_addr learned my addr 172.21.15.96:0/388181431 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:36.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f23a3e00640 1 -- 172.21.15.96:0/388181431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a40ccc20 msgr2=0x7f23a409b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f23a3e00640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a40ccc20 0x7f23a409b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f23a3e00640 1 -- 172.21.15.96:0/388181431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a40b4ec0 msgr2=0x7f23a4158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f23a3e00640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a40b4ec0 0x7f23a4158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f23a3e00640 1 -- 172.21.15.96:0/388181431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a40c9100 con 0x7f23a415f6b0 2024-04-24T23:59:36.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f23a3e00640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a415f6b0 0x7f23a40acec0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f239c00c7a0 tx=0x7f239c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:36.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.184+0000 7f239b400640 1 -- 172.21.15.96:0/388181431 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c018070 con 0x7f23a415f6b0 2024-04-24T23:59:36.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.185+0000 7f239b400640 1 -- 172.21.15.96:0/388181431 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239c00a640 con 0x7f23a415f6b0 2024-04-24T23:59:36.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.185+0000 7f239b400640 1 -- 172.21.15.96:0/388181431 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c00aab0 con 0x7f23a415f6b0 2024-04-24T23:59:36.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.185+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a40c93e0 con 0x7f23a415f6b0 2024-04-24T23:59:36.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.185+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a40c99a0 con 0x7f23a415f6b0 2024-04-24T23:59:36.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.186+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a4067e40 con 0x7f23a415f6b0 2024-04-24T23:59:36.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.187+0000 7f239b400640 1 -- 172.21.15.96:0/388181431 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f239c00ac50 con 0x7f23a415f6b0 2024-04-24T23:59:36.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.188+0000 7f239b400640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f238006bfe0 0x7f238006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.188+0000 7f239b400640 1 -- 172.21.15.96:0/388181431 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f239c08a760 con 0x7f23a415f6b0 2024-04-24T23:59:36.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.188+0000 7f23a3400640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f238006bfe0 0x7f238006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:36.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.188+0000 7f23a3400640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f238006bfe0 0x7f238006e4a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2394009710 tx=0x7f2394006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:36.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.192+0000 7f239b400640 1 -- 172.21.15.96:0/388181431 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f239c058f20 con 0x7f23a415f6b0 2024-04-24T23:59:36.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.405+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f23a40d07d0 con 0x7f23a415f6b0 2024-04-24T23:59:36.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.406+0000 7f239b400640 1 -- 172.21.15.96:0/388181431 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f239c058820 con 0x7f23a415f6b0 2024-04-24T23:59:36.406 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-24T23:59:36.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.408+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f238006bfe0 msgr2=0x7f238006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.408+0000 7f23a8c00640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f238006bfe0 0x7f238006e4a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2394009710 tx=0x7f2394006c90 comp rx=0 tx=0).stop 2024-04-24T23:59:36.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.408+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a415f6b0 msgr2=0x7f23a40acec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.408+0000 7f23a8c00640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a415f6b0 0x7f23a40acec0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f239c00c7a0 tx=0x7f239c00cc60 comp rx=0 tx=0).stop 2024-04-24T23:59:36.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.409+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 shutdown_connections 2024-04-24T23:59:36.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.409+0000 7f23a8c00640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f238006bfe0 0x7f238006e4a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.409+0000 7f23a8c00640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a415f6b0 0x7f23a40acec0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.409+0000 7f23a8c00640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a40ccc20 0x7f23a409b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.409+0000 7f23a8c00640 1 --2- 172.21.15.96:0/388181431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a40b4ec0 0x7f23a4158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.409+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 >> 172.21.15.96:0/388181431 conn(0x7f23a40b1f10 msgr2=0x7f23a40d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:36.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.409+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 shutdown_connections 2024-04-24T23:59:36.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.409+0000 7f23a8c00640 1 -- 172.21.15.96:0/388181431 wait complete. 2024-04-24T23:59:36.426 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:59:36.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:36.426 DEBUG:teuthology.orchestra.run.smithi096:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-24T23:59:36.521 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-04-24T23:59:36.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:36.521 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:59:36.570 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:59:36.570 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:59:36.570 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:36.626 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:59:36.626 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:36.678 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:36.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.887+0000 7f8bad400640 1 Processor -- start 2024-04-24T23:59:36.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.887+0000 7f8bad400640 1 -- start start 2024-04-24T23:59:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.888+0000 7f8bad400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8ba815e480 0x7f8ba80cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.888+0000 7f8bad400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba806cc10 con 0x7f8ba80b2be0 2024-04-24T23:59:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.888+0000 7f8bad400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba806cef0 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.888+0000 7f8bad400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba8073060 con 0x7f8ba815e480 2024-04-24T23:59:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.889+0000 7f8ba7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8ba815e480 0x7f8ba80cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.889+0000 7f8ba7e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8ba815e480 0x7f8ba80cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51320/0 (socket says 172.21.15.96:51320) 2024-04-24T23:59:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.889+0000 7f8ba7e00640 1 -- 172.21.15.96:0/3756885978 learned_addr learned my addr 172.21.15.96:0/3756885978 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:36.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.889+0000 7f8ba7e00640 1 -- 172.21.15.96:0/3756885978 >> v1:172.21.15.155:6789/0 conn(0x7f8ba80cc6e0 legacy=0x7f8ba806d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:36.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.889+0000 7f8ba7e00640 1 -- 172.21.15.96:0/3756885978 >> v1:172.21.15.96:6789/0 conn(0x7f8ba80b2be0 legacy=0x7f8ba8072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.889+0000 7f8ba7e00640 1 -- 172.21.15.96:0/3756885978 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba806d1d0 con 0x7f8ba815e480 2024-04-24T23:59:36.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.890+0000 7f8ba7e00640 1 --2- 172.21.15.96:0/3756885978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba815e480 0x7f8ba80cf670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009870 tx=0x7f8b9802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54be672bee143fe server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:36.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.890+0000 7f8ba6a00640 1 -- 172.21.15.96:0/3756885978 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98037070 con 0x7f8ba815e480 2024-04-24T23:59:36.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.891+0000 7f8ba6a00640 1 -- 172.21.15.96:0/3756885978 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b98032440 con 0x7f8ba815e480 2024-04-24T23:59:36.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.891+0000 7f8ba6a00640 1 -- 172.21.15.96:0/3756885978 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98032810 con 0x7f8ba815e480 2024-04-24T23:59:36.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.891+0000 7f8bad400640 1 -- 172.21.15.96:0/3756885978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba815e480 msgr2=0x7f8ba80cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.891+0000 7f8bad400640 1 --2- 172.21.15.96:0/3756885978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba815e480 0x7f8ba80cf670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009870 tx=0x7f8b9802a210 comp rx=0 tx=0).stop 2024-04-24T23:59:36.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.891+0000 7f8bad400640 1 -- 172.21.15.96:0/3756885978 shutdown_connections 2024-04-24T23:59:36.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.891+0000 7f8bad400640 1 --2- 172.21.15.96:0/3756885978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba815e480 0x7f8ba80cf670 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.891+0000 7f8bad400640 1 -- 172.21.15.96:0/3756885978 >> 172.21.15.96:0/3756885978 conn(0x7f8ba80b1f10 msgr2=0x7f8ba80cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:36.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.891+0000 7f8bad400640 1 -- 172.21.15.96:0/3756885978 shutdown_connections 2024-04-24T23:59:36.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.891+0000 7f8bad400640 1 -- 172.21.15.96:0/3756885978 wait complete. 2024-04-24T23:59:36.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.893+0000 7f8bad400640 1 Processor -- start 2024-04-24T23:59:36.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.893+0000 7f8bad400640 1 -- start start 2024-04-24T23:59:36.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.894+0000 7f8bad400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ba80b2be0 0x7f8ba8151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.894+0000 7f8bad400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba80cc6e0 0x7f8ba80acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.894+0000 7f8bad400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ba815e480 0x7f8ba80ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.894+0000 7f8bad400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba80cccd0 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.894+0000 7f8bad400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba80ccb50 con 0x7f8ba80b2be0 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.894+0000 7f8bad400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba80cce50 con 0x7f8ba815e480 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.894+0000 7f8ba7400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba80cc6e0 0x7f8ba80acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.894+0000 7f8ba7400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba80cc6e0 0x7f8ba80acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51332/0 (socket says 172.21.15.96:51332) 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.894+0000 7f8ba7400640 1 -- 172.21.15.96:0/1266750251 learned_addr learned my addr 172.21.15.96:0/1266750251 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8ba7400640 1 -- 172.21.15.96:0/1266750251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ba815e480 msgr2=0x7f8ba80ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8ba7400640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ba815e480 0x7f8ba80ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8ba7e00640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ba80b2be0 0x7f8ba8151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8ba7400640 1 -- 172.21.15.96:0/1266750251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ba80b2be0 msgr2=0x7f8ba8151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8ba7400640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ba80b2be0 0x7f8ba8151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8ba7400640 1 -- 172.21.15.96:0/1266750251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba815f240 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8ba7400640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba80cc6e0 0x7f8ba80acda0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000c470 tx=0x7f8b90001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8b9fe00640 1 -- 172.21.15.96:0/1266750251 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b900052d0 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8b9fe00640 1 -- 172.21.15.96:0/1266750251 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b90005470 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8b9fe00640 1 -- 172.21.15.96:0/1266750251 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90007260 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.895+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba80ad4a0 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.896+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba80ada60 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.897+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba8067e40 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.898+0000 7f8b9fe00640 1 -- 172.21.15.96:0/1266750251 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f8b90007400 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.898+0000 7f8b9fe00640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8b8406c010 0x7f8b8406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:36.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.899+0000 7f8b9fe00640 1 -- 172.21.15.96:0/1266750251 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8b9008a740 con 0x7f8ba80cc6e0 2024-04-24T23:59:36.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.899+0000 7f8ba7e00640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8b8406c010 0x7f8b8406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:36.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.900+0000 7f8ba7e00640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8b8406c010 0x7f8b8406e4d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8b98034000 tx=0x7f8b9802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:36.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:36.903+0000 7f8b9fe00640 1 -- 172.21.15.96:0/1266750251 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8b90058dd0 con 0x7f8ba80cc6e0 2024-04-24T23:59:37.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.102+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ba80cf460 con 0x7f8ba80cc6e0 2024-04-24T23:59:37.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.105+0000 7f8b9fe00640 1 -- 172.21.15.96:0/1266750251 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16621 (secure 0 0 0) 0x7f8ba80cf460 con 0x7f8ba80cc6e0 2024-04-24T23:59:37.106 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:37.106 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":33,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:17.499374+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:59:13.640002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T23:59:14.952491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:37.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8b8406c010 msgr2=0x7f8b8406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8b8406c010 0x7f8b8406e4d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8b98034000 tx=0x7f8b9802e000 comp rx=0 tx=0).stop 2024-04-24T23:59:37.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba80cc6e0 msgr2=0x7f8ba80acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba80cc6e0 0x7f8ba80acda0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000c470 tx=0x7f8b90001e70 comp rx=0 tx=0).stop 2024-04-24T23:59:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 shutdown_connections 2024-04-24T23:59:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ba815e480 0x7f8ba80ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f8b8406c010 0x7f8b8406e4d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ba80cc6e0 0x7f8ba80acda0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 --2- 172.21.15.96:0/1266750251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ba80b2be0 0x7f8ba8151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 >> 172.21.15.96:0/1266750251 conn(0x7f8ba80b1f10 msgr2=0x7f8ba80cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 shutdown_connections 2024-04-24T23:59:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.108+0000 7f8bad400640 1 -- 172.21.15.96:0/1266750251 wait complete. 2024-04-24T23:59:37.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:59:13.640002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:59:14.952491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:59:37.132 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:59:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.325+0000 7fe6b1400640 1 Processor -- start 2024-04-24T23:59:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.326+0000 7fe6b1400640 1 -- start start 2024-04-24T23:59:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.327+0000 7fe6b1400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6ac1617b0 0x7fe6ac0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.328+0000 7fe6b1400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ac0d15c0 con 0x7fe6ac0d4ab0 2024-04-24T23:59:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.328+0000 7fe6b1400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ac0d2610 con 0x7fe6ac161b90 2024-04-24T23:59:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.328+0000 7fe6b1400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ac0d2c60 con 0x7fe6ac1617b0 2024-04-24T23:59:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.328+0000 7fe6b0a00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe6ac0d4ab0 0x7fe6ac0b6dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54256/0 (socket says 172.21.15.96:54256) 2024-04-24T23:59:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.328+0000 7fe6b0a00640 1 -- 172.21.15.96:0/3456772604 learned_addr learned my addr 172.21.15.96:0/3456772604 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.328+0000 7fe6abe00640 1 --2- 172.21.15.96:0/3456772604 >> v2:172.21.15.155:3300/0 conn(0x7fe6ac1617b0 0x7fe6ac0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.328+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749429990 0 0) 0x7fe6ac0d15c0 con 0x7fe6ac0d4ab0 2024-04-24T23:59:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe690003520 con 0x7fe6ac0d4ab0 2024-04-24T23:59:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2772231132 0 0) 0x7fe690003520 con 0x7fe6ac0d4ab0 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 >> v2:172.21.15.155:3300/0 conn(0x7fe6ac1617b0 msgr2=0x7fe6ac0b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 --2- 172.21.15.96:0/3456772604 >> v2:172.21.15.155:3300/0 conn(0x7fe6ac1617b0 0x7fe6ac0b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 >> v1:172.21.15.155:6789/0 conn(0x7fe6ac161b90 legacy=0x7fe6ac0d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac0d28f0 con 0x7fe6ac0d4ab0 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fe6a40019f0 con 0x7fe6ac0d4ab0 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 >> v1:172.21.15.96:6789/0 conn(0x7fe6ac0d4ab0 legacy=0x7fe6ac0b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe690003a00 0x7fe690003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe690004800 0x7fe690004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6900051c0 0x7fe69000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac0d2c60 con 0x7fe690003a00 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe69000c0c0 con 0x7fe690004800 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe69000c2c0 con 0x7fe6900051c0 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.329+0000 7fe6abe00640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe690003a00 0x7fe690003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.330+0000 7fe6a3e00640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe690004800 0x7fe690004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.330+0000 7fe6abe00640 1 -- 172.21.15.96:0/3456772604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6900051c0 msgr2=0x7fe69000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.330+0000 7fe6abe00640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6900051c0 0x7fe69000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.330+0000 7fe6abe00640 1 -- 172.21.15.96:0/3456772604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe690004800 msgr2=0x7fe690004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.330+0000 7fe6abe00640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe690004800 0x7fe690004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.330+0000 7fe6abe00640 1 -- 172.21.15.96:0/3456772604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe690003520 con 0x7fe690003a00 2024-04-24T23:59:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.330+0000 7fe6a3e00640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe690004800 0x7fe690004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.330+0000 7fe6b0a00640 1 -- 172.21.15.96:0/3456772604 reap_dead start 2024-04-24T23:59:37.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.331+0000 7fe6abe00640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe690003a00 0x7fe690003e20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009ac0 tx=0x7fe690005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890ea09b9a6c5794 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:37.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.331+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c036070 con 0x7fe690003a00 2024-04-24T23:59:37.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.331+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69c031400 con 0x7fe690003a00 2024-04-24T23:59:37.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.331+0000 7fe6ab400640 1 -- 172.21.15.96:0/3456772604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c009690 con 0x7fe690003a00 2024-04-24T23:59:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.332+0000 7fe6b1400640 1 -- 172.21.15.96:0/3456772604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe690003a00 msgr2=0x7fe690003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.332+0000 7fe6b1400640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe690003a00 0x7fe690003e20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009ac0 tx=0x7fe690005830 comp rx=0 tx=0).stop 2024-04-24T23:59:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.332+0000 7fe6b1400640 1 -- 172.21.15.96:0/3456772604 shutdown_connections 2024-04-24T23:59:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.332+0000 7fe6b1400640 1 --2- 172.21.15.96:0/3456772604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe690003a00 0x7fe690003e20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.332+0000 7fe6b1400640 1 -- 172.21.15.96:0/3456772604 >> 172.21.15.96:0/3456772604 conn(0x7fe6ac0d3f90 msgr2=0x7fe6ac0d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.332+0000 7fe6b1400640 1 -- 172.21.15.96:0/3456772604 shutdown_connections 2024-04-24T23:59:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.332+0000 7fe6b1400640 1 -- 172.21.15.96:0/3456772604 wait complete. 2024-04-24T23:59:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.334+0000 7fe6b1400640 1 Processor -- start 2024-04-24T23:59:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.334+0000 7fe6b1400640 1 -- start start 2024-04-24T23:59:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.335+0000 7fe6b1400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe690003a00 0x7fe6ac0b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.335+0000 7fe6b1400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6ac1533b0 0x7fe6ac0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.335+0000 7fe6b1400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ac0ca2b0 0x7fe6ac0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.335+0000 7fe6b1400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac0b5020 con 0x7fe6ac1533b0 2024-04-24T23:59:37.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.335+0000 7fe6b1400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac0b4ea0 con 0x7fe6ac0ca2b0 2024-04-24T23:59:37.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.335+0000 7fe6b1400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac0b51a0 con 0x7fe690003a00 2024-04-24T23:59:37.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.335+0000 7fe6a3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6ac1533b0 0x7fe6ac0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.335+0000 7fe6a3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6ac1533b0 0x7fe6ac0c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51360/0 (socket says 172.21.15.96:51360) 2024-04-24T23:59:37.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.335+0000 7fe6a3e00640 1 -- 172.21.15.96:0/4152305745 learned_addr learned my addr 172.21.15.96:0/4152305745 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:37.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6b0a00640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ac0ca2b0 0x7fe6ac0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6abe00640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe690003a00 0x7fe6ac0b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6a3e00640 1 -- 172.21.15.96:0/4152305745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe690003a00 msgr2=0x7fe6ac0b9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6a3e00640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe690003a00 0x7fe6ac0b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6a3e00640 1 -- 172.21.15.96:0/4152305745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ac0ca2b0 msgr2=0x7fe6ac0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6a3e00640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ac0ca2b0 0x7fe6ac0cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6a3e00640 1 -- 172.21.15.96:0/4152305745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac1f75b0 con 0x7fe6ac1533b0 2024-04-24T23:59:37.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6a3e00640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6ac1533b0 0x7fe6ac0c9d70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe69400d540 tx=0x7fe69400da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:37.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6a8c00640 1 -- 172.21.15.96:0/4152305745 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694005480 con 0x7fe6ac1533b0 2024-04-24T23:59:37.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6a8c00640 1 -- 172.21.15.96:0/4152305745 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe694017070 con 0x7fe6ac1533b0 2024-04-24T23:59:37.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6a8c00640 1 -- 172.21.15.96:0/4152305745 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694003810 con 0x7fe6ac1533b0 2024-04-24T23:59:37.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac1f7890 con 0x7fe6ac1533b0 2024-04-24T23:59:37.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.336+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac1f7e50 con 0x7fe6ac1533b0 2024-04-24T23:59:37.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.338+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ac0755d0 con 0x7fe6ac1533b0 2024-04-24T23:59:37.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.339+0000 7fe6a8c00640 1 -- 172.21.15.96:0/4152305745 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fe6940039b0 con 0x7fe6ac1533b0 2024-04-24T23:59:37.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.340+0000 7fe6a8c00640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe68806bfe0 0x7fe68806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.340+0000 7fe6a8c00640 1 -- 172.21.15.96:0/4152305745 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe69408aff0 con 0x7fe6ac1533b0 2024-04-24T23:59:37.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.340+0000 7fe6abe00640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe68806bfe0 0x7fe68806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.341+0000 7fe6abe00640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe68806bfe0 0x7fe68806e4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe69c033000 tx=0x7fe69c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:37.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.345+0000 7fe6a8c00640 1 -- 172.21.15.96:0/4152305745 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe694019310 con 0x7fe6ac1533b0 2024-04-24T23:59:37.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.539+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe6ac0ca690 con 0x7fe6ac1533b0 2024-04-24T23:59:37.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.540+0000 7fe6a8c00640 1 -- 172.21.15.96:0/4152305745 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fe694059660 con 0x7fe6ac1533b0 2024-04-24T23:59:37.541 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:59:37.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe68806bfe0 msgr2=0x7fe68806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe68806bfe0 0x7fe68806e4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe69c033000 tx=0x7fe69c008030 comp rx=0 tx=0).stop 2024-04-24T23:59:37.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6ac1533b0 msgr2=0x7fe6ac0c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6ac1533b0 0x7fe6ac0c9d70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe69400d540 tx=0x7fe69400da00 comp rx=0 tx=0).stop 2024-04-24T23:59:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 shutdown_connections 2024-04-24T23:59:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6ac0ca2b0 0x7fe6ac0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe68806bfe0 0x7fe68806e4a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6ac1533b0 0x7fe6ac0c9d70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 --2- 172.21.15.96:0/4152305745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe690003a00 0x7fe6ac0b9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 >> 172.21.15.96:0/4152305745 conn(0x7fe6ac0d3f90 msgr2=0x7fe6ac06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 shutdown_connections 2024-04-24T23:59:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.543+0000 7fe6b1400640 1 -- 172.21.15.96:0/4152305745 wait complete. 2024-04-24T23:59:37.562 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:59:37.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.766+0000 7fd117800640 1 Processor -- start 2024-04-24T23:59:37.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.766+0000 7fd117800640 1 -- start start 2024-04-24T23:59:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.768+0000 7fd117800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11006edb0 0x7fd1100b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.768+0000 7fd117800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd1100b3200 0x7fd1100726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.768+0000 7fd117800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd11015f750 con 0x7fd1101551c0 2024-04-24T23:59:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.768+0000 7fd117800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd11015ef00 con 0x7fd1100b3200 2024-04-24T23:59:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.768+0000 7fd117800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd11015f190 con 0x7fd11006edb0 2024-04-24T23:59:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.768+0000 7fd114e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd1101551c0 0x7fd11015e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54270/0 (socket says 172.21.15.96:54270) 2024-04-24T23:59:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.768+0000 7fd114e00640 1 -- 172.21.15.96:0/3053846267 learned_addr learned my addr 172.21.15.96:0/3053846267 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.768+0000 7fd115800640 1 --2- 172.21.15.96:0/3053846267 >> v2:172.21.15.96:3300/0 conn(0x7fd1100b3200 0x7fd1100726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.768+0000 7fd10fe00640 1 --2- 172.21.15.96:0/3053846267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11006edb0 0x7fd1100b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.769+0000 7fd115800640 1 -- 172.21.15.96:0/3053846267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11006edb0 msgr2=0x7fd1100b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.769+0000 7fd115800640 1 --2- 172.21.15.96:0/3053846267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11006edb0 0x7fd1100b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.769+0000 7fd115800640 1 -- 172.21.15.96:0/3053846267 >> v1:172.21.15.96:6789/0 conn(0x7fd1101551c0 legacy=0x7fd11015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.769+0000 7fd115800640 1 -- 172.21.15.96:0/3053846267 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11015f470 con 0x7fd1100b3200 2024-04-24T23:59:37.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.770+0000 7fd115800640 1 --2- 172.21.15.96:0/3053846267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100b3200 0x7fd1100726d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd108009d90 tx=0x7fd10802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c86d24e9cad528 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:37.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.770+0000 7fd10f400640 1 -- 172.21.15.96:0/3053846267 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108031600 con 0x7fd1100b3200 2024-04-24T23:59:37.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.770+0000 7fd10f400640 1 -- 172.21.15.96:0/3053846267 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1080317a0 con 0x7fd1100b3200 2024-04-24T23:59:37.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.770+0000 7fd10f400640 1 -- 172.21.15.96:0/3053846267 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108031b70 con 0x7fd1100b3200 2024-04-24T23:59:37.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.771+0000 7fd117800640 1 -- 172.21.15.96:0/3053846267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100b3200 msgr2=0x7fd1100726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.771+0000 7fd117800640 1 --2- 172.21.15.96:0/3053846267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100b3200 0x7fd1100726d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd108009d90 tx=0x7fd10802a5d0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.771+0000 7fd117800640 1 -- 172.21.15.96:0/3053846267 shutdown_connections 2024-04-24T23:59:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.771+0000 7fd117800640 1 --2- 172.21.15.96:0/3053846267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100b3200 0x7fd1100726d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.771+0000 7fd117800640 1 --2- 172.21.15.96:0/3053846267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11006edb0 0x7fd1100b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.771+0000 7fd117800640 1 -- 172.21.15.96:0/3053846267 >> 172.21.15.96:0/3053846267 conn(0x7fd1100b19c0 msgr2=0x7fd1100b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.771+0000 7fd117800640 1 -- 172.21.15.96:0/3053846267 shutdown_connections 2024-04-24T23:59:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.771+0000 7fd117800640 1 -- 172.21.15.96:0/3053846267 wait complete. 2024-04-24T23:59:37.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.773+0000 7fd117800640 1 Processor -- start 2024-04-24T23:59:37.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.773+0000 7fd117800640 1 -- start start 2024-04-24T23:59:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.774+0000 7fd117800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd11006edb0 0x7fd11015f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.774+0000 7fd117800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1100b3200 0x7fd1100afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.774+0000 7fd117800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1101551c0 0x7fd110152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.774+0000 7fd117800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd1101555a0 con 0x7fd11006edb0 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.774+0000 7fd117800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd110071430 con 0x7fd1100b3200 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.774+0000 7fd117800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd110072c10 con 0x7fd1101551c0 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd114e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd11006edb0 0x7fd11015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd114e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd11006edb0 0x7fd11015f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51368/0 (socket says 172.21.15.96:51368) 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd114e00640 1 -- 172.21.15.96:0/2049947627 learned_addr learned my addr 172.21.15.96:0/2049947627 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd115800640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1101551c0 0x7fd110152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd10fe00640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1100b3200 0x7fd1100afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd114e00640 1 -- 172.21.15.96:0/2049947627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1101551c0 msgr2=0x7fd110152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd114e00640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1101551c0 0x7fd110152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd114e00640 1 -- 172.21.15.96:0/2049947627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1100b3200 msgr2=0x7fd1100afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd114e00640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1100b3200 0x7fd1100afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd114e00640 1 -- 172.21.15.96:0/2049947627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1101607e0 con 0x7fd11006edb0 2024-04-24T23:59:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.775+0000 7fd114e00640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd11006edb0 0x7fd11015f920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c3c0 tx=0x7fd10400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.776+0000 7fd10cc00640 1 -- 172.21.15.96:0/2049947627 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104017070 con 0x7fd11006edb0 2024-04-24T23:59:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.776+0000 7fd10cc00640 1 -- 172.21.15.96:0/2049947627 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd104005ce0 con 0x7fd11006edb0 2024-04-24T23:59:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.776+0000 7fd10cc00640 1 -- 172.21.15.96:0/2049947627 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1040072f0 con 0x7fd11006edb0 2024-04-24T23:59:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.776+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd110160220 con 0x7fd11006edb0 2024-04-24T23:59:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.776+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd110161030 con 0x7fd11006edb0 2024-04-24T23:59:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.777+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd110069110 con 0x7fd11006edb0 2024-04-24T23:59:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.778+0000 7fd10cc00640 1 -- 172.21.15.96:0/2049947627 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fd10401a070 con 0x7fd11006edb0 2024-04-24T23:59:37.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.779+0000 7fd10cc00640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0f006bfe0 0x7fd0f006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:37.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.779+0000 7fd10cc00640 1 -- 172.21.15.96:0/2049947627 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd10408a570 con 0x7fd11006edb0 2024-04-24T23:59:37.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.779+0000 7fd10fe00640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0f006bfe0 0x7fd0f006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:37.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.780+0000 7fd10fe00640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0f006bfe0 0x7fd0f006e4a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd1100cf700 tx=0x7fd0fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:37.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.783+0000 7fd10cc00640 1 -- 172.21.15.96:0/2049947627 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd104058c00 con 0x7fd11006edb0 2024-04-24T23:59:37.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.979+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd1100b4e00 con 0x7fd11006edb0 2024-04-24T23:59:37.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.980+0000 7fd10cc00640 1 -- 172.21.15.96:0/2049947627 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7fd104088e20 con 0x7fd11006edb0 2024-04-24T23:59:37.980 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:59:37.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.982+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0f006bfe0 msgr2=0x7fd0f006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.982+0000 7fd117800640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0f006bfe0 0x7fd0f006e4a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd1100cf700 tx=0x7fd0fc008040 comp rx=0 tx=0).stop 2024-04-24T23:59:37.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd11006edb0 msgr2=0x7fd11015f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:37.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd11006edb0 0x7fd11015f920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c3c0 tx=0x7fd10400c880 comp rx=0 tx=0).stop 2024-04-24T23:59:37.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 shutdown_connections 2024-04-24T23:59:37.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1101551c0 0x7fd110152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1100b3200 0x7fd1100afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0f006bfe0 0x7fd0f006e4a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 --2- 172.21.15.96:0/2049947627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd11006edb0 0x7fd11015f920 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:37.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 >> 172.21.15.96:0/2049947627 conn(0x7fd1100b19c0 msgr2=0x7fd1100b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:37.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 shutdown_connections 2024-04-24T23:59:37.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:37.983+0000 7fd117800640 1 -- 172.21.15.96:0/2049947627 wait complete. 2024-04-24T23:59:38.002 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:59:38.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.208+0000 7fd335400640 1 Processor -- start 2024-04-24T23:59:38.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.208+0000 7fd335400640 1 -- start start 2024-04-24T23:59:38.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.210+0000 7fd335400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd330156620 0x7fd33015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.210+0000 7fd335400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd33006d100 con 0x7fd3300ae8e0 2024-04-24T23:59:38.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.210+0000 7fd335400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3300acda0 con 0x7fd33006edf0 2024-04-24T23:59:38.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.210+0000 7fd335400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd3300ad060 con 0x7fd330156620 2024-04-24T23:59:38.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.210+0000 7fd32f200640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd3300ae8e0 0x7fd3300aed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54282/0 (socket says 172.21.15.96:54282) 2024-04-24T23:59:38.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.210+0000 7fd32f200640 1 -- 172.21.15.96:0/4084521267 learned_addr learned my addr 172.21.15.96:0/4084521267 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:38.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.210+0000 7fd32e800640 1 --2- 172.21.15.96:0/4084521267 >> v2:172.21.15.155:3300/0 conn(0x7fd330156620 0x7fd33015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489632853 0 0) 0x7fd33006d100 con 0x7fd3300ae8e0 2024-04-24T23:59:38.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd314003520 con 0x7fd3300ae8e0 2024-04-24T23:59:38.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2291922074 0 0) 0x7fd314003520 con 0x7fd3300ae8e0 2024-04-24T23:59:38.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 >> v2:172.21.15.155:3300/0 conn(0x7fd330156620 msgr2=0x7fd33015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:38.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 --2- 172.21.15.96:0/4084521267 >> v2:172.21.15.155:3300/0 conn(0x7fd330156620 0x7fd33015cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 >> v1:172.21.15.155:6789/0 conn(0x7fd33006edf0 legacy=0x7fd33006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33006d3a0 con 0x7fd3300ae8e0 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fd328001670 con 0x7fd3300ae8e0 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 >> v1:172.21.15.96:6789/0 conn(0x7fd3300ae8e0 legacy=0x7fd3300aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3140039b0 0x7fd314003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd314004800 0x7fd314004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3140053c0 0x7fd31400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd3300ad060 con 0x7fd3140039b0 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd31400c250 con 0x7fd3140053c0 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd31400c450 con 0x7fd314004800 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.211+0000 7fd32e800640 1 --2- 172.21.15.96:0/4084521267 >> v2:172.21.15.155:3300/0 conn(0x7fd330156620 0x7fd33015cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd32e800640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3140039b0 0x7fd314003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd325e00640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd314004800 0x7fd314004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd32f200640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3140053c0 0x7fd31400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd32e800640 1 -- 172.21.15.96:0/4084521267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd314004800 msgr2=0x7fd314004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd32e800640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd314004800 0x7fd314004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd32e800640 1 -- 172.21.15.96:0/4084521267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3140053c0 msgr2=0x7fd31400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd32e800640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3140053c0 0x7fd31400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd32e800640 1 -- 172.21.15.96:0/4084521267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd314003520 con 0x7fd3140039b0 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd32f200640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3140053c0 0x7fd31400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.212+0000 7fd32f200640 1 -- 172.21.15.96:0/4084521267 reap_dead start 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.213+0000 7fd32e800640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3140039b0 0x7fd314003dd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd3200098a0 tx=0x7fd314005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a683b80b899519 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.213+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320037070 con 0x7fd3140039b0 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.213+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32002aca0 con 0x7fd3140039b0 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.213+0000 7fd32de00640 1 -- 172.21.15.96:0/4084521267 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32000f040 con 0x7fd3140039b0 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.214+0000 7fd335400640 1 -- 172.21.15.96:0/4084521267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3140039b0 msgr2=0x7fd314003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.214+0000 7fd335400640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3140039b0 0x7fd314003dd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd3200098a0 tx=0x7fd314005830 comp rx=0 tx=0).stop 2024-04-24T23:59:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.214+0000 7fd335400640 1 -- 172.21.15.96:0/4084521267 shutdown_connections 2024-04-24T23:59:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.214+0000 7fd335400640 1 --2- 172.21.15.96:0/4084521267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3140039b0 0x7fd314003dd0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.214+0000 7fd335400640 1 -- 172.21.15.96:0/4084521267 >> 172.21.15.96:0/4084521267 conn(0x7fd3300b19c0 msgr2=0x7fd3300b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.214+0000 7fd335400640 1 -- 172.21.15.96:0/4084521267 shutdown_connections 2024-04-24T23:59:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.214+0000 7fd335400640 1 -- 172.21.15.96:0/4084521267 wait complete. 2024-04-24T23:59:38.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.216+0000 7fd335400640 1 Processor -- start 2024-04-24T23:59:38.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.216+0000 7fd335400640 1 -- start start 2024-04-24T23:59:38.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd335400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3140039b0 0x7fd3301e9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd335400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33014f280 0x7fd33009c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd335400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3301526c0 0x7fd330152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd335400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd3300ad4c0 con 0x7fd33014f280 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd335400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd3300ad340 con 0x7fd3301526c0 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd335400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd33015cf70 con 0x7fd3140039b0 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd325e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33014f280 0x7fd33009c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd325e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33014f280 0x7fd33009c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51386/0 (socket says 172.21.15.96:51386) 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd325e00640 1 -- 172.21.15.96:0/3596526348 learned_addr learned my addr 172.21.15.96:0/3596526348 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd325e00640 1 -- 172.21.15.96:0/3596526348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3140039b0 msgr2=0x7fd3301e9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd325e00640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3140039b0 0x7fd3301e9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd325e00640 1 -- 172.21.15.96:0/3596526348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3301526c0 msgr2=0x7fd330152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd325e00640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3301526c0 0x7fd330152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd325e00640 1 -- 172.21.15.96:0/3596526348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3301e97b0 con 0x7fd33014f280 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.217+0000 7fd325e00640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33014f280 0x7fd33009c4a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d800 tx=0x7fd31800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.218+0000 7fd327400640 1 -- 172.21.15.96:0/3596526348 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318003da0 con 0x7fd33014f280 2024-04-24T23:59:38.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.218+0000 7fd327400640 1 -- 172.21.15.96:0/3596526348 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd318017070 con 0x7fd33014f280 2024-04-24T23:59:38.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.218+0000 7fd327400640 1 -- 172.21.15.96:0/3596526348 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31800b8b0 con 0x7fd33014f280 2024-04-24T23:59:38.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.218+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33009c9e0 con 0x7fd33014f280 2024-04-24T23:59:38.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.218+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33009cf90 con 0x7fd33014f280 2024-04-24T23:59:38.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.219+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd330069110 con 0x7fd33014f280 2024-04-24T23:59:38.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.220+0000 7fd327400640 1 -- 172.21.15.96:0/3596526348 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fd31800ba50 con 0x7fd33014f280 2024-04-24T23:59:38.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.221+0000 7fd327400640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30c06c060 0x7fd30c06e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.221+0000 7fd327400640 1 -- 172.21.15.96:0/3596526348 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd31808b1b0 con 0x7fd33014f280 2024-04-24T23:59:38.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.221+0000 7fd32e800640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30c06c060 0x7fd30c06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.222+0000 7fd32e800640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30c06c060 0x7fd30c06e520 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd320034000 tx=0x7fd32002c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:38.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.225+0000 7fd327400640 1 -- 172.21.15.96:0/3596526348 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd318059940 con 0x7fd33014f280 2024-04-24T23:59:38.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.421+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd33013b170 con 0x7fd33014f280 2024-04-24T23:59:38.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.422+0000 7fd327400640 1 -- 172.21.15.96:0/3596526348 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7fd318059240 con 0x7fd33014f280 2024-04-24T23:59:38.422 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:59:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30c06c060 msgr2=0x7fd30c06e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30c06c060 0x7fd30c06e520 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd320034000 tx=0x7fd32002c000 comp rx=0 tx=0).stop 2024-04-24T23:59:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33014f280 msgr2=0x7fd33009c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33014f280 0x7fd33009c4a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d800 tx=0x7fd31800dcc0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 shutdown_connections 2024-04-24T23:59:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3301526c0 0x7fd330152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30c06c060 0x7fd30c06e520 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33014f280 0x7fd33009c4a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 --2- 172.21.15.96:0/3596526348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3140039b0 0x7fd3301e9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.424+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 >> 172.21.15.96:0/3596526348 conn(0x7fd3300b19c0 msgr2=0x7fd3300b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:38.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.425+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 shutdown_connections 2024-04-24T23:59:38.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.425+0000 7fd335400640 1 -- 172.21.15.96:0/3596526348 wait complete. 2024-04-24T23:59:38.443 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:59:38.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.625+0000 7fdee0c00640 1 Processor -- start 2024-04-24T23:59:38.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.625+0000 7fdee0c00640 1 -- start start 2024-04-24T23:59:38.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.627+0000 7fdee0c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdedc0af120 0x7fdedc071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.627+0000 7fdee0c00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdedc160b20 con 0x7fdedc15c230 2024-04-24T23:59:38.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.627+0000 7fdee0c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdedc15fd60 con 0x7fdedc0acda0 2024-04-24T23:59:38.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.627+0000 7fdee0c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdedc15c610 con 0x7fdedc0af120 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.627+0000 7fded9e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdedc15c230 0x7fdedc0aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54284/0 (socket says 172.21.15.96:54284) 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.627+0000 7fded9e00640 1 -- 172.21.15.96:0/3459564706 learned_addr learned my addr 172.21.15.96:0/3459564706 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded1400640 1 --2- 172.21.15.96:0/3459564706 >> v2:172.21.15.155:3300/0 conn(0x7fdedc0af120 0x7fdedc071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183111465 0 0) 0x7fdedc160b20 con 0x7fdedc15c230 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdec0003520 con 0x7fdedc15c230 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3844557231 0 0) 0x7fdec0003520 con 0x7fdedc15c230 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 >> v2:172.21.15.155:3300/0 conn(0x7fdedc0af120 msgr2=0x7fdedc071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 --2- 172.21.15.96:0/3459564706 >> v2:172.21.15.155:3300/0 conn(0x7fdedc0af120 0x7fdedc071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 >> v1:172.21.15.155:6789/0 conn(0x7fdedc0acda0 legacy=0x7fdedc06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc160040 con 0x7fdedc15c230 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fdecc001670 con 0x7fdedc15c230 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 >> v1:172.21.15.96:6789/0 conn(0x7fdedc15c230 legacy=0x7fdedc0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 --2- 172.21.15.96:0/3459564706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdec0003a00 0x7fdec0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 --2- 172.21.15.96:0/3459564706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdec0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 --2- 172.21.15.96:0/3459564706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdec0005210 0x7fdec000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc15c610 con 0x7fdec0004800 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdec000c160 con 0x7fdec0005210 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdec000c360 con 0x7fdec0003a00 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.628+0000 7fded1400640 1 --2- 172.21.15.96:0/3459564706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdec0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.629+0000 7fded1400640 1 -- 172.21.15.96:0/3459564706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdec0003a00 msgr2=0x7fdec0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.629+0000 7fded1400640 1 --2- 172.21.15.96:0/3459564706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdec0003a00 0x7fdec0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.629+0000 7fded1400640 1 -- 172.21.15.96:0/3459564706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdec0005210 msgr2=0x7fdec000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.629+0000 7fded1400640 1 --2- 172.21.15.96:0/3459564706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdec0005210 0x7fdec000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.629+0000 7fded1400640 1 -- 172.21.15.96:0/3459564706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec0003520 con 0x7fdec0004800 2024-04-24T23:59:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.629+0000 7fdeda800640 1 -- 172.21.15.96:0/3459564706 reap_dead start 2024-04-24T23:59:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.630+0000 7fded1400640 1 --2- 172.21.15.96:0/3459564706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdec0004c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdec400ba30 tx=0x7fdec0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7359eaa65b3e5e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.630+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4030070 con 0x7fdec0004800 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.630+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec402ae10 con 0x7fdec0004800 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.630+0000 7fded9400640 1 -- 172.21.15.96:0/3459564706 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec400b600 con 0x7fdec0004800 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.631+0000 7fdee0c00640 1 -- 172.21.15.96:0/3459564706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 msgr2=0x7fdec0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.631+0000 7fdee0c00640 1 --2- 172.21.15.96:0/3459564706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdec0004c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdec400ba30 tx=0x7fdec0005830 comp rx=0 tx=0).stop 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.631+0000 7fdee0c00640 1 -- 172.21.15.96:0/3459564706 shutdown_connections 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.631+0000 7fdee0c00640 1 --2- 172.21.15.96:0/3459564706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdec0004c80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.631+0000 7fdee0c00640 1 -- 172.21.15.96:0/3459564706 >> 172.21.15.96:0/3459564706 conn(0x7fdedc0b19c0 msgr2=0x7fdedc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.631+0000 7fdee0c00640 1 -- 172.21.15.96:0/3459564706 shutdown_connections 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.631+0000 7fdee0c00640 1 -- 172.21.15.96:0/3459564706 wait complete. 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.633+0000 7fdee0c00640 1 Processor -- start 2024-04-24T23:59:38.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.633+0000 7fdee0c00640 1 -- start start 2024-04-24T23:59:38.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fdee0c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdedc0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fdee0c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdedc14d670 0x7fdedc15ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fdee0c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdedc15f380 0x7fdedc15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fdee0c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc0ad1f0 con 0x7fdec0004800 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fdee0c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc160600 con 0x7fdedc15f380 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fdee0c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdedc0ad4d0 con 0x7fdedc14d670 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fded9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdedc0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fded9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdedc0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51408/0 (socket says 172.21.15.96:51408) 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fded9e00640 1 -- 172.21.15.96:0/2715346060 learned_addr learned my addr 172.21.15.96:0/2715346060 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fded9e00640 1 -- 172.21.15.96:0/2715346060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdedc14d670 msgr2=0x7fdedc15ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fded9e00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdedc14d670 0x7fdedc15ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fded9e00640 1 -- 172.21.15.96:0/2715346060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdedc15f380 msgr2=0x7fdedc15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fdeda800640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdedc15f380 0x7fdedc15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fded9e00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdedc15f380 0x7fdedc15cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.634+0000 7fded9e00640 1 -- 172.21.15.96:0/2715346060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc09bbb0 con 0x7fdec0004800 2024-04-24T23:59:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.635+0000 7fded9e00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdedc0c9040 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00c730 tx=0x7fdecc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:38.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.635+0000 7fded2a00640 1 -- 172.21.15.96:0/2715346060 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc018070 con 0x7fdec0004800 2024-04-24T23:59:38.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.635+0000 7fded2a00640 1 -- 172.21.15.96:0/2715346060 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdecc0072f0 con 0x7fdec0004800 2024-04-24T23:59:38.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.635+0000 7fded2a00640 1 -- 172.21.15.96:0/2715346060 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0047e0 con 0x7fdec0004800 2024-04-24T23:59:38.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.635+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdedc09be90 con 0x7fdec0004800 2024-04-24T23:59:38.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.635+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdedc09c450 con 0x7fdec0004800 2024-04-24T23:59:38.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.636+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdedc069110 con 0x7fdec0004800 2024-04-24T23:59:38.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.637+0000 7fded2a00640 1 -- 172.21.15.96:0/2715346060 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fdecc004980 con 0x7fdec0004800 2024-04-24T23:59:38.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.638+0000 7fded2a00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdeb806bfe0 0x7fdeb806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:38.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.638+0000 7fded2a00640 1 -- 172.21.15.96:0/2715346060 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fdecc08a600 con 0x7fdec0004800 2024-04-24T23:59:38.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.638+0000 7fded1400640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdeb806bfe0 0x7fdeb806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:38.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.639+0000 7fded1400640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdeb806bfe0 0x7fdeb806e4a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdec400ba00 tx=0x7fdec402c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:38.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.642+0000 7fded2a00640 1 -- 172.21.15.96:0/2715346060 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdecc004c70 con 0x7fdec0004800 2024-04-24T23:59:38.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.854+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdedc074f80 con 0x7fdec0004800 2024-04-24T23:59:38.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.854+0000 7fded2a00640 1 -- 172.21.15.96:0/2715346060 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7fdecc058d20 con 0x7fdec0004800 2024-04-24T23:59:38.855 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdeb806bfe0 msgr2=0x7fdeb806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdeb806bfe0 0x7fdeb806e4a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdec400ba00 tx=0x7fdec402c000 comp rx=0 tx=0).stop 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 msgr2=0x7fdedc0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdedc0c9040 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00c730 tx=0x7fdecc00cbf0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 shutdown_connections 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdedc15f380 0x7fdedc15cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdedc14d670 0x7fdedc15ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fdeb806bfe0 0x7fdeb806e4a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 --2- 172.21.15.96:0/2715346060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdec0004800 0x7fdedc0c9040 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.857+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 >> 172.21.15.96:0/2715346060 conn(0x7fdedc0b19c0 msgr2=0x7fdedc06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.858+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 shutdown_connections 2024-04-24T23:59:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:38.858+0000 7fdee0c00640 1 -- 172.21.15.96:0/2715346060 wait complete. 2024-04-24T23:59:38.875 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-24T23:59:38.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:38.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-24T23:59:38.977 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-04-24T23:59:38.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:38.977 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-24T23:59:39.029 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:59:39.029 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:59:39.029 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:39.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052731,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498000k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248996k,nr_inodes=812249,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498000k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:59:39.087 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:59:39.087 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:59:39.087 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:39.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:59:39.143 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:59:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.348+0000 7f9536800640 1 Processor -- start 2024-04-24T23:59:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.348+0000 7f9536800640 1 -- start start 2024-04-24T23:59:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.350+0000 7f9536800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f953015e0f0 0x7f95300b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.350+0000 7f9536800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f953006f880 0x7f95300d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.350+0000 7f9536800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95300aff90 con 0x7f953015e4d0 2024-04-24T23:59:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.350+0000 7f9536800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f95300b5ad0 con 0x7f953015e0f0 2024-04-24T23:59:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.350+0000 7f9536800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95300b5d00 con 0x7f953006f880 2024-04-24T23:59:39.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.351+0000 7f9535400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f953015e0f0 0x7f95300b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.351+0000 7f9535e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f953006f880 0x7f95300d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.351+0000 7f9535400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f953015e0f0 0x7f95300b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:55152/0 (socket says 172.21.15.96:55152) 2024-04-24T23:59:39.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.351+0000 7f9535400640 1 -- 172.21.15.96:0/2300742244 learned_addr learned my addr 172.21.15.96:0/2300742244 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:39.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.352+0000 7f9535e00640 1 -- 172.21.15.96:0/2300742244 >> v2:172.21.15.155:3300/0 conn(0x7f953015e0f0 msgr2=0x7f95300b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:39.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.352+0000 7f9535e00640 1 --2- 172.21.15.96:0/2300742244 >> v2:172.21.15.155:3300/0 conn(0x7f953015e0f0 0x7f95300b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.352+0000 7f9535e00640 1 -- 172.21.15.96:0/2300742244 >> v1:172.21.15.155:6789/0 conn(0x7f953015e4d0 legacy=0x7f9530162770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:39.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.352+0000 7f9535e00640 1 -- 172.21.15.96:0/2300742244 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95300b6280 con 0x7f953006f880 2024-04-24T23:59:39.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.353+0000 7f9535e00640 1 --2- 172.21.15.96:0/2300742244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f953006f880 0x7f95300d1030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9528009d90 tx=0x7f952802a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=655ca691b6064ac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:39.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.353+0000 7f952fe00640 1 -- 172.21.15.96:0/2300742244 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528007740 con 0x7f953006f880 2024-04-24T23:59:39.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f952fe00640 1 -- 172.21.15.96:0/2300742244 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95280078e0 con 0x7f953006f880 2024-04-24T23:59:39.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f952fe00640 1 -- 172.21.15.96:0/2300742244 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528007cb0 con 0x7f953006f880 2024-04-24T23:59:39.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f9536800640 1 -- 172.21.15.96:0/2300742244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f953006f880 msgr2=0x7f95300d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:39.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f9536800640 1 --2- 172.21.15.96:0/2300742244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f953006f880 0x7f95300d1030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9528009d90 tx=0x7f952802a530 comp rx=0 tx=0).stop 2024-04-24T23:59:39.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f9536800640 1 -- 172.21.15.96:0/2300742244 shutdown_connections 2024-04-24T23:59:39.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f9536800640 1 --2- 172.21.15.96:0/2300742244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f953006f880 0x7f95300d1030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f9536800640 1 --2- 172.21.15.96:0/2300742244 >> v2:172.21.15.155:3300/0 conn(0x7f953015e0f0 0x7f95300b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f9536800640 1 -- 172.21.15.96:0/2300742244 >> 172.21.15.96:0/2300742244 conn(0x7f953006c3b0 msgr2=0x7f953006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:39.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f9536800640 1 -- 172.21.15.96:0/2300742244 shutdown_connections 2024-04-24T23:59:39.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.354+0000 7f9536800640 1 -- 172.21.15.96:0/2300742244 wait complete. 2024-04-24T23:59:39.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.356+0000 7f9536800640 1 Processor -- start 2024-04-24T23:59:39.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.356+0000 7f9536800640 1 -- start start 2024-04-24T23:59:39.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.357+0000 7f9536800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f953006f880 0x7f95301557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.357+0000 7f9536800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f953015e0f0 0x7f9530161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.357+0000 7f9536800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9530151dd0 0x7f95300b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.357+0000 7f9536800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9530162250 con 0x7f953006f880 2024-04-24T23:59:39.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.357+0000 7f9536800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9530161f70 con 0x7f953015e0f0 2024-04-24T23:59:39.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.357+0000 7f9536800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95300d1570 con 0x7f9530151dd0 2024-04-24T23:59:39.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.357+0000 7f9535400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f953006f880 0x7f95301557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.357+0000 7f9535400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f953006f880 0x7f95301557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51416/0 (socket says 172.21.15.96:51416) 2024-04-24T23:59:39.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.358+0000 7f9535400640 1 -- 172.21.15.96:0/2441155355 learned_addr learned my addr 172.21.15.96:0/2441155355 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:39.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.358+0000 7f9535400640 1 -- 172.21.15.96:0/2441155355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9530151dd0 msgr2=0x7f95300b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.358+0000 7f9535e00640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9530151dd0 0x7f95300b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.358+0000 7f9534a00640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f953015e0f0 0x7f9530161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.358+0000 7f9535400640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9530151dd0 0x7f95300b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.358+0000 7f9535400640 1 -- 172.21.15.96:0/2441155355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f953015e0f0 msgr2=0x7f9530161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.358+0000 7f9535400640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f953015e0f0 0x7f9530161180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.358+0000 7f9535400640 1 -- 172.21.15.96:0/2441155355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95301f7bc0 con 0x7f953006f880 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.358+0000 7f9535400640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f953006f880 0x7f95301557d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9524009fd0 tx=0x7f952400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.359+0000 7f952d600640 1 -- 172.21.15.96:0/2441155355 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524017070 con 0x7f953006f880 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.359+0000 7f952d600640 1 -- 172.21.15.96:0/2441155355 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952400c940 con 0x7f953006f880 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.359+0000 7f952d600640 1 -- 172.21.15.96:0/2441155355 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952400cd10 con 0x7f953006f880 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.359+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95301f7ea0 con 0x7f953006f880 2024-04-24T23:59:39.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.359+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95301f8460 con 0x7f953006f880 2024-04-24T23:59:39.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.360+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95300756b0 con 0x7f953006f880 2024-04-24T23:59:39.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.361+0000 7f952d600640 1 -- 172.21.15.96:0/2441155355 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f952401a070 con 0x7f953006f880 2024-04-24T23:59:39.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.362+0000 7f952d600640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f951006bfe0 0x7f951006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.362+0000 7f952d600640 1 -- 172.21.15.96:0/2441155355 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f952408b510 con 0x7f953006f880 2024-04-24T23:59:39.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.362+0000 7f9534a00640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f951006bfe0 0x7f951006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.363+0000 7f9534a00640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f951006bfe0 0x7f951006e4a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f951c001500 tx=0x7f951c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:39.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.366+0000 7f952d600640 1 -- 172.21.15.96:0/2441155355 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9524059ba0 con 0x7f953006f880 2024-04-24T23:59:39.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.615+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95300729e0 con 0x7f953006f880 2024-04-24T23:59:39.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.617+0000 7f952d600640 1 -- 172.21.15.96:0/2441155355 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f95240594a0 con 0x7f953006f880 2024-04-24T23:59:39.617 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:39.617 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1875464528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1875464528},{"type":"v1","addr":"172.21.15.155:6835","nonce":1875464528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/2449705897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":2449705897},{"type":"v1","addr":"172.21.15.96:6837","nonce":2449705897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4160377725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4160377725},{"type":"v1","addr":"172.21.15.155:6833","nonce":4160377725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:59:15.923615+0000","modified":"2024-04-24T23:59:19.009098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.96:6835/3672280349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3672280349},{"type":"v1","addr":"172.21.15.96:6835","nonce":3672280349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5097,"qdb_cluster":[5097]},"id":2}]} 2024-04-24T23:59:39.617 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-24T23:59:39.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f951006bfe0 msgr2=0x7f951006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:39.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f951006bfe0 0x7f951006e4a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f951c001500 tx=0x7f951c009040 comp rx=0 tx=0).stop 2024-04-24T23:59:39.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f953006f880 msgr2=0x7f95301557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:39.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f953006f880 0x7f95301557d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9524009fd0 tx=0x7f952400ed40 comp rx=0 tx=0).stop 2024-04-24T23:59:39.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 shutdown_connections 2024-04-24T23:59:39.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9530151dd0 0x7f95300b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f953015e0f0 0x7f9530161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f951006bfe0 0x7f951006e4a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 --2- 172.21.15.96:0/2441155355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f953006f880 0x7f95301557d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 >> 172.21.15.96:0/2441155355 conn(0x7f953006c3b0 msgr2=0x7f95300ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:39.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 shutdown_connections 2024-04-24T23:59:39.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.620+0000 7f9536800640 1 -- 172.21.15.96:0/2441155355 wait complete. 2024-04-24T23:59:39.639 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.830+0000 7ff0ba400640 1 Processor -- start 2024-04-24T23:59:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.831+0000 7ff0ba400640 1 -- start start 2024-04-24T23:59:39.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.832+0000 7ff0ba400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff0b415f6b0 0x7ff0b40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.832+0000 7ff0ba400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0b40b4ec0 0x7ff0b40cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.832+0000 7ff0ba400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b415fa90 con 0x7ff0b40ccc20 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.832+0000 7ff0ba400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b40b4a30 con 0x7ff0b415f6b0 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.832+0000 7ff0ba400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b40b3e20 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.833+0000 7ff0b9000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff0b415f6b0 0x7ff0b40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.833+0000 7ff0b9000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff0b415f6b0 0x7ff0b40ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51424/0 (socket says 172.21.15.96:51424) 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.833+0000 7ff0b9000640 1 -- 172.21.15.96:0/1169666522 learned_addr learned my addr 172.21.15.96:0/1169666522 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.833+0000 7ff0b3e00640 1 --2- 172.21.15.96:0/1169666522 >> v2:172.21.15.155:3300/0 conn(0x7ff0b40b4ec0 0x7ff0b40cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.833+0000 7ff0b9000640 1 -- 172.21.15.96:0/1169666522 >> v2:172.21.15.155:3300/0 conn(0x7ff0b40b4ec0 msgr2=0x7ff0b40cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.833+0000 7ff0b9000640 1 --2- 172.21.15.96:0/1169666522 >> v2:172.21.15.155:3300/0 conn(0x7ff0b40b4ec0 0x7ff0b40cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.833+0000 7ff0b9000640 1 -- 172.21.15.96:0/1169666522 >> v1:172.21.15.155:6789/0 conn(0x7ff0b40ccc20 legacy=0x7ff0b415fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:39.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.833+0000 7ff0b9000640 1 -- 172.21.15.96:0/1169666522 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b40b4100 con 0x7ff0b415f6b0 2024-04-24T23:59:39.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.835+0000 7ff0b9000640 1 --2- 172.21.15.96:0/1169666522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b415f6b0 0x7ff0b40ce5e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40af6a0 tx=0x7ff0a802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa93f21ca3aca68d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:39.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.835+0000 7ff0b3400640 1 -- 172.21.15.96:0/1169666522 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8037070 con 0x7ff0b415f6b0 2024-04-24T23:59:39.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.835+0000 7ff0b3400640 1 -- 172.21.15.96:0/1169666522 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a8032440 con 0x7ff0b415f6b0 2024-04-24T23:59:39.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.835+0000 7ff0b3400640 1 -- 172.21.15.96:0/1169666522 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8032810 con 0x7ff0b415f6b0 2024-04-24T23:59:39.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.836+0000 7ff0ba400640 1 -- 172.21.15.96:0/1169666522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b415f6b0 msgr2=0x7ff0b40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:39.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.836+0000 7ff0ba400640 1 --2- 172.21.15.96:0/1169666522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b415f6b0 0x7ff0b40ce5e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40af6a0 tx=0x7ff0a802a230 comp rx=0 tx=0).stop 2024-04-24T23:59:39.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.836+0000 7ff0ba400640 1 -- 172.21.15.96:0/1169666522 shutdown_connections 2024-04-24T23:59:39.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.836+0000 7ff0ba400640 1 --2- 172.21.15.96:0/1169666522 >> v2:172.21.15.155:3300/0 conn(0x7ff0b40b4ec0 0x7ff0b40cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.836+0000 7ff0ba400640 1 --2- 172.21.15.96:0/1169666522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b415f6b0 0x7ff0b40ce5e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.836+0000 7ff0ba400640 1 -- 172.21.15.96:0/1169666522 >> 172.21.15.96:0/1169666522 conn(0x7ff0b40b1f10 msgr2=0x7ff0b40cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:39.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.836+0000 7ff0ba400640 1 -- 172.21.15.96:0/1169666522 shutdown_connections 2024-04-24T23:59:39.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.836+0000 7ff0ba400640 1 -- 172.21.15.96:0/1169666522 wait complete. 2024-04-24T23:59:39.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.838+0000 7ff0ba400640 1 Processor -- start 2024-04-24T23:59:39.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.838+0000 7ff0ba400640 1 -- start start 2024-04-24T23:59:39.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.839+0000 7ff0ba400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b40b4ec0 0x7ff0b4153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.839+0000 7ff0ba400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b40ccc20 0x7ff0b4149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.839+0000 7ff0ba400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b415f6b0 0x7ff0b40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.839+0000 7ff0ba400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b40ceb20 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.839+0000 7ff0ba400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b40b46c0 con 0x7ff0b40ccc20 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.839+0000 7ff0ba400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b40cf1c0 con 0x7ff0b415f6b0 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.839+0000 7ff0b9000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b40b4ec0 0x7ff0b4153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.839+0000 7ff0b9000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b40b4ec0 0x7ff0b4153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51430/0 (socket says 172.21.15.96:51430) 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.839+0000 7ff0b9000640 1 -- 172.21.15.96:0/1514713165 learned_addr learned my addr 172.21.15.96:0/1514713165 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b9000640 1 -- 172.21.15.96:0/1514713165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b415f6b0 msgr2=0x7ff0b40c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b3e00640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b40ccc20 0x7ff0b4149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b9a00640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b415f6b0 0x7ff0b40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b9000640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b415f6b0 0x7ff0b40c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b9000640 1 -- 172.21.15.96:0/1514713165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b40ccc20 msgr2=0x7ff0b4149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b9000640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b40ccc20 0x7ff0b4149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b9000640 1 -- 172.21.15.96:0/1514713165 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b40c94a0 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b9000640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b40b4ec0 0x7ff0b4153a50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff0a802a270 tx=0x7ff0a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b0c00640 1 -- 172.21.15.96:0/1514713165 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8041020 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b0c00640 1 -- 172.21.15.96:0/1514713165 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a80306c0 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b40c9740 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.840+0000 7ff0b0c00640 1 -- 172.21.15.96:0/1514713165 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8037040 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.841+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b40c9d00 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.842+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b4067e40 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.843+0000 7ff0b0c00640 1 -- 172.21.15.96:0/1514713165 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff0a8044020 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.844+0000 7ff0b0c00640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff09406bfe0 0x7ff09406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:39.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.844+0000 7ff0b0c00640 1 -- 172.21.15.96:0/1514713165 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff0a80aba50 con 0x7ff0b40b4ec0 2024-04-24T23:59:39.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.844+0000 7ff0b3e00640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff09406bfe0 0x7ff09406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.845+0000 7ff0b3e00640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff09406bfe0 0x7ff09406e4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40af1c0 tx=0x7ff0a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:39.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:39.848+0000 7ff0b0c00640 1 -- 172.21.15.96:0/1514713165 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff0a804b030 con 0x7ff0b40b4ec0 2024-04-24T23:59:40.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.045+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0b40756b0 con 0x7ff0b40b4ec0 2024-04-24T23:59:40.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.048+0000 7ff0b0c00640 1 -- 172.21.15.96:0/1514713165 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16621 (secure 0 0 0) 0x7ff0a807a0f0 con 0x7ff0b40b4ec0 2024-04-24T23:59:40.049 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:40.049 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":33,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:17.499374+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:59:13.640002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T23:59:14.952491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff09406bfe0 msgr2=0x7ff09406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff09406bfe0 0x7ff09406e4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40af1c0 tx=0x7ff0a0008040 comp rx=0 tx=0).stop 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b40b4ec0 msgr2=0x7ff0b4153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b40b4ec0 0x7ff0b4153a50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff0a802a270 tx=0x7ff0a80046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 shutdown_connections 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b415f6b0 0x7ff0b40c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b40ccc20 0x7ff0b4149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff09406bfe0 0x7ff09406e4a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 --2- 172.21.15.96:0/1514713165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b40b4ec0 0x7ff0b4153a50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.051+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 >> 172.21.15.96:0/1514713165 conn(0x7ff0b40b1f10 msgr2=0x7ff0b415da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.052+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 shutdown_connections 2024-04-24T23:59:40.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.052+0000 7ff0ba400640 1 -- 172.21.15.96:0/1514713165 wait complete. 2024-04-24T23:59:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:59:13.640002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:59:14.952491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:59:40.071 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:59:40.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.265+0000 7f82b6800640 1 Processor -- start 2024-04-24T23:59:40.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.265+0000 7f82b6800640 1 -- start start 2024-04-24T23:59:40.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.267+0000 7f82b6800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f82b013ef60 0x7f82b015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.267+0000 7f82b6800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82b01415d0 0x7f82b0141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.267+0000 7f82b6800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82b00ce620 con 0x7f82b00cf3e0 2024-04-24T23:59:40.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.267+0000 7f82b6800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f82b00ce900 con 0x7f82b013ef60 2024-04-24T23:59:40.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.267+0000 7f82b6800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f82b00cebe0 con 0x7f82b01415d0 2024-04-24T23:59:40.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.267+0000 7f82b5400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f82b013ef60 0x7f82b015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.267+0000 7f82b5400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f82b013ef60 0x7f82b015cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51446/0 (socket says 172.21.15.96:51446) 2024-04-24T23:59:40.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.267+0000 7f82b5400640 1 -- 172.21.15.96:0/1445591132 learned_addr learned my addr 172.21.15.96:0/1445591132 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:40.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.268+0000 7f82b5400640 1 -- 172.21.15.96:0/1445591132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82b01415d0 msgr2=0x7f82b0141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:40.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.268+0000 7f82b5400640 1 --2- 172.21.15.96:0/1445591132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82b01415d0 0x7f82b0141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.268+0000 7f82b5400640 1 -- 172.21.15.96:0/1445591132 >> v1:172.21.15.155:6789/0 conn(0x7f82b00cf3e0 legacy=0x7f82b00cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:40.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.268+0000 7f82b5400640 1 -- 172.21.15.96:0/1445591132 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b00ce240 con 0x7f82b013ef60 2024-04-24T23:59:40.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.269+0000 7f82b5400640 1 --2- 172.21.15.96:0/1445591132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b013ef60 0x7f82b015cfe0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009870 tx=0x7f82a402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ed1606a0ce577a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:40.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.269+0000 7f82afe00640 1 -- 172.21.15.96:0/1445591132 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4037070 con 0x7f82b013ef60 2024-04-24T23:59:40.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.270+0000 7f82afe00640 1 -- 172.21.15.96:0/1445591132 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a4032440 con 0x7f82b013ef60 2024-04-24T23:59:40.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.270+0000 7f82afe00640 1 -- 172.21.15.96:0/1445591132 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4032810 con 0x7f82b013ef60 2024-04-24T23:59:40.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.270+0000 7f82b6800640 1 -- 172.21.15.96:0/1445591132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b013ef60 msgr2=0x7f82b015cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.270+0000 7f82b6800640 1 --2- 172.21.15.96:0/1445591132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b013ef60 0x7f82b015cfe0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009870 tx=0x7f82a402a200 comp rx=0 tx=0).stop 2024-04-24T23:59:40.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.271+0000 7f82b6800640 1 -- 172.21.15.96:0/1445591132 shutdown_connections 2024-04-24T23:59:40.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.271+0000 7f82b6800640 1 --2- 172.21.15.96:0/1445591132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82b01415d0 0x7f82b0141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.271+0000 7f82b6800640 1 --2- 172.21.15.96:0/1445591132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b013ef60 0x7f82b015cfe0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.271+0000 7f82b6800640 1 -- 172.21.15.96:0/1445591132 >> 172.21.15.96:0/1445591132 conn(0x7f82b00b18b0 msgr2=0x7f82b00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:40.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.271+0000 7f82b6800640 1 -- 172.21.15.96:0/1445591132 shutdown_connections 2024-04-24T23:59:40.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.271+0000 7f82b6800640 1 -- 172.21.15.96:0/1445591132 wait complete. 2024-04-24T23:59:40.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.273+0000 7f82b6800640 1 Processor -- start 2024-04-24T23:59:40.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.273+0000 7f82b6800640 1 -- start start 2024-04-24T23:59:40.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.274+0000 7f82b6800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b00cf3e0 0x7f82b0156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.274+0000 7f82b6800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82b013ef60 0x7f82b0156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.274+0000 7f82b6800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82b01415d0 0x7f82b0157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.274+0000 7f82b6800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f82b006cba0 con 0x7f82b00cf3e0 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.274+0000 7f82b6800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f82b006ca20 con 0x7f82b013ef60 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.274+0000 7f82b6800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f82b006cd20 con 0x7f82b01415d0 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b5400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b00cf3e0 0x7f82b0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b5400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b00cf3e0 0x7f82b0156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51448/0 (socket says 172.21.15.96:51448) 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b5400640 1 -- 172.21.15.96:0/3211557678 learned_addr learned my addr 172.21.15.96:0/3211557678 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b4a00640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82b013ef60 0x7f82b0156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b5e00640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82b01415d0 0x7f82b0157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b5400640 1 -- 172.21.15.96:0/3211557678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82b01415d0 msgr2=0x7f82b0157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b5400640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82b01415d0 0x7f82b0157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b5400640 1 -- 172.21.15.96:0/3211557678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82b013ef60 msgr2=0x7f82b0156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b5400640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82b013ef60 0x7f82b0156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b5400640 1 -- 172.21.15.96:0/3211557678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b0156570 con 0x7f82b00cf3e0 2024-04-24T23:59:40.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.275+0000 7f82b4a00640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82b013ef60 0x7f82b0156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:40.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.276+0000 7f82b5400640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b00cf3e0 0x7f82b0156030 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009870 tx=0x7f82a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:40.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.276+0000 7f82ad600640 1 -- 172.21.15.96:0/3211557678 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4041070 con 0x7f82b00cf3e0 2024-04-24T23:59:40.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.276+0000 7f82ad600640 1 -- 172.21.15.96:0/3211557678 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a403c870 con 0x7f82b00cf3e0 2024-04-24T23:59:40.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.276+0000 7f82ad600640 1 -- 172.21.15.96:0/3211557678 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4037040 con 0x7f82b00cf3e0 2024-04-24T23:59:40.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.276+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b01f79a0 con 0x7f82b00cf3e0 2024-04-24T23:59:40.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.276+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b01f7f60 con 0x7f82b00cf3e0 2024-04-24T23:59:40.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.277+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b00755d0 con 0x7f82b00cf3e0 2024-04-24T23:59:40.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.278+0000 7f82ad600640 1 -- 172.21.15.96:0/3211557678 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f82a4044070 con 0x7f82b00cf3e0 2024-04-24T23:59:40.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.279+0000 7f82ad600640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f829406bfe0 0x7f829406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.279+0000 7f82ad600640 1 -- 172.21.15.96:0/3211557678 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f82a40abcc0 con 0x7f82b00cf3e0 2024-04-24T23:59:40.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.280+0000 7f82b4a00640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f829406bfe0 0x7f829406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.280+0000 7f82b4a00640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f829406bfe0 0x7f829406e4a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f82b00b1880 tx=0x7f82a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:40.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.285+0000 7f82ad600640 1 -- 172.21.15.96:0/3211557678 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f82a40b2080 con 0x7f82b00cf3e0 2024-04-24T23:59:40.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.483+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82b00b49b0 con 0x7f82b00cf3e0 2024-04-24T23:59:40.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.484+0000 7f82ad600640 1 -- 172.21.15.96:0/3211557678 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7f82b0156570 con 0x7f82b00cf3e0 2024-04-24T23:59:40.484 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:59:40.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.486+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f829406bfe0 msgr2=0x7f829406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f829406bfe0 0x7f829406e4a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f82b00b1880 tx=0x7f82a0009040 comp rx=0 tx=0).stop 2024-04-24T23:59:40.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b00cf3e0 msgr2=0x7f82b0156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b00cf3e0 0x7f82b0156030 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009870 tx=0x7f82a40046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 shutdown_connections 2024-04-24T23:59:40.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82b01415d0 0x7f82b0157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82b013ef60 0x7f82b0156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f829406bfe0 0x7f829406e4a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 --2- 172.21.15.96:0/3211557678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82b00cf3e0 0x7f82b0156030 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 >> 172.21.15.96:0/3211557678 conn(0x7f82b00b18b0 msgr2=0x7f82b015d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:40.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 shutdown_connections 2024-04-24T23:59:40.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.487+0000 7f82b6800640 1 -- 172.21.15.96:0/3211557678 wait complete. 2024-04-24T23:59:40.505 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:59:40.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.690+0000 7ff8fb200640 1 Processor -- start 2024-04-24T23:59:40.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.690+0000 7ff8fb200640 1 -- start start 2024-04-24T23:59:40.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.692+0000 7ff8fb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc15cfe0 0x7ff8fc0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.692+0000 7ff8fb200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8fc0ce620 con 0x7ff8fc13ef60 2024-04-24T23:59:40.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.692+0000 7ff8fb200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8fc0ce900 con 0x7ff8fc1415d0 2024-04-24T23:59:40.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.692+0000 7ff8fb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc0cebe0 con 0x7ff8fc15cfe0 2024-04-24T23:59:40.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.692+0000 7ff8f9e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff8fc13ef60 0x7ff8fc0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54300/0 (socket says 172.21.15.96:54300) 2024-04-24T23:59:40.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.692+0000 7ff8f9e00640 1 -- 172.21.15.96:0/4166599455 learned_addr learned my addr 172.21.15.96:0/4166599455 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:40.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.692+0000 7ff8f1400640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc15cfe0 0x7ff8fc0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661416578 0 0) 0x7ff8fc0ce620 con 0x7ff8fc13ef60 2024-04-24T23:59:40.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e0003520 con 0x7ff8fc13ef60 2024-04-24T23:59:40.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4078437861 0 0) 0x7ff8e0003520 con 0x7ff8fc13ef60 2024-04-24T23:59:40.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc15cfe0 msgr2=0x7ff8fc0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:40.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc15cfe0 0x7ff8fc0cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 >> v1:172.21.15.155:6789/0 conn(0x7ff8fc1415d0 legacy=0x7ff8fc06ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc0ccb10 con 0x7ff8fc13ef60 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7ff8ec001670 con 0x7ff8fc13ef60 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 >> v1:172.21.15.96:6789/0 conn(0x7ff8fc13ef60 legacy=0x7ff8fc0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8e00039e0 0x7ff8e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc15cfe0 0x7ff8e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0cebe0 con 0x7ff8e0004800 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e000ba70 con 0x7ff8e00039e0 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.693+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e000bc70 con 0x7ff8fc15cfe0 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.694+0000 7ff8f1400640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.694+0000 7ff8f1400640 1 -- 172.21.15.96:0/4166599455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc15cfe0 msgr2=0x7ff8e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.694+0000 7ff8f1400640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc15cfe0 0x7ff8e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.694+0000 7ff8f1400640 1 -- 172.21.15.96:0/4166599455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8e00039e0 msgr2=0x7ff8e0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:40.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.694+0000 7ff8f1400640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8e00039e0 0x7ff8e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.694+0000 7ff8f1400640 1 -- 172.21.15.96:0/4166599455 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e0003520 con 0x7ff8e0004800 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.695+0000 7ff8f1400640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8e0004c80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009ac0 tx=0x7ff8e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deedda4027738d4e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.695+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4036070 con 0x7ff8e0004800 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.695+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e4031400 con 0x7ff8e0004800 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.695+0000 7ff8f9400640 1 -- 172.21.15.96:0/4166599455 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4009690 con 0x7ff8e0004800 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.696+0000 7ff8fb200640 1 -- 172.21.15.96:0/4166599455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 msgr2=0x7ff8e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.696+0000 7ff8fb200640 1 --2- 172.21.15.96:0/4166599455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8e0004c80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009ac0 tx=0x7ff8e0005830 comp rx=0 tx=0).stop 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.696+0000 7ff8fa800640 1 -- 172.21.15.96:0/4166599455 reap_dead start 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.696+0000 7ff8fb200640 1 -- 172.21.15.96:0/4166599455 shutdown_connections 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.696+0000 7ff8fb200640 1 -- 172.21.15.96:0/4166599455 >> 172.21.15.96:0/4166599455 conn(0x7ff8fc0b18b0 msgr2=0x7ff8fc0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.696+0000 7ff8fb200640 1 -- 172.21.15.96:0/4166599455 shutdown_connections 2024-04-24T23:59:40.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.696+0000 7ff8fb200640 1 -- 172.21.15.96:0/4166599455 wait complete. 2024-04-24T23:59:40.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.697+0000 7ff8fb200640 1 Processor -- start 2024-04-24T23:59:40.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.698+0000 7ff8fb200640 1 -- start start 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.698+0000 7ff8fb200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8fc13d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.698+0000 7ff8fb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc140b10 0x7ff8fc140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.698+0000 7ff8fb200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc15e4b0 0x7ff8fc15e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.698+0000 7ff8fb200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0cc750 con 0x7ff8e0004800 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.698+0000 7ff8fb200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0cc5d0 con 0x7ff8fc15e4b0 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.698+0000 7ff8fb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc0cc8d0 con 0x7ff8fc140b10 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8f9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8fc13d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8f9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8fc13d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51452/0 (socket says 172.21.15.96:51452) 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8f9e00640 1 -- 172.21.15.96:0/3357031680 learned_addr learned my addr 172.21.15.96:0/3357031680 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:40.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8f9e00640 1 -- 172.21.15.96:0/3357031680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc140b10 msgr2=0x7ff8fc140f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8fa800640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc15e4b0 0x7ff8fc15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8f9e00640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc140b10 0x7ff8fc140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8f9e00640 1 -- 172.21.15.96:0/3357031680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc15e4b0 msgr2=0x7ff8fc15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8f9e00640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc15e4b0 0x7ff8fc15e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8f9e00640 1 -- 172.21.15.96:0/3357031680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc13f340 con 0x7ff8e0004800 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.699+0000 7ff8f9e00640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8fc13d1e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00c790 tx=0x7ff8ec00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.700+0000 7ff8f2a00640 1 -- 172.21.15.96:0/3357031680 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec018070 con 0x7ff8e0004800 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.700+0000 7ff8f2a00640 1 -- 172.21.15.96:0/3357031680 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0074e0 con 0x7ff8e0004800 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.700+0000 7ff8f2a00640 1 -- 172.21.15.96:0/3357031680 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec004a20 con 0x7ff8e0004800 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.700+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc13f620 con 0x7ff8e0004800 2024-04-24T23:59:40.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.700+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc13fbe0 con 0x7ff8e0004800 2024-04-24T23:59:40.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.701+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc0755d0 con 0x7ff8e0004800 2024-04-24T23:59:40.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.702+0000 7ff8f2a00640 1 -- 172.21.15.96:0/3357031680 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff8ec004bc0 con 0x7ff8e0004800 2024-04-24T23:59:40.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.702+0000 7ff8f2a00640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8d806bfe0 0x7ff8d806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:40.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.703+0000 7ff8f2a00640 1 -- 172.21.15.96:0/3357031680 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff8ec08a7d0 con 0x7ff8e0004800 2024-04-24T23:59:40.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.703+0000 7ff8f1400640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8d806bfe0 0x7ff8d806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:40.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.704+0000 7ff8f1400640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8d806bfe0 0x7ff8d806e4a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4033000 tx=0x7ff8e402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:40.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.707+0000 7ff8f2a00640 1 -- 172.21.15.96:0/3357031680 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff8ec058dd0 con 0x7ff8e0004800 2024-04-24T23:59:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.902+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff8fc0cd190 con 0x7ff8e0004800 2024-04-24T23:59:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.903+0000 7ff8f2a00640 1 -- 172.21.15.96:0/3357031680 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7ff8ec0586d0 con 0x7ff8e0004800 2024-04-24T23:59:40.904 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-24T23:59:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8d806bfe0 msgr2=0x7ff8d806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8d806bfe0 0x7ff8d806e4a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4033000 tx=0x7ff8e402e000 comp rx=0 tx=0).stop 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 msgr2=0x7ff8fc13d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8fc13d1e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00c790 tx=0x7ff8ec00cc50 comp rx=0 tx=0).stop 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 shutdown_connections 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc15e4b0 0x7ff8fc15e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc140b10 0x7ff8fc140f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff8d806bfe0 0x7ff8d806e4a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 --2- 172.21.15.96:0/3357031680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8e0004800 0x7ff8fc13d1e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 >> 172.21.15.96:0/3357031680 conn(0x7ff8fc0b18b0 msgr2=0x7ff8fc160240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 shutdown_connections 2024-04-24T23:59:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:40.906+0000 7ff8fb200640 1 -- 172.21.15.96:0/3357031680 wait complete. 2024-04-24T23:59:40.925 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:59:41.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.128+0000 7f3577a00640 1 Processor -- start 2024-04-24T23:59:41.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.128+0000 7f3577a00640 1 -- start start 2024-04-24T23:59:41.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.130+0000 7f3577a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3570156620 0x7f357015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.130+0000 7f3577a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35700ae8e0 0x7f35700aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.130+0000 7f3577a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f357006d100 con 0x7f357006edf0 2024-04-24T23:59:41.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.130+0000 7f3577a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f35700acda0 con 0x7f35700ae8e0 2024-04-24T23:59:41.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.130+0000 7f3577a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f35700ad060 con 0x7f3570156620 2024-04-24T23:59:41.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.130+0000 7f356fe00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f357006edf0 0x7f357006dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54316/0 (socket says 172.21.15.96:54316) 2024-04-24T23:59:41.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.130+0000 7f356fe00640 1 -- 172.21.15.96:0/1771012315 learned_addr learned my addr 172.21.15.96:0/1771012315 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:41.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f3575a00640 1 --2- 172.21.15.96:0/1771012315 >> v2:172.21.15.155:3300/0 conn(0x7f35700ae8e0 0x7f35700aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f3575000640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3570156620 0x7f357015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576206085 0 0) 0x7f357006d100 con 0x7f357006edf0 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3558003520 con 0x7f357006edf0 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3842801551 0 0) 0x7f3558003520 con 0x7f357006edf0 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3570156620 msgr2=0x7f357015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3570156620 0x7f357015cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 >> v2:172.21.15.155:3300/0 conn(0x7f35700ae8e0 msgr2=0x7f35700aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 --2- 172.21.15.96:0/1771012315 >> v2:172.21.15.155:3300/0 conn(0x7f35700ae8e0 0x7f35700aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357006d3a0 con 0x7f357006edf0 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f355c001670 con 0x7f357006edf0 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 >> v1:172.21.15.96:6789/0 conn(0x7f357006edf0 legacy=0x7f357006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.131+0000 7f356f400640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3570156620 0x7f35580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356f400640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3558003f80 0x7f3558004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356f400640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3558004d40 0x7f35580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f35700acda0 con 0x7f3558003f80 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f35700ad060 con 0x7f3558004d40 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f355800ba70 con 0x7f3570156620 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356fe00640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3558003f80 0x7f3558004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f3575000640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3570156620 0x7f35580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356fe00640 1 -- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3570156620 msgr2=0x7f35580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356fe00640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3570156620 0x7f35580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356fe00640 1 -- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3558004d40 msgr2=0x7f35580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f3575a00640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3558004d40 0x7f35580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356fe00640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3558004d40 0x7f35580051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f356fe00640 1 -- 172.21.15.96:0/1771012315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3558003520 con 0x7f3558003f80 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.132+0000 7f3575000640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3570156620 0x7f35580039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.133+0000 7f356fe00640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3558003f80 0x7f3558004800 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f357006f210 tx=0x7f3558005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8ed9ece4d10e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c007c80 con 0x7f3558003f80 2024-04-24T23:59:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355c005ad0 con 0x7f3558003f80 2024-04-24T23:59:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f356f400640 1 -- 172.21.15.96:0/1771012315 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c007070 con 0x7f3558003f80 2024-04-24T23:59:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f3577a00640 1 -- 172.21.15.96:0/1771012315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3558003f80 msgr2=0x7f3558004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f3577a00640 1 --2- 172.21.15.96:0/1771012315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3558003f80 0x7f3558004800 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f357006f210 tx=0x7f3558005830 comp rx=0 tx=0).stop 2024-04-24T23:59:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f3575a00640 1 -- 172.21.15.96:0/1771012315 reap_dead start 2024-04-24T23:59:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f3577a00640 1 -- 172.21.15.96:0/1771012315 shutdown_connections 2024-04-24T23:59:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f3577a00640 1 -- 172.21.15.96:0/1771012315 >> 172.21.15.96:0/1771012315 conn(0x7f35700b19c0 msgr2=0x7f35700b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f3577a00640 1 -- 172.21.15.96:0/1771012315 shutdown_connections 2024-04-24T23:59:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.134+0000 7f3577a00640 1 -- 172.21.15.96:0/1771012315 wait complete. 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.136+0000 7f3577a00640 1 Processor -- start 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.136+0000 7f3577a00640 1 -- start start 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.137+0000 7f3577a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3558003f80 0x7f357014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.137+0000 7f3577a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f357014d190 0x7f35700d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.137+0000 7f3577a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35700d0800 0x7f357015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.137+0000 7f3577a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f35700ad340 con 0x7f357014d190 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.137+0000 7f3577a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f35700af2b0 con 0x7f35700d0800 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.137+0000 7f3577a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f35700ad4c0 con 0x7f3558003f80 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f356fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f357014d190 0x7f35700d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f356fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f357014d190 0x7f35700d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51478/0 (socket says 172.21.15.96:51478) 2024-04-24T23:59:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f356fe00640 1 -- 172.21.15.96:0/1187272512 learned_addr learned my addr 172.21.15.96:0/1187272512 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f3575000640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3558003f80 0x7f357014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f3575a00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35700d0800 0x7f357015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f356fe00640 1 -- 172.21.15.96:0/1187272512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3558003f80 msgr2=0x7f357014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f356fe00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3558003f80 0x7f357014b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f356fe00640 1 -- 172.21.15.96:0/1187272512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35700d0800 msgr2=0x7f357015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f356fe00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35700d0800 0x7f357015e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f356fe00640 1 -- 172.21.15.96:0/1187272512 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357014bd50 con 0x7f357014d190 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.138+0000 7f3575000640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3558003f80 0x7f357014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.139+0000 7f356fe00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f357014d190 0x7f35700d02c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f355c00c220 tx=0x7f3570072e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.139+0000 7f356cc00640 1 -- 172.21.15.96:0/1187272512 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c041020 con 0x7f357014d190 2024-04-24T23:59:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.139+0000 7f356cc00640 1 -- 172.21.15.96:0/1187272512 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355c001430 con 0x7f357014d190 2024-04-24T23:59:41.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.139+0000 7f356cc00640 1 -- 172.21.15.96:0/1187272512 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c007070 con 0x7f357014d190 2024-04-24T23:59:41.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.139+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35701f4620 con 0x7f357014d190 2024-04-24T23:59:41.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.139+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35701f4be0 con 0x7f357014d190 2024-04-24T23:59:41.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.140+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3570069110 con 0x7f357014d190 2024-04-24T23:59:41.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.141+0000 7f356cc00640 1 -- 172.21.15.96:0/1187272512 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f355c044020 con 0x7f357014d190 2024-04-24T23:59:41.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.142+0000 7f356cc00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f355006c010 0x7f355006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.142+0000 7f356cc00640 1 -- 172.21.15.96:0/1187272512 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f355c0ab4c0 con 0x7f357014d190 2024-04-24T23:59:41.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.142+0000 7f3575000640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f355006c010 0x7f355006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.143+0000 7f3575000640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f355006c010 0x7f355006e4d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f35640099c0 tx=0x7f3564008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:41.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.146+0000 7f356cc00640 1 -- 172.21.15.96:0/1187272512 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f357014bd50 con 0x7f357014d190 2024-04-24T23:59:41.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.328+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f35700af9d0 con 0x7f357014d190 2024-04-24T23:59:41.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.329+0000 7f356cc00640 1 -- 172.21.15.96:0/1187272512 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f355c079c00 con 0x7f357014d190 2024-04-24T23:59:41.329 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-24T23:59:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f355006c010 msgr2=0x7f355006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f355006c010 0x7f355006e4d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f35640099c0 tx=0x7f3564008040 comp rx=0 tx=0).stop 2024-04-24T23:59:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f357014d190 msgr2=0x7f35700d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f357014d190 0x7f35700d02c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f355c00c220 tx=0x7f3570072e80 comp rx=0 tx=0).stop 2024-04-24T23:59:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 shutdown_connections 2024-04-24T23:59:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35700d0800 0x7f357015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f355006c010 0x7f355006e4d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f357014d190 0x7f35700d02c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 --2- 172.21.15.96:0/1187272512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3558003f80 0x7f357014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 >> 172.21.15.96:0/1187272512 conn(0x7f35700b19c0 msgr2=0x7f357015b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 shutdown_connections 2024-04-24T23:59:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.332+0000 7f3577a00640 1 -- 172.21.15.96:0/1187272512 wait complete. 2024-04-24T23:59:41.351 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:59:41.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.548+0000 7f3676c00640 1 Processor -- start 2024-04-24T23:59:41.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.548+0000 7f3676c00640 1 -- start start 2024-04-24T23:59:41.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.550+0000 7f3676c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36700b4ec0 0x7f36700cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.550+0000 7f3676c00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367015fa90 con 0x7f36700ccc20 2024-04-24T23:59:41.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.550+0000 7f3676c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36700b3e20 con 0x7f367015f6b0 2024-04-24T23:59:41.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.550+0000 7f3676c00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f36700b4a30 con 0x7f36700b4ec0 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.550+0000 7f3676200640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f36700ccc20 0x7f3670070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54332/0 (socket says 172.21.15.96:54332) 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.550+0000 7f3676200640 1 -- 172.21.15.96:0/1484227686 learned_addr learned my addr 172.21.15.96:0/1484227686 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.550+0000 7f3674e00640 1 --2- 172.21.15.96:0/1484227686 >> v2:172.21.15.96:3300/0 conn(0x7f36700b4ec0 0x7f36700cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.551+0000 7f366fe00640 1 -- 172.21.15.96:0/1484227686 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002058081 0 0) 0x7f367015fa90 con 0x7f36700ccc20 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.551+0000 7f3674e00640 1 -- 172.21.15.96:0/1484227686 >> v1:172.21.15.155:6789/0 conn(0x7f367015f6b0 legacy=0x7f36700ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.551+0000 7f3674e00640 1 -- 172.21.15.96:0/1484227686 >> v1:172.21.15.96:6789/0 conn(0x7f36700ccc20 legacy=0x7f3670070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.551+0000 7f3674e00640 1 -- 172.21.15.96:0/1484227686 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36700b4100 con 0x7f36700b4ec0 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.552+0000 7f3674e00640 1 --2- 172.21.15.96:0/1484227686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36700b4ec0 0x7f36700cc6e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f365c0097a0 tx=0x7f365c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5092d08e6b5146e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.552+0000 7f366fe00640 1 -- 172.21.15.96:0/1484227686 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c037070 con 0x7f36700b4ec0 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.552+0000 7f366fe00640 1 -- 172.21.15.96:0/1484227686 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c032440 con 0x7f36700b4ec0 2024-04-24T23:59:41.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.552+0000 7f366fe00640 1 -- 172.21.15.96:0/1484227686 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c032810 con 0x7f36700b4ec0 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.553+0000 7f3676c00640 1 -- 172.21.15.96:0/1484227686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36700b4ec0 msgr2=0x7f36700cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.553+0000 7f3676c00640 1 --2- 172.21.15.96:0/1484227686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36700b4ec0 0x7f36700cc6e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f365c0097a0 tx=0x7f365c02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.553+0000 7f3676c00640 1 -- 172.21.15.96:0/1484227686 shutdown_connections 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.553+0000 7f3676c00640 1 --2- 172.21.15.96:0/1484227686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36700b4ec0 0x7f36700cc6e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.553+0000 7f3676c00640 1 -- 172.21.15.96:0/1484227686 >> 172.21.15.96:0/1484227686 conn(0x7f36700b1f10 msgr2=0x7f36700cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.553+0000 7f3676c00640 1 -- 172.21.15.96:0/1484227686 shutdown_connections 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.553+0000 7f3676c00640 1 -- 172.21.15.96:0/1484227686 wait complete. 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.555+0000 7f3676c00640 1 Processor -- start 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.555+0000 7f3676c00640 1 -- start start 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3676c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36700b4ec0 0x7f36700b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3676c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36700ccc20 0x7f36700b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3676c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f367015f6b0 0x7f367009b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3676c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f36700cf1c0 con 0x7f367015f6b0 2024-04-24T23:59:41.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3676c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36700b46c0 con 0x7f36700ccc20 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3676c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36700b3a40 con 0x7f36700b4ec0 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3676200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f367015f6b0 0x7f367009b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3676200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f367015f6b0 0x7f367009b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51486/0 (socket says 172.21.15.96:51486) 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3676200640 1 -- 172.21.15.96:0/767052551 learned_addr learned my addr 172.21.15.96:0/767052551 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3675800640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36700b4ec0 0x7f36700b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.556+0000 7f3674e00640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36700ccc20 0x7f36700b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f3676200640 1 -- 172.21.15.96:0/767052551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36700b4ec0 msgr2=0x7f36700b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f3676200640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36700b4ec0 0x7f36700b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f3676200640 1 -- 172.21.15.96:0/767052551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36700ccc20 msgr2=0x7f36700b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f3676200640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36700ccc20 0x7f36700b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f3676200640 1 -- 172.21.15.96:0/767052551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36701f7900 con 0x7f367015f6b0 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f3676200640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f367015f6b0 0x7f367009b7e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f366800c7d0 tx=0x7f366800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f366d600640 1 -- 172.21.15.96:0/767052551 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668018070 con 0x7f367015f6b0 2024-04-24T23:59:41.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f366d600640 1 -- 172.21.15.96:0/767052551 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366800a640 con 0x7f367015f6b0 2024-04-24T23:59:41.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36701f7be0 con 0x7f367015f6b0 2024-04-24T23:59:41.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f366d600640 1 -- 172.21.15.96:0/767052551 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366800aa70 con 0x7f367015f6b0 2024-04-24T23:59:41.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.557+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36700ad400 con 0x7f367015f6b0 2024-04-24T23:59:41.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.558+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3670067e40 con 0x7f367015f6b0 2024-04-24T23:59:41.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.559+0000 7f366d600640 1 -- 172.21.15.96:0/767052551 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f366801b070 con 0x7f367015f6b0 2024-04-24T23:59:41.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.560+0000 7f366d600640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f365006bfe0 0x7f365006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:41.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.560+0000 7f366d600640 1 -- 172.21.15.96:0/767052551 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f366808a7f0 con 0x7f367015f6b0 2024-04-24T23:59:41.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.560+0000 7f3675800640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f365006bfe0 0x7f365006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:41.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.561+0000 7f3675800640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f365006bfe0 0x7f365006e4a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3664006fd0 tx=0x7f3664008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:41.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.565+0000 7f366d600640 1 -- 172.21.15.96:0/767052551 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3668058f10 con 0x7f367015f6b0 2024-04-24T23:59:41.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.804+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36700756b0 con 0x7f367015f6b0 2024-04-24T23:59:41.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.805+0000 7f366d600640 1 -- 172.21.15.96:0/767052551 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f3668058810 con 0x7f367015f6b0 2024-04-24T23:59:41.806 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:41.806 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1875464528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1875464528},{"type":"v1","addr":"172.21.15.155:6835","nonce":1875464528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/2449705897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":2449705897},{"type":"v1","addr":"172.21.15.96:6837","nonce":2449705897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4160377725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4160377725},{"type":"v1","addr":"172.21.15.155:6833","nonce":4160377725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:59:15.923615+0000","modified":"2024-04-24T23:59:19.009098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.96:6835/3672280349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3672280349},{"type":"v1","addr":"172.21.15.96:6835","nonce":3672280349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5097,"qdb_cluster":[5097]},"id":2}]} 2024-04-24T23:59:41.806 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-24T23:59:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f365006bfe0 msgr2=0x7f365006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f365006bfe0 0x7f365006e4a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3664006fd0 tx=0x7f3664008040 comp rx=0 tx=0).stop 2024-04-24T23:59:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f367015f6b0 msgr2=0x7f367009b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f367015f6b0 0x7f367009b7e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f366800c7d0 tx=0x7f366800cc90 comp rx=0 tx=0).stop 2024-04-24T23:59:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 shutdown_connections 2024-04-24T23:59:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f365006bfe0 0x7f365006e4a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f367015f6b0 0x7f367009b7e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36700ccc20 0x7f36700b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 --2- 172.21.15.96:0/767052551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36700b4ec0 0x7f36700b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 >> 172.21.15.96:0/767052551 conn(0x7f36700b1f10 msgr2=0x7f36700cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 shutdown_connections 2024-04-24T23:59:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:41.808+0000 7f3676c00640 1 -- 172.21.15.96:0/767052551 wait complete. 2024-04-24T23:59:41.828 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:42.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.029+0000 7f01bf600640 1 Processor -- start 2024-04-24T23:59:42.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.030+0000 7f01bf600640 1 -- start start 2024-04-24T23:59:42.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.031+0000 7f01bf600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f01b815ee50 0x7f01b80d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.031+0000 7f01bf600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b815fba0 con 0x7f01b815f230 2024-04-24T23:59:42.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.031+0000 7f01bf600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b80d4eb0 con 0x7f01b80d2c00 2024-04-24T23:59:42.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.031+0000 7f01bf600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f01b815fe40 con 0x7f01b815ee50 2024-04-24T23:59:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.031+0000 7f01b7e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f01b815f230 0x7f01b80d24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54348/0 (socket says 172.21.15.96:54348) 2024-04-24T23:59:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.031+0000 7f01b7e00640 1 -- 172.21.15.96:0/1539137609 learned_addr learned my addr 172.21.15.96:0/1539137609 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01bcc00640 1 --2- 172.21.15.96:0/1539137609 >> v2:172.21.15.155:3300/0 conn(0x7f01b815ee50 0x7f01b80d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519388997 0 0) 0x7f01b815fba0 con 0x7f01b815f230 2024-04-24T23:59:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0198003520 con 0x7f01b815f230 2024-04-24T23:59:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3060575534 0 0) 0x7f0198003520 con 0x7f01b815f230 2024-04-24T23:59:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 >> v2:172.21.15.155:3300/0 conn(0x7f01b815ee50 msgr2=0x7f01b80d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 --2- 172.21.15.96:0/1539137609 >> v2:172.21.15.155:3300/0 conn(0x7f01b815ee50 0x7f01b80d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 >> v1:172.21.15.155:6789/0 conn(0x7f01b80d2c00 legacy=0x7f01b8160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b8160120 con 0x7f01b815f230 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f01a00019f0 con 0x7f01b815f230 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 >> v1:172.21.15.96:6789/0 conn(0x7f01b815f230 legacy=0x7f01b80d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0198003a00 0x7f0198003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0198004800 0x7f0198004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01980051c0 0x7f019800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f01b815fe40 con 0x7f0198003a00 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f019800c0c0 con 0x7f01980051c0 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.032+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f019800c2c0 con 0x7f0198004800 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.033+0000 7f01bcc00640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0198003a00 0x7f0198003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.033+0000 7f01bd600640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01980051c0 0x7f019800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.033+0000 7f01bcc00640 1 -- 172.21.15.96:0/1539137609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0198004800 msgr2=0x7f0198004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:42.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.033+0000 7f01bcc00640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0198004800 0x7f0198004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.033+0000 7f01bcc00640 1 -- 172.21.15.96:0/1539137609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01980051c0 msgr2=0x7f019800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:42.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.033+0000 7f01bcc00640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01980051c0 0x7f019800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.033+0000 7f01bd600640 1 -- 172.21.15.96:0/1539137609 reap_dead start 2024-04-24T23:59:42.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.033+0000 7f01bcc00640 1 -- 172.21.15.96:0/1539137609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0198003520 con 0x7f0198003a00 2024-04-24T23:59:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.034+0000 7f01bcc00640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0198003a00 0x7f0198003e20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009ac0 tx=0x7f0198005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9fe1e24cd1a4be server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.034+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8036070 con 0x7f0198003a00 2024-04-24T23:59:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.034+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a8031400 con 0x7f0198003a00 2024-04-24T23:59:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.034+0000 7f01b7400640 1 -- 172.21.15.96:0/1539137609 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8009690 con 0x7f0198003a00 2024-04-24T23:59:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.035+0000 7f01bf600640 1 -- 172.21.15.96:0/1539137609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0198003a00 msgr2=0x7f0198003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.035+0000 7f01bf600640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0198003a00 0x7f0198003e20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009ac0 tx=0x7f0198005830 comp rx=0 tx=0).stop 2024-04-24T23:59:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.035+0000 7f01bf600640 1 -- 172.21.15.96:0/1539137609 shutdown_connections 2024-04-24T23:59:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.035+0000 7f01bf600640 1 --2- 172.21.15.96:0/1539137609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0198003a00 0x7f0198003e20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.035+0000 7f01bf600640 1 -- 172.21.15.96:0/1539137609 >> 172.21.15.96:0/1539137609 conn(0x7f01b809d450 msgr2=0x7f01b80d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.035+0000 7f01bf600640 1 -- 172.21.15.96:0/1539137609 shutdown_connections 2024-04-24T23:59:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.035+0000 7f01bf600640 1 -- 172.21.15.96:0/1539137609 wait complete. 2024-04-24T23:59:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.037+0000 7f01bf600640 1 Processor -- start 2024-04-24T23:59:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.037+0000 7f01bf600640 1 -- start start 2024-04-24T23:59:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bf600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0198003a00 0x7f01b815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bf600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b80b5290 0x7f01b80ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bf600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01b80c7b50 0x7f01b80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bf600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f01b815f810 con 0x7f01b80c7b50 2024-04-24T23:59:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bf600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01b815f690 con 0x7f0198003a00 2024-04-24T23:59:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bf600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01b80d47b0 con 0x7f01b80b5290 2024-04-24T23:59:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bd600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01b80c7b50 0x7f01b80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bd600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01b80c7b50 0x7f01b80c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51494/0 (socket says 172.21.15.96:51494) 2024-04-24T23:59:42.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bd600640 1 -- 172.21.15.96:0/371324546 learned_addr learned my addr 172.21.15.96:0/371324546 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01b7e00640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b80b5290 0x7f01b80ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bcc00640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0198003a00 0x7f01b815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bd600640 1 -- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b80b5290 msgr2=0x7f01b80ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.038+0000 7f01bd600640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b80b5290 0x7f01b80ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01bd600640 1 -- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0198003a00 msgr2=0x7f01b815bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01bd600640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0198003a00 0x7f01b815bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01bd600640 1 -- 172.21.15.96:0/371324546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b80cd0c0 con 0x7f01b80c7b50 2024-04-24T23:59:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01b7e00640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b80b5290 0x7f01b80ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01bcc00640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0198003a00 0x7f01b815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01bd600640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01b80c7b50 0x7f01b80c7fd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f01b80ce920 tx=0x7f01b000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01b4c00640 1 -- 172.21.15.96:0/371324546 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b0018070 con 0x7f01b80c7b50 2024-04-24T23:59:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01b4c00640 1 -- 172.21.15.96:0/371324546 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b00035f0 con 0x7f01b80c7b50 2024-04-24T23:59:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01b4c00640 1 -- 172.21.15.96:0/371324546 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b00039e0 con 0x7f01b80c7b50 2024-04-24T23:59:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b815c340 con 0x7f01b80c7b50 2024-04-24T23:59:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.039+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b80cd620 con 0x7f01b80c7b50 2024-04-24T23:59:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.040+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b815c510 con 0x7f01b80c7b50 2024-04-24T23:59:42.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.041+0000 7f01b4c00640 1 -- 172.21.15.96:0/371324546 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f01b0003b80 con 0x7f01b80c7b50 2024-04-24T23:59:42.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.042+0000 7f01b4c00640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f019406c010 0x7f019406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.042+0000 7f01b4c00640 1 -- 172.21.15.96:0/371324546 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f01b008a830 con 0x7f01b80c7b50 2024-04-24T23:59:42.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.042+0000 7f01bcc00640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f019406c010 0x7f019406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.043+0000 7f01bcc00640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f019406c010 0x7f019406e4d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f01a8033000 tx=0x7f01a8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:42.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.046+0000 7f01b4c00640 1 -- 172.21.15.96:0/371324546 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f01b80cd0c0 con 0x7f01b80c7b50 2024-04-24T23:59:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.243+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01b8069110 con 0x7f01b80c7b50 2024-04-24T23:59:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.244+0000 7f01b4c00640 1 -- 172.21.15.96:0/371324546 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16621 (secure 0 0 0) 0x7f01b0058e50 con 0x7f01b80c7b50 2024-04-24T23:59:42.245 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:42.245 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":33,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:17.499374+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:59:13.640002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T23:59:14.952491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f019406c010 msgr2=0x7f019406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f019406c010 0x7f019406e4d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f01a8033000 tx=0x7f01a8008030 comp rx=0 tx=0).stop 2024-04-24T23:59:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01b80c7b50 msgr2=0x7f01b80c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01b80c7b50 0x7f01b80c7fd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f01b80ce920 tx=0x7f01b000d890 comp rx=0 tx=0).stop 2024-04-24T23:59:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 shutdown_connections 2024-04-24T23:59:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f019406c010 0x7f019406e4d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01b80c7b50 0x7f01b80c7fd0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b80b5290 0x7f01b80ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 --2- 172.21.15.96:0/371324546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0198003a00 0x7f01b815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 >> 172.21.15.96:0/371324546 conn(0x7f01b809d450 msgr2=0x7f01b80cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 shutdown_connections 2024-04-24T23:59:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.247+0000 7f01bf600640 1 -- 172.21.15.96:0/371324546 wait complete. 2024-04-24T23:59:42.266 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:59:42.267 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:59:42.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.454+0000 7f99b3200640 1 Processor -- start 2024-04-24T23:59:42.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.454+0000 7f99b3200640 1 -- start start 2024-04-24T23:59:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.456+0000 7f99b3200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f99b40b4ec0 0x7f99b40cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.456+0000 7f99b3200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b40ccc20 0x7f99b4070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.456+0000 7f99b3200640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b415fa90 con 0x7f99b415f6b0 2024-04-24T23:59:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.456+0000 7f99b3200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f99b40b4a30 con 0x7f99b40b4ec0 2024-04-24T23:59:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.456+0000 7f99b3200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f99b40b3e20 con 0x7f99b40ccc20 2024-04-24T23:59:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.456+0000 7f99b1400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f99b40b4ec0 0x7f99b40cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.456+0000 7f99b1e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f99b415f6b0 0x7f99b40ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54356/0 (socket says 172.21.15.96:54356) 2024-04-24T23:59:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.456+0000 7f99b1e00640 1 -- 172.21.15.96:0/3968836357 learned_addr learned my addr 172.21.15.96:0/3968836357 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.457+0000 7f99b2800640 1 --2- 172.21.15.96:0/3968836357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b40ccc20 0x7f99b4070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.457+0000 7f99b1400640 1 -- 172.21.15.96:0/3968836357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b40ccc20 msgr2=0x7f99b4070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.457+0000 7f99b1400640 1 --2- 172.21.15.96:0/3968836357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b40ccc20 0x7f99b4070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.457+0000 7f99b1400640 1 -- 172.21.15.96:0/3968836357 >> v1:172.21.15.96:6789/0 conn(0x7f99b415f6b0 legacy=0x7f99b40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.457+0000 7f99b1400640 1 -- 172.21.15.96:0/3968836357 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b40b4100 con 0x7f99b40b4ec0 2024-04-24T23:59:42.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.457+0000 7f99b0a00640 1 -- 172.21.15.96:0/3968836357 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384889495 0 0) 0x7f99b415fa90 con 0x7f99b415f6b0 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.458+0000 7f99b1400640 1 --2- 172.21.15.96:0/3968836357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 0x7f99b40cc6e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f99a00097a0 tx=0x7f99a002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194892f8f2304290 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.458+0000 7f99b0a00640 1 -- 172.21.15.96:0/3968836357 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0037070 con 0x7f99b40b4ec0 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.458+0000 7f99b0a00640 1 -- 172.21.15.96:0/3968836357 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a0032440 con 0x7f99b40b4ec0 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.458+0000 7f99b0a00640 1 -- 172.21.15.96:0/3968836357 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0032810 con 0x7f99b40b4ec0 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.458+0000 7f99b3200640 1 -- 172.21.15.96:0/3968836357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 msgr2=0x7f99b40cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.459+0000 7f99b3200640 1 --2- 172.21.15.96:0/3968836357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 0x7f99b40cc6e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f99a00097a0 tx=0x7f99a002a180 comp rx=0 tx=0).stop 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.459+0000 7f99b3200640 1 -- 172.21.15.96:0/3968836357 shutdown_connections 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.459+0000 7f99b3200640 1 --2- 172.21.15.96:0/3968836357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b40ccc20 0x7f99b4070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.459+0000 7f99b3200640 1 --2- 172.21.15.96:0/3968836357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 0x7f99b40cc6e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.459+0000 7f99b3200640 1 -- 172.21.15.96:0/3968836357 >> 172.21.15.96:0/3968836357 conn(0x7f99b40b1f10 msgr2=0x7f99b40cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:42.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.459+0000 7f99b3200640 1 -- 172.21.15.96:0/3968836357 shutdown_connections 2024-04-24T23:59:42.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.459+0000 7f99b3200640 1 -- 172.21.15.96:0/3968836357 wait complete. 2024-04-24T23:59:42.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.460+0000 7f99b3200640 1 Processor -- start 2024-04-24T23:59:42.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.460+0000 7f99b3200640 1 -- start start 2024-04-24T23:59:42.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.461+0000 7f99b3200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 0x7f99b4146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.461+0000 7f99b3200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b40ccc20 0x7f99b409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.461+0000 7f99b3200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b415f6b0 0x7f99b40adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.461+0000 7f99b3200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f99b40cf1c0 con 0x7f99b40b4ec0 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.461+0000 7f99b3200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f99b40b46c0 con 0x7f99b40ccc20 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.461+0000 7f99b3200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f99b40b3a40 con 0x7f99b415f6b0 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 0x7f99b4146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 0x7f99b4146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51522/0 (socket says 172.21.15.96:51522) 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1e00640 1 -- 172.21.15.96:0/2631750530 learned_addr learned my addr 172.21.15.96:0/2631750530 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b2800640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b415f6b0 0x7f99b40adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1e00640 1 -- 172.21.15.96:0/2631750530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b415f6b0 msgr2=0x7f99b40adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1400640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b40ccc20 0x7f99b409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1e00640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b415f6b0 0x7f99b40adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1e00640 1 -- 172.21.15.96:0/2631750530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b40ccc20 msgr2=0x7f99b409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1e00640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b40ccc20 0x7f99b409aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1e00640 1 -- 172.21.15.96:0/2631750530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b40acf40 con 0x7f99b40b4ec0 2024-04-24T23:59:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b2800640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b415f6b0 0x7f99b40adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:42.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.462+0000 7f99b1e00640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 0x7f99b4146850 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f99a400c430 tx=0x7f99a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:42.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.463+0000 7f99aa000640 1 -- 172.21.15.96:0/2631750530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a40074e0 con 0x7f99b40b4ec0 2024-04-24T23:59:42.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.463+0000 7f99aa000640 1 -- 172.21.15.96:0/2631750530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a40047e0 con 0x7f99b40b4ec0 2024-04-24T23:59:42.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.463+0000 7f99aa000640 1 -- 172.21.15.96:0/2631750530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4004bd0 con 0x7f99b40b4ec0 2024-04-24T23:59:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.463+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b40ad220 con 0x7f99b40b4ec0 2024-04-24T23:59:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.463+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b40ad7e0 con 0x7f99b40b4ec0 2024-04-24T23:59:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.464+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b40756b0 con 0x7f99b40b4ec0 2024-04-24T23:59:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.465+0000 7f99aa000640 1 -- 172.21.15.96:0/2631750530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f99a4011070 con 0x7f99b40b4ec0 2024-04-24T23:59:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.466+0000 7f99aa000640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f999406c010 0x7f999406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.466+0000 7f99aa000640 1 -- 172.21.15.96:0/2631750530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f99a408ad20 con 0x7f99b40b4ec0 2024-04-24T23:59:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.466+0000 7f99b1400640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f999406c010 0x7f999406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.467+0000 7f99b1400640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f999406c010 0x7f999406e4d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f99a0034000 tx=0x7f99a002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:42.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.470+0000 7f99aa000640 1 -- 172.21.15.96:0/2631750530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f99a4059440 con 0x7f99b40b4ec0 2024-04-24T23:59:42.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.709+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99b4071730 con 0x7f99b40b4ec0 2024-04-24T23:59:42.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.710+0000 7f99aa000640 1 -- 172.21.15.96:0/2631750530 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f99a4058d40 con 0x7f99b40b4ec0 2024-04-24T23:59:42.710 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:42.711 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1875464528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1875464528},{"type":"v1","addr":"172.21.15.155:6835","nonce":1875464528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/2449705897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":2449705897},{"type":"v1","addr":"172.21.15.96:6837","nonce":2449705897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4160377725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4160377725},{"type":"v1","addr":"172.21.15.155:6833","nonce":4160377725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:59:15.923615+0000","modified":"2024-04-24T23:59:19.009098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.96:6835/3672280349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3672280349},{"type":"v1","addr":"172.21.15.96:6835","nonce":3672280349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5097,"qdb_cluster":[5097]},"id":2}]} 2024-04-24T23:59:42.711 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-24T23:59:42.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f999406c010 msgr2=0x7f999406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f999406c010 0x7f999406e4d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f99a0034000 tx=0x7f99a002e000 comp rx=0 tx=0).stop 2024-04-24T23:59:42.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 msgr2=0x7f99b4146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 0x7f99b4146850 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f99a400c430 tx=0x7f99a400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 shutdown_connections 2024-04-24T23:59:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b415f6b0 0x7f99b40adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b40ccc20 0x7f99b409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f999406c010 0x7f999406e4d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 --2- 172.21.15.96:0/2631750530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40b4ec0 0x7f99b4146850 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 >> 172.21.15.96:0/2631750530 conn(0x7f99b40b1f10 msgr2=0x7f99b415e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 shutdown_connections 2024-04-24T23:59:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.713+0000 7f99b3200640 1 -- 172.21.15.96:0/2631750530 wait complete. 2024-04-24T23:59:42.731 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:59:42.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.920+0000 7fea61800640 1 Processor -- start 2024-04-24T23:59:42.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.920+0000 7fea61800640 1 -- start start 2024-04-24T23:59:42.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.921+0000 7fea61800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea5c0cdbd0 0x7fea5c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.922+0000 7fea61800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea5c0ce100 con 0x7fea5c071470 2024-04-24T23:59:42.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.922+0000 7fea61800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea5c0ce3e0 con 0x7fea5c1553f0 2024-04-24T23:59:42.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.922+0000 7fea61800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fea5c0ce6c0 con 0x7fea5c0cdbd0 2024-04-24T23:59:42.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.922+0000 7fea53400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fea5c071470 0x7fea5c06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54362/0 (socket says 172.21.15.96:54362) 2024-04-24T23:59:42.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.922+0000 7fea53400640 1 -- 172.21.15.96:0/3789823268 learned_addr learned my addr 172.21.15.96:0/3789823268 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.922+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837862352 0 0) 0x7fea5c0ce100 con 0x7fea5c071470 2024-04-24T23:59:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.922+0000 7fea60e00640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea5c0cdbd0 0x7fea5c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.922+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea40003520 con 0x7fea5c071470 2024-04-24T23:59:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2364056297 0 0) 0x7fea40003520 con 0x7fea5c071470 2024-04-24T23:59:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea5c0cdbd0 msgr2=0x7fea5c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea5c0cdbd0 0x7fea5c15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 >> v1:172.21.15.155:6789/0 conn(0x7fea5c1553f0 legacy=0x7fea5c070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c0ce9a0 con 0x7fea5c071470 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fea44001690 con 0x7fea5c071470 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 >> v1:172.21.15.96:6789/0 conn(0x7fea5c071470 legacy=0x7fea5c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea400039e0 0x7fea40003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea40004800 0x7fea40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea400051c0 0x7fea4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c0ce6c0 con 0x7fea400051c0 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea4000c090 con 0x7fea400039e0 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fea4000e4a0 con 0x7fea40004800 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea60e00640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea5c0cdbd0 0x7fea5c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea60e00640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea400051c0 0x7fea4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea53400640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea40004800 0x7fea40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.923+0000 7fea5be00640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea400039e0 0x7fea40003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.924+0000 7fea60e00640 1 -- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea40004800 msgr2=0x7fea40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.924+0000 7fea60e00640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea40004800 0x7fea40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.924+0000 7fea60e00640 1 -- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea400039e0 msgr2=0x7fea40003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.924+0000 7fea60e00640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea400039e0 0x7fea40003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.924+0000 7fea60e00640 1 -- 172.21.15.96:0/3789823268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea40003520 con 0x7fea400051c0 2024-04-24T23:59:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.924+0000 7fea5be00640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea400039e0 0x7fea40003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.924+0000 7fea53400640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea40004800 0x7fea40004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.925+0000 7fea60e00640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea400051c0 0x7fea4000b9c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fea54009f00 tx=0x7fea40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccdc62ddfe8a8bf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.925+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54009b50 con 0x7fea400051c0 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.925+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea54003990 con 0x7fea400051c0 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.925+0000 7fea5b400640 1 -- 172.21.15.96:0/3789823268 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54003d60 con 0x7fea400051c0 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.925+0000 7fea61800640 1 -- 172.21.15.96:0/3789823268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea400051c0 msgr2=0x7fea4000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.925+0000 7fea61800640 1 --2- 172.21.15.96:0/3789823268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea400051c0 0x7fea4000b9c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fea54009f00 tx=0x7fea40005830 comp rx=0 tx=0).stop 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.925+0000 7fea60e00640 1 -- 172.21.15.96:0/3789823268 reap_dead start 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.925+0000 7fea61800640 1 -- 172.21.15.96:0/3789823268 shutdown_connections 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.925+0000 7fea61800640 1 -- 172.21.15.96:0/3789823268 >> 172.21.15.96:0/3789823268 conn(0x7fea5c0b1f10 msgr2=0x7fea5c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.926+0000 7fea61800640 1 -- 172.21.15.96:0/3789823268 shutdown_connections 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.926+0000 7fea61800640 1 -- 172.21.15.96:0/3789823268 wait complete. 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.927+0000 7fea61800640 1 Processor -- start 2024-04-24T23:59:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.927+0000 7fea61800640 1 -- start start 2024-04-24T23:59:42.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.928+0000 7fea61800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea400051c0 0x7fea5c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.928+0000 7fea61800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c1e6ee0 0x7fea5c0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.928+0000 7fea61800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5c159f70 0x7fea5c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.928+0000 7fea61800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c155950 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.928+0000 7fea61800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c1557d0 con 0x7fea5c159f70 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.928+0000 7fea61800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fea5c15b530 con 0x7fea400051c0 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.928+0000 7fea53400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c1e6ee0 0x7fea5c0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.928+0000 7fea53400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c1e6ee0 0x7fea5c0ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51538/0 (socket says 172.21.15.96:51538) 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.928+0000 7fea53400640 1 -- 172.21.15.96:0/4226598110 learned_addr learned my addr 172.21.15.96:0/4226598110 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea53400640 1 -- 172.21.15.96:0/4226598110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea400051c0 msgr2=0x7fea5c151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea53400640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea400051c0 0x7fea5c151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea53400640 1 -- 172.21.15.96:0/4226598110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5c159f70 msgr2=0x7fea5c15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea60e00640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5c159f70 0x7fea5c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea53400640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5c159f70 0x7fea5c15a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea53400640 1 -- 172.21.15.96:0/4226598110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c0aea70 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea53400640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c1e6ee0 0x7fea5c0ae530 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fea4400d7e0 tx=0x7fea4400dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea58c00640 1 -- 172.21.15.96:0/4226598110 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44019070 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea58c00640 1 -- 172.21.15.96:0/4226598110 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea440074e0 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea58c00640 1 -- 172.21.15.96:0/4226598110 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea440049e0 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.929+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5c1f4320 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.930+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea5c1f48e0 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.931+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5c067e40 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.931+0000 7fea58c00640 1 -- 172.21.15.96:0/4226598110 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fea44004b80 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.932+0000 7fea58c00640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fea3806c010 0x7fea3806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.932+0000 7fea58c00640 1 -- 172.21.15.96:0/4226598110 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fea4408ad30 con 0x7fea5c1e6ee0 2024-04-24T23:59:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.933+0000 7fea5be00640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fea3806c010 0x7fea3806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.933+0000 7fea5be00640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fea3806c010 0x7fea3806e4d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0ccf60 tx=0x7fea4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:42.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:42.937+0000 7fea58c00640 1 -- 172.21.15.96:0/4226598110 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fea440592b0 con 0x7fea5c1e6ee0 2024-04-24T23:59:43.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.157+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea5c0756b0 con 0x7fea5c1e6ee0 2024-04-24T23:59:43.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.158+0000 7fea58c00640 1 -- 172.21.15.96:0/4226598110 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7fea44058bb0 con 0x7fea5c1e6ee0 2024-04-24T23:59:43.158 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:43.158 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1875464528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1875464528},{"type":"v1","addr":"172.21.15.155:6835","nonce":1875464528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/2449705897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":2449705897},{"type":"v1","addr":"172.21.15.96:6837","nonce":2449705897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4160377725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4160377725},{"type":"v1","addr":"172.21.15.155:6833","nonce":4160377725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:59:15.923615+0000","modified":"2024-04-24T23:59:19.009098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.96:6835/3672280349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3672280349},{"type":"v1","addr":"172.21.15.96:6835","nonce":3672280349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5097,"qdb_cluster":[5097]},"id":2}]} 2024-04-24T23:59:43.159 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-24T23:59:43.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fea3806c010 msgr2=0x7fea3806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fea3806c010 0x7fea3806e4d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0ccf60 tx=0x7fea4c009040 comp rx=0 tx=0).stop 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c1e6ee0 msgr2=0x7fea5c0ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c1e6ee0 0x7fea5c0ae530 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fea4400d7e0 tx=0x7fea4400dca0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 shutdown_connections 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea5c159f70 0x7fea5c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fea3806c010 0x7fea3806e4d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c1e6ee0 0x7fea5c0ae530 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 --2- 172.21.15.96:0/4226598110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea400051c0 0x7fea5c151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 >> 172.21.15.96:0/4226598110 conn(0x7fea5c0b1f10 msgr2=0x7fea5c153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 shutdown_connections 2024-04-24T23:59:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.161+0000 7fea61800640 1 -- 172.21.15.96:0/4226598110 wait complete. 2024-04-24T23:59:43.180 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:43.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.374+0000 7f1167800640 1 Processor -- start 2024-04-24T23:59:43.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.375+0000 7f1167800640 1 -- start start 2024-04-24T23:59:43.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.376+0000 7f1167800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f116015c230 0x7f1160071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.376+0000 7f1167800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11600acda0 0x7f11600aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.376+0000 7f1167800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1160160b20 con 0x7f11600aef50 2024-04-24T23:59:43.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.376+0000 7f1167800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f116015c610 con 0x7f116015c230 2024-04-24T23:59:43.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.376+0000 7f1167800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f11600ad230 con 0x7f11600acda0 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f1165800640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f11600aef50 0x7f11600722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54374/0 (socket says 172.21.15.96:54374) 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f1165800640 1 -- 172.21.15.96:0/3407992023 learned_addr learned my addr 172.21.15.96:0/3407992023 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f1164e00640 1 --2- 172.21.15.96:0/3407992023 >> v2:172.21.15.96:3300/0 conn(0x7f116015c230 0x7f1160071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f115fe00640 1 -- 172.21.15.96:0/3407992023 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385412334 0 0) 0x7f1160160b20 con 0x7f11600aef50 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f1157e00640 1 --2- 172.21.15.96:0/3407992023 >> v2:172.21.15.155:3300/0 conn(0x7f11600acda0 0x7f11600aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f115fe00640 1 -- 172.21.15.96:0/3407992023 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1140003520 con 0x7f11600aef50 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f1164e00640 1 -- 172.21.15.96:0/3407992023 >> v2:172.21.15.155:3300/0 conn(0x7f11600acda0 msgr2=0x7f11600aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f1164e00640 1 --2- 172.21.15.96:0/3407992023 >> v2:172.21.15.155:3300/0 conn(0x7f11600acda0 0x7f11600aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f1164e00640 1 -- 172.21.15.96:0/3407992023 >> v1:172.21.15.96:6789/0 conn(0x7f11600aef50 legacy=0x7f11600722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f1164e00640 1 -- 172.21.15.96:0/3407992023 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116015fd60 con 0x7f116015c230 2024-04-24T23:59:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.377+0000 7f1157e00640 1 --2- 172.21.15.96:0/3407992023 >> v2:172.21.15.155:3300/0 conn(0x7f11600acda0 0x7f11600aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.378+0000 7f1164e00640 1 --2- 172.21.15.96:0/3407992023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f116015c230 0x7f1160071800 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1160073640 tx=0x7f114802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97172f5389edcf29 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f115fe00640 1 -- 172.21.15.96:0/3407992023 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148037070 con 0x7f116015c230 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f115fe00640 1 -- 172.21.15.96:0/3407992023 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1148032440 con 0x7f116015c230 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f115fe00640 1 -- 172.21.15.96:0/3407992023 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148032810 con 0x7f116015c230 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f1167800640 1 -- 172.21.15.96:0/3407992023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f116015c230 msgr2=0x7f1160071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f1167800640 1 --2- 172.21.15.96:0/3407992023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f116015c230 0x7f1160071800 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1160073640 tx=0x7f114802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f1167800640 1 -- 172.21.15.96:0/3407992023 shutdown_connections 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f1167800640 1 --2- 172.21.15.96:0/3407992023 >> v2:172.21.15.155:3300/0 conn(0x7f11600acda0 0x7f11600aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f1167800640 1 --2- 172.21.15.96:0/3407992023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f116015c230 0x7f1160071800 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f1167800640 1 -- 172.21.15.96:0/3407992023 >> 172.21.15.96:0/3407992023 conn(0x7f11600b19c0 msgr2=0x7f11600b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:43.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.379+0000 7f1167800640 1 -- 172.21.15.96:0/3407992023 shutdown_connections 2024-04-24T23:59:43.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.380+0000 7f1167800640 1 -- 172.21.15.96:0/3407992023 wait complete. 2024-04-24T23:59:43.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.382+0000 7f1167800640 1 Processor -- start 2024-04-24T23:59:43.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.382+0000 7f1167800640 1 -- start start 2024-04-24T23:59:43.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.383+0000 7f1167800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600acda0 0x7f116015de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.383+0000 7f1167800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11600aef50 0x7f11600b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.383+0000 7f1167800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f116015c230 0x7f116015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.383+0000 7f1167800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1160160600 con 0x7f11600aef50 2024-04-24T23:59:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.383+0000 7f1167800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1160160320 con 0x7f11600acda0 2024-04-24T23:59:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.383+0000 7f1167800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f116006db80 con 0x7f116015c230 2024-04-24T23:59:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.383+0000 7f1157e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11600aef50 0x7f11600b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.383+0000 7f1157e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11600aef50 0x7f11600b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51560/0 (socket says 172.21.15.96:51560) 2024-04-24T23:59:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.383+0000 7f1157e00640 1 -- 172.21.15.96:0/2288804067 learned_addr learned my addr 172.21.15.96:0/2288804067 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.384+0000 7f1164e00640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600acda0 0x7f116015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.384+0000 7f1157e00640 1 -- 172.21.15.96:0/2288804067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f116015c230 msgr2=0x7f116015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.384+0000 7f1157e00640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f116015c230 0x7f116015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.384+0000 7f1157e00640 1 -- 172.21.15.96:0/2288804067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600acda0 msgr2=0x7f116015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.384+0000 7f1157e00640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600acda0 0x7f116015de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.384+0000 7f1157e00640 1 -- 172.21.15.96:0/2288804067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116015e720 con 0x7f11600aef50 2024-04-24T23:59:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.384+0000 7f1164e00640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600acda0 0x7f116015de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.384+0000 7f1157e00640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11600aef50 0x7f11600b3080 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f115000c820 tx=0x7f115000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.385+0000 7f115d600640 1 -- 172.21.15.96:0/2288804067 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150015070 con 0x7f11600aef50 2024-04-24T23:59:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.385+0000 7f115d600640 1 -- 172.21.15.96:0/2288804067 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1150007a30 con 0x7f11600aef50 2024-04-24T23:59:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.385+0000 7f115d600640 1 -- 172.21.15.96:0/2288804067 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150007e00 con 0x7f11600aef50 2024-04-24T23:59:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.385+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116015c960 con 0x7f11600aef50 2024-04-24T23:59:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.385+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116015cf20 con 0x7f11600aef50 2024-04-24T23:59:43.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.386+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1160069110 con 0x7f11600aef50 2024-04-24T23:59:43.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.387+0000 7f115d600640 1 -- 172.21.15.96:0/2288804067 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f1150018070 con 0x7f11600aef50 2024-04-24T23:59:43.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.388+0000 7f115d600640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f113c06bfe0 0x7f113c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.388+0000 7f115d600640 1 -- 172.21.15.96:0/2288804067 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f115008b3a0 con 0x7f11600aef50 2024-04-24T23:59:43.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.388+0000 7f1164e00640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f113c06bfe0 0x7f113c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.389+0000 7f1164e00640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f113c06bfe0 0x7f113c06e4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1148034000 tx=0x7f114802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:43.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.392+0000 7f115d600640 1 -- 172.21.15.96:0/2288804067 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1150059890 con 0x7f11600aef50 2024-04-24T23:59:43.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.592+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f116015d0f0 con 0x7f11600aef50 2024-04-24T23:59:43.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.595+0000 7f115d600640 1 -- 172.21.15.96:0/2288804067 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16621 (secure 0 0 0) 0x7f1150059190 con 0x7f11600aef50 2024-04-24T23:59:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:43.597 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":33,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:17.499374+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:59:13.640002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T23:59:14.952491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:43.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f113c06bfe0 msgr2=0x7f113c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f113c06bfe0 0x7f113c06e4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1148034000 tx=0x7f114802e000 comp rx=0 tx=0).stop 2024-04-24T23:59:43.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11600aef50 msgr2=0x7f11600b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11600aef50 0x7f11600b3080 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f115000c820 tx=0x7f115000cc20 comp rx=0 tx=0).stop 2024-04-24T23:59:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 shutdown_connections 2024-04-24T23:59:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f116015c230 0x7f116015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f113c06bfe0 0x7f113c06e4a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11600aef50 0x7f11600b3080 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 --2- 172.21.15.96:0/2288804067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600acda0 0x7f116015de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 >> 172.21.15.96:0/2288804067 conn(0x7f11600b19c0 msgr2=0x7f11600b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 shutdown_connections 2024-04-24T23:59:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.598+0000 7f1167800640 1 -- 172.21.15.96:0/2288804067 wait complete. 2024-04-24T23:59:43.619 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:59:43.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.803+0000 7fc8fa800640 1 Processor -- start 2024-04-24T23:59:43.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.803+0000 7fc8fa800640 1 -- start start 2024-04-24T23:59:43.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.805+0000 7fc8fa800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f40af120 0x7fc8f4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.805+0000 7fc8fa800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f4160b20 con 0x7fc8f40acda0 2024-04-24T23:59:43.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.805+0000 7fc8fa800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f40ad230 con 0x7fc8f415c230 2024-04-24T23:59:43.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.805+0000 7fc8fa800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f415c610 con 0x7fc8f40af120 2024-04-24T23:59:43.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.805+0000 7fc8f3e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc8f40acda0 0x7fc8f406cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54388/0 (socket says 172.21.15.96:54388) 2024-04-24T23:59:43.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.805+0000 7fc8f3e00640 1 -- 172.21.15.96:0/2279255856 learned_addr learned my addr 172.21.15.96:0/2279255856 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544822597 0 0) 0x7fc8f4160b20 con 0x7fc8f40acda0 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8d8003520 con 0x7fc8f40acda0 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2a00640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f40af120 0x7fc8f4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3220328497 0 0) 0x7fc8d8003520 con 0x7fc8f40acda0 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f40af120 msgr2=0x7fc8f4071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f40af120 0x7fc8f4071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 >> v1:172.21.15.155:6789/0 conn(0x7fc8f415c230 legacy=0x7fc8f40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f415fd60 con 0x7fc8f40acda0 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7fc8ec001670 con 0x7fc8f40acda0 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 >> v1:172.21.15.96:6789/0 conn(0x7fc8f40acda0 legacy=0x7fc8f406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.806+0000 7fc8f2000640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8d80039e0 0x7fc8d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f2000640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d8004800 0x7fc8d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f2000640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d80051c0 0x7fc8d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f415c610 con 0x7fc8d80051c0 2024-04-24T23:59:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d800c0c0 con 0x7fc8d8004800 2024-04-24T23:59:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d800c2c0 con 0x7fc8d80039e0 2024-04-24T23:59:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f3e00640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d80051c0 0x7fc8d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f3400640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8d80039e0 0x7fc8d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f2a00640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d8004800 0x7fc8d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f3e00640 1 -- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8d80039e0 msgr2=0x7fc8d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f3e00640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8d80039e0 0x7fc8d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f3e00640 1 -- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d8004800 msgr2=0x7fc8d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f3e00640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d8004800 0x7fc8d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f3e00640 1 -- 172.21.15.96:0/2279255856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d8003520 con 0x7fc8d80051c0 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.807+0000 7fc8f2a00640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d8004800 0x7fc8d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.809+0000 7fc8f3e00640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d80051c0 0x7fc8d800b9c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c190 tx=0x7fc8d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369005ed78aafa6b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.809+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec007c60 con 0x7fc8d80051c0 2024-04-24T23:59:43.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.809+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ec005ad0 con 0x7fc8d80051c0 2024-04-24T23:59:43.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.809+0000 7fc8f2000640 1 -- 172.21.15.96:0/2279255856 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec007070 con 0x7fc8d80051c0 2024-04-24T23:59:43.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.809+0000 7fc8fa800640 1 -- 172.21.15.96:0/2279255856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d80051c0 msgr2=0x7fc8d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.809+0000 7fc8fa800640 1 --2- 172.21.15.96:0/2279255856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d80051c0 0x7fc8d800b9c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c190 tx=0x7fc8d8005830 comp rx=0 tx=0).stop 2024-04-24T23:59:43.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.809+0000 7fc8f3e00640 1 -- 172.21.15.96:0/2279255856 reap_dead start 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.810+0000 7fc8fa800640 1 -- 172.21.15.96:0/2279255856 shutdown_connections 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.810+0000 7fc8fa800640 1 -- 172.21.15.96:0/2279255856 >> 172.21.15.96:0/2279255856 conn(0x7fc8f40b19c0 msgr2=0x7fc8f40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.810+0000 7fc8fa800640 1 -- 172.21.15.96:0/2279255856 shutdown_connections 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.810+0000 7fc8fa800640 1 -- 172.21.15.96:0/2279255856 wait complete. 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.811+0000 7fc8fa800640 1 Processor -- start 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.812+0000 7fc8fa800640 1 -- start start 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.812+0000 7fc8fa800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d80051c0 0x7fc8f40b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8fa800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f40b1030 0x7fc8f41508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8fa800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f415ca30 0x7fc8f406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8fa800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4160600 con 0x7fc8f415ca30 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8fa800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4160320 con 0x7fc8d80051c0 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8fa800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f40ad4d0 con 0x7fc8f40b1030 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f415ca30 0x7fc8f406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f415ca30 0x7fc8f406cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51586/0 (socket says 172.21.15.96:51586) 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f3e00640 1 -- 172.21.15.96:0/1989827454 learned_addr learned my addr 172.21.15.96:0/1989827454 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f3400640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d80051c0 0x7fc8f40b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f2a00640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f40b1030 0x7fc8f41508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f3e00640 1 -- 172.21.15.96:0/1989827454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f40b1030 msgr2=0x7fc8f41508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f3e00640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f40b1030 0x7fc8f41508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f3e00640 1 -- 172.21.15.96:0/1989827454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d80051c0 msgr2=0x7fc8f40b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f3e00640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d80051c0 0x7fc8f40b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.813+0000 7fc8f3e00640 1 -- 172.21.15.96:0/1989827454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f40b3e60 con 0x7fc8f415ca30 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.814+0000 7fc8f3e00640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f415ca30 0x7fc8f406cb70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec02ad60 tx=0x7fc8ec001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.814+0000 7fc8eb400640 1 -- 172.21.15.96:0/1989827454 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec040070 con 0x7fc8f415ca30 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.814+0000 7fc8eb400640 1 -- 172.21.15.96:0/1989827454 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ec0047e0 con 0x7fc8f415ca30 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.814+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f40c90e0 con 0x7fc8f415ca30 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.814+0000 7fc8eb400640 1 -- 172.21.15.96:0/1989827454 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec004bf0 con 0x7fc8f415ca30 2024-04-24T23:59:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.814+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f40c96a0 con 0x7fc8f415ca30 2024-04-24T23:59:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.815+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f4069110 con 0x7fc8f415ca30 2024-04-24T23:59:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.816+0000 7fc8eb400640 1 -- 172.21.15.96:0/1989827454 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fc8ec043070 con 0x7fc8f415ca30 2024-04-24T23:59:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.817+0000 7fc8eb400640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc8d406bfe0 0x7fc8d406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.817+0000 7fc8eb400640 1 -- 172.21.15.96:0/1989827454 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc8ec0aa370 con 0x7fc8f415ca30 2024-04-24T23:59:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.817+0000 7fc8f3400640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc8d406bfe0 0x7fc8d406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:43.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.818+0000 7fc8f3400640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc8d406bfe0 0x7fc8d406e4a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4007fd0 tx=0x7fc8e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:43.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:43.821+0000 7fc8eb400640 1 -- 172.21.15.96:0/1989827454 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc8ec0783b0 con 0x7fc8f415ca30 2024-04-24T23:59:44.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.058+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc8f40b42d0 con 0x7fc8f415ca30 2024-04-24T23:59:44.059 INFO:tasks.ceph.mon.a.smithi096.stderr:2024-04-24T23:59:44.059+0000 7f743ce00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:59:44.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.063+0000 7fc8eb400640 1 -- 172.21.15.96:0/1989827454 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7fc8ec07c6b0 con 0x7fc8f415ca30 2024-04-24T23:59:44.063 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:59:44.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.066+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc8d406bfe0 msgr2=0x7fc8d406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.066+0000 7fc8fa800640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc8d406bfe0 0x7fc8d406e4a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4007fd0 tx=0x7fc8e4009040 comp rx=0 tx=0).stop 2024-04-24T23:59:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.066+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f415ca30 msgr2=0x7fc8f406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.066+0000 7fc8fa800640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f415ca30 0x7fc8f406cb70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec02ad60 tx=0x7fc8ec001970 comp rx=0 tx=0).stop 2024-04-24T23:59:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.067+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 shutdown_connections 2024-04-24T23:59:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.067+0000 7fc8fa800640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc8d406bfe0 0x7fc8d406e4a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.067+0000 7fc8fa800640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f415ca30 0x7fc8f406cb70 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.067+0000 7fc8fa800640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8f40b1030 0x7fc8f41508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.067+0000 7fc8fa800640 1 --2- 172.21.15.96:0/1989827454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8d80051c0 0x7fc8f40b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.067+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 >> 172.21.15.96:0/1989827454 conn(0x7fc8f40b19c0 msgr2=0x7fc8f4071800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.068+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 shutdown_connections 2024-04-24T23:59:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.068+0000 7fc8fa800640 1 -- 172.21.15.96:0/1989827454 wait complete. 2024-04-24T23:59:44.088 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:59:44.170 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-04-24T23:59:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.265+0000 7f7575000640 1 Processor -- start 2024-04-24T23:59:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.265+0000 7f7575000640 1 -- start start 2024-04-24T23:59:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.266+0000 7f7575000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f757015f160 0x7f7570165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.266+0000 7f7575000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75700b36f0 con 0x7f75700b4790 2024-04-24T23:59:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.266+0000 7f7575000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75700b39d0 con 0x7f75701446c0 2024-04-24T23:59:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.266+0000 7f7575000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f75700b4300 con 0x7f757015f160 2024-04-24T23:59:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.267+0000 7f756fe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f757015f160 0x7f7570165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.267+0000 7f7567e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f75700b4790 0x7f757015ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54392/0 (socket says 172.21.15.96:54392) 2024-04-24T23:59:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.267+0000 7f7567e00640 1 -- 172.21.15.96:0/520828307 learned_addr learned my addr 172.21.15.96:0/520828307 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.267+0000 7f756fe00640 1 -- 172.21.15.96:0/520828307 >> v1:172.21.15.155:6789/0 conn(0x7f75701446c0 legacy=0x7f757006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.267+0000 7f756fe00640 1 -- 172.21.15.96:0/520828307 >> v1:172.21.15.96:6789/0 conn(0x7f75700b4790 legacy=0x7f757015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.267+0000 7f756fe00640 1 -- 172.21.15.96:0/520828307 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75700b3cb0 con 0x7f757015f160 2024-04-24T23:59:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.268+0000 7f756fe00640 1 --2- 172.21.15.96:0/520828307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f160 0x7f7570165de0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7568009d90 tx=0x7f756802a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d211a7a3c4872c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.268+0000 7f756ea00640 1 -- 172.21.15.96:0/520828307 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568007740 con 0x7f757015f160 2024-04-24T23:59:44.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.268+0000 7f756ea00640 1 -- 172.21.15.96:0/520828307 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75680078e0 con 0x7f757015f160 2024-04-24T23:59:44.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.268+0000 7f756ea00640 1 -- 172.21.15.96:0/520828307 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568007cb0 con 0x7f757015f160 2024-04-24T23:59:44.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.269+0000 7f7575000640 1 -- 172.21.15.96:0/520828307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f160 msgr2=0x7f7570165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:44.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.269+0000 7f7575000640 1 --2- 172.21.15.96:0/520828307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f160 0x7f7570165de0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7568009d90 tx=0x7f756802a590 comp rx=0 tx=0).stop 2024-04-24T23:59:44.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.269+0000 7f7575000640 1 -- 172.21.15.96:0/520828307 shutdown_connections 2024-04-24T23:59:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.269+0000 7f7575000640 1 --2- 172.21.15.96:0/520828307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757015f160 0x7f7570165de0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.269+0000 7f7575000640 1 -- 172.21.15.96:0/520828307 >> 172.21.15.96:0/520828307 conn(0x7f75700b18b0 msgr2=0x7f75700b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.269+0000 7f7575000640 1 -- 172.21.15.96:0/520828307 shutdown_connections 2024-04-24T23:59:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.269+0000 7f7575000640 1 -- 172.21.15.96:0/520828307 wait complete. 2024-04-24T23:59:44.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.271+0000 7f7575000640 1 Processor -- start 2024-04-24T23:59:44.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.271+0000 7f7575000640 1 -- start start 2024-04-24T23:59:44.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.272+0000 7f7575000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4790 0x7f75701422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:44.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.272+0000 7f7575000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75701446c0 0x7f75700a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.272+0000 7f7575000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f757015f160 0x7f75700a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.272+0000 7f7575000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f757006ead0 con 0x7f75700b4790 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.272+0000 7f7575000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7570071cb0 con 0x7f757015f160 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.272+0000 7f7575000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7570144aa0 con 0x7f75701446c0 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.272+0000 7f756f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4790 0x7f75701422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.272+0000 7f756f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4790 0x7f75701422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51608/0 (socket says 172.21.15.96:51608) 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.272+0000 7f756f400640 1 -- 172.21.15.96:0/398136487 learned_addr learned my addr 172.21.15.96:0/398136487 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f756f400640 1 -- 172.21.15.96:0/398136487 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75701446c0 msgr2=0x7f75700a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f756f400640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75701446c0 0x7f75700a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f756f400640 1 -- 172.21.15.96:0/398136487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f757015f160 msgr2=0x7f75700a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f756f400640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f757015f160 0x7f75700a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f756f400640 1 -- 172.21.15.96:0/398136487 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75701327a0 con 0x7f75700b4790 2024-04-24T23:59:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f756f400640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4790 0x7f75701422f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f756000c430 tx=0x7f756000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f7567400640 1 -- 172.21.15.96:0/398136487 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560011790 con 0x7f75700b4790 2024-04-24T23:59:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f7567400640 1 -- 172.21.15.96:0/398136487 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7560017070 con 0x7f75700b4790 2024-04-24T23:59:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f7567400640 1 -- 172.21.15.96:0/398136487 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560011bb0 con 0x7f75700b4790 2024-04-24T23:59:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75700aa180 con 0x7f75700b4790 2024-04-24T23:59:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.273+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7570131cc0 con 0x7f75700b4790 2024-04-24T23:59:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.274+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75700755d0 con 0x7f75700b4790 2024-04-24T23:59:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.275+0000 7f7567400640 1 -- 172.21.15.96:0/398136487 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f756001c460 con 0x7f75700b4790 2024-04-24T23:59:44.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.276+0000 7f7567400640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06c010 0x7f754c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:44.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.276+0000 7f7567400640 1 -- 172.21.15.96:0/398136487 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f756008b0b0 con 0x7f75700b4790 2024-04-24T23:59:44.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.276+0000 7f7567e00640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06c010 0x7f754c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.277+0000 7f7567e00640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06c010 0x7f754c06e4d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7558000f60 tx=0x7f7558007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.281+0000 7f7567400640 1 -- 172.21.15.96:0/398136487 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f75700aa180 con 0x7f75700b4790 2024-04-24T23:59:44.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:44.521+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f757006ce30 con 0x7f75700b4790 2024-04-24T23:59:45.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.130+0000 7f7567400640 1 -- 172.21.15.96:0/398136487 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f75600596e0 con 0x7f75700b4790 2024-04-24T23:59:45.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06c010 msgr2=0x7f754c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:45.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06c010 0x7f754c06e4d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7558000f60 tx=0x7f7558007a80 comp rx=0 tx=0).stop 2024-04-24T23:59:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4790 msgr2=0x7f75701422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4790 0x7f75701422f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f756000c430 tx=0x7f756000c8f0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 shutdown_connections 2024-04-24T23:59:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f757015f160 0x7f75700a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75701446c0 0x7f75700a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f754c06c010 0x7f754c06e4d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 --2- 172.21.15.96:0/398136487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75700b4790 0x7f75701422f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.134+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 >> 172.21.15.96:0/398136487 conn(0x7f75700b18b0 msgr2=0x7f75700cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:45.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.135+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 shutdown_connections 2024-04-24T23:59:45.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.135+0000 7f7575000640 1 -- 172.21.15.96:0/398136487 wait complete. 2024-04-24T23:59:45.159 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:59:45.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.362+0000 7f2f3a800640 1 Processor -- start 2024-04-24T23:59:45.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.362+0000 7f2f3a800640 1 -- start start 2024-04-24T23:59:45.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.363+0000 7f2f3a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f34161920 0x7f2f340d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:45.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.363+0000 7f2f3a800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f340d0780 con 0x7f2f3406cbe0 2024-04-24T23:59:45.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.363+0000 7f2f3a800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f340cef80 con 0x7f2f340b12d0 2024-04-24T23:59:45.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.363+0000 7f2f3a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f340cf260 con 0x7f2f34161920 2024-04-24T23:59:45.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.364+0000 7f2f33e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2f3406cbe0 0x7f2f340b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54400/0 (socket says 172.21.15.96:54400) 2024-04-24T23:59:45.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.364+0000 7f2f33e00640 1 -- 172.21.15.96:0/691833417 learned_addr learned my addr 172.21.15.96:0/691833417 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:45.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.364+0000 7f2f33400640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f34161920 0x7f2f340d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:45.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.364+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881595533 0 0) 0x7f2f340d0780 con 0x7f2f3406cbe0 2024-04-24T23:59:45.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.364+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f18003520 con 0x7f2f3406cbe0 2024-04-24T23:59:45.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.364+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2799816760 0 0) 0x7f2f18003520 con 0x7f2f3406cbe0 2024-04-24T23:59:45.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.364+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f34161920 msgr2=0x7f2f340d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.364+0000 7f2f32000640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f34161920 0x7f2f340d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.364+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 >> v1:172.21.15.155:6789/0 conn(0x7f2f340b12d0 legacy=0x7f2f340ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f340cf540 con 0x7f2f3406cbe0 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f2f2c001670 con 0x7f2f3406cbe0 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 >> v1:172.21.15.96:6789/0 conn(0x7f2f3406cbe0 legacy=0x7f2f340b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32000640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180039e0 0x7f2f18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32000640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f18004800 0x7f2f18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32000640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f34161920 0x7f2f180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2f340cf260 con 0x7f2f180039e0 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1800ba70 con 0x7f2f18004800 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1800bc70 con 0x7f2f34161920 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f33400640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180039e0 0x7f2f18003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f33400640 1 -- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f34161920 msgr2=0x7f2f180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:45.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32a00640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f18004800 0x7f2f18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:45.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f33400640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f34161920 0x7f2f180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f33400640 1 -- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f18004800 msgr2=0x7f2f18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:45.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f33400640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f18004800 0x7f2f18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f33400640 1 -- 172.21.15.96:0/691833417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f18003520 con 0x7f2f180039e0 2024-04-24T23:59:45.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.365+0000 7f2f32a00640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f18004800 0x7f2f18004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:45.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.366+0000 7f2f33400640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180039e0 0x7f2f18003e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009f90 tx=0x7f2f18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527823acd0fd3233 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:45.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24009c10 con 0x7f2f180039e0 2024-04-24T23:59:45.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f24036070 con 0x7f2f180039e0 2024-04-24T23:59:45.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f32000640 1 -- 172.21.15.96:0/691833417 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24031850 con 0x7f2f180039e0 2024-04-24T23:59:45.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f3a800640 1 -- 172.21.15.96:0/691833417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180039e0 msgr2=0x7f2f18003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:45.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f3a800640 1 --2- 172.21.15.96:0/691833417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180039e0 0x7f2f18003e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009f90 tx=0x7f2f18005830 comp rx=0 tx=0).stop 2024-04-24T23:59:45.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f33e00640 1 -- 172.21.15.96:0/691833417 reap_dead start 2024-04-24T23:59:45.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f3a800640 1 -- 172.21.15.96:0/691833417 shutdown_connections 2024-04-24T23:59:45.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f3a800640 1 -- 172.21.15.96:0/691833417 >> 172.21.15.96:0/691833417 conn(0x7f2f3409aa70 msgr2=0x7f2f3409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:45.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f3a800640 1 -- 172.21.15.96:0/691833417 shutdown_connections 2024-04-24T23:59:45.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.367+0000 7f2f3a800640 1 -- 172.21.15.96:0/691833417 wait complete. 2024-04-24T23:59:45.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.369+0000 7f2f3a800640 1 Processor -- start 2024-04-24T23:59:45.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.369+0000 7f2f3a800640 1 -- start start 2024-04-24T23:59:45.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.370+0000 7f2f3a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f180039e0 0x7f2f340c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:45.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.370+0000 7f2f3a800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f341598b0 0x7f2f34159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:45.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.370+0000 7f2f3a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f3415c040 0x7f2f3415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:45.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.370+0000 7f2f3a800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2f340d03c0 con 0x7f2f341598b0 2024-04-24T23:59:45.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.370+0000 7f2f3a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f340d0240 con 0x7f2f3415c040 2024-04-24T23:59:45.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.370+0000 7f2f3a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f340d0540 con 0x7f2f180039e0 2024-04-24T23:59:45.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.370+0000 7f2f32a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f341598b0 0x7f2f34159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:45.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.370+0000 7f2f32a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f341598b0 0x7f2f34159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51628/0 (socket says 172.21.15.96:51628) 2024-04-24T23:59:45.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.370+0000 7f2f32a00640 1 -- 172.21.15.96:0/3009746773 learned_addr learned my addr 172.21.15.96:0/3009746773 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f32a00640 1 -- 172.21.15.96:0/3009746773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f180039e0 msgr2=0x7f2f340c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f32a00640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f180039e0 0x7f2f340c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f33e00640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f3415c040 0x7f2f3415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f32a00640 1 -- 172.21.15.96:0/3009746773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f3415c040 msgr2=0x7f2f3415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f32a00640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f3415c040 0x7f2f3415c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f32a00640 1 -- 172.21.15.96:0/3009746773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f340b6370 con 0x7f2f341598b0 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f33e00640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f3415c040 0x7f2f3415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f32a00640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f341598b0 0x7f2f34159d30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00d7d0 tx=0x7f2f1c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f2b400640 1 -- 172.21.15.96:0/3009746773 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c005070 con 0x7f2f341598b0 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f2b400640 1 -- 172.21.15.96:0/3009746773 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c005230 con 0x7f2f341598b0 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.371+0000 7f2f2b400640 1 -- 172.21.15.96:0/3009746773 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c007030 con 0x7f2f341598b0 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.372+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f340b4ff0 con 0x7f2f341598b0 2024-04-24T23:59:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.372+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f340b55b0 con 0x7f2f341598b0 2024-04-24T23:59:45.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.373+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f3409b7c0 con 0x7f2f341598b0 2024-04-24T23:59:45.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.374+0000 7f2f2b400640 1 -- 172.21.15.96:0/3009746773 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f2f1c01a030 con 0x7f2f341598b0 2024-04-24T23:59:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.375+0000 7f2f2b400640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2f1006c010 0x7f2f1006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.376+0000 7f2f2b400640 1 -- 172.21.15.96:0/3009746773 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f2f1c08aa50 con 0x7f2f341598b0 2024-04-24T23:59:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.376+0000 7f2f33400640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2f1006c010 0x7f2f1006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.376+0000 7f2f33400640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2f1006c010 0x7f2f1006e4d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2f24035000 tx=0x7f2f2402d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.380+0000 7f2f2b400640 1 -- 172.21.15.96:0/3009746773 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2f3409b7c0 con 0x7f2f341598b0 2024-04-24T23:59:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:45.579+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2f340681f0 con 0x7f2f341598b0 2024-04-24T23:59:46.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.143+0000 7f2f2b400640 1 -- 172.21.15.96:0/3009746773 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7f2f1c021020 con 0x7f2f341598b0 2024-04-24T23:59:46.143 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:59:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.149+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2f1006c010 msgr2=0x7f2f1006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.149+0000 7f2f3a800640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2f1006c010 0x7f2f1006e4d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2f24035000 tx=0x7f2f2402d000 comp rx=0 tx=0).stop 2024-04-24T23:59:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.149+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f341598b0 msgr2=0x7f2f34159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.149+0000 7f2f3a800640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f341598b0 0x7f2f34159d30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00d7d0 tx=0x7f2f1c00dc90 comp rx=0 tx=0).stop 2024-04-24T23:59:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.150+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 shutdown_connections 2024-04-24T23:59:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.150+0000 7f2f3a800640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f3415c040 0x7f2f3415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.150+0000 7f2f3a800640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f2f1006c010 0x7f2f1006e4d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.150+0000 7f2f3a800640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f341598b0 0x7f2f34159d30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.150+0000 7f2f3a800640 1 --2- 172.21.15.96:0/3009746773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f180039e0 0x7f2f340c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.150+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 >> 172.21.15.96:0/3009746773 conn(0x7f2f3409aa70 msgr2=0x7f2f340cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.150+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 shutdown_connections 2024-04-24T23:59:46.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.150+0000 7f2f3a800640 1 -- 172.21.15.96:0/3009746773 wait complete. 2024-04-24T23:59:46.176 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:59:46.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.375+0000 7ff4c9e00640 1 Processor -- start 2024-04-24T23:59:46.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.375+0000 7ff4c9e00640 1 -- start start 2024-04-24T23:59:46.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.377+0000 7ff4c9e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c40727f0 0x7ff4c415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.377+0000 7ff4c9e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff4c415f220 0x7ff4c40ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.377+0000 7ff4c9e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c4072bd0 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.377+0000 7ff4c9e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c415f680 con 0x7ff4c415f220 2024-04-24T23:59:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.377+0000 7ff4c9e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c40b4a90 con 0x7ff4c40727f0 2024-04-24T23:59:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.377+0000 7ff4c2000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff4c415f220 0x7ff4c40ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.377+0000 7ff4c3400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff4c40ae9e0 0x7ff4c4154f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54410/0 (socket says 172.21.15.96:54410) 2024-04-24T23:59:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.377+0000 7ff4c3400640 1 -- 172.21.15.96:0/3867720117 learned_addr learned my addr 172.21.15.96:0/3867720117 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.378+0000 7ff4c2a00640 1 --2- 172.21.15.96:0/3867720117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c40727f0 0x7ff4c415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.378+0000 7ff4c2000640 1 -- 172.21.15.96:0/3867720117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c40727f0 msgr2=0x7ff4c415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.378+0000 7ff4c2000640 1 --2- 172.21.15.96:0/3867720117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c40727f0 0x7ff4c415ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.378+0000 7ff4c2000640 1 -- 172.21.15.96:0/3867720117 >> v1:172.21.15.96:6789/0 conn(0x7ff4c40ae9e0 legacy=0x7ff4c4154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.378+0000 7ff4c2000640 1 -- 172.21.15.96:0/3867720117 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c40af260 con 0x7ff4c415f220 2024-04-24T23:59:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.379+0000 7ff4c2000640 1 --2- 172.21.15.96:0/3867720117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c415f220 0x7ff4c40ae4a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00097a0 tx=0x7ff4b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5be02a54455013 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.379+0000 7ff4c1600640 1 -- 172.21.15.96:0/3867720117 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0037070 con 0x7ff4c415f220 2024-04-24T23:59:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.379+0000 7ff4c1600640 1 -- 172.21.15.96:0/3867720117 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b0032440 con 0x7ff4c415f220 2024-04-24T23:59:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.380+0000 7ff4c1600640 1 -- 172.21.15.96:0/3867720117 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0032810 con 0x7ff4c415f220 2024-04-24T23:59:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.380+0000 7ff4c9e00640 1 -- 172.21.15.96:0/3867720117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c415f220 msgr2=0x7ff4c40ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.380+0000 7ff4c9e00640 1 --2- 172.21.15.96:0/3867720117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c415f220 0x7ff4c40ae4a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00097a0 tx=0x7ff4b002a180 comp rx=0 tx=0).stop 2024-04-24T23:59:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.380+0000 7ff4c9e00640 1 -- 172.21.15.96:0/3867720117 shutdown_connections 2024-04-24T23:59:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.380+0000 7ff4c9e00640 1 --2- 172.21.15.96:0/3867720117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c415f220 0x7ff4c40ae4a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.380+0000 7ff4c9e00640 1 --2- 172.21.15.96:0/3867720117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c40727f0 0x7ff4c415ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.380+0000 7ff4c9e00640 1 -- 172.21.15.96:0/3867720117 >> 172.21.15.96:0/3867720117 conn(0x7ff4c40b19c0 msgr2=0x7ff4c40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.380+0000 7ff4c9e00640 1 -- 172.21.15.96:0/3867720117 shutdown_connections 2024-04-24T23:59:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.380+0000 7ff4c9e00640 1 -- 172.21.15.96:0/3867720117 wait complete. 2024-04-24T23:59:46.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.382+0000 7ff4c9e00640 1 Processor -- start 2024-04-24T23:59:46.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.382+0000 7ff4c9e00640 1 -- start start 2024-04-24T23:59:46.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.383+0000 7ff4c9e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4c40727f0 0x7ff4c41535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:46.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.383+0000 7ff4c9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c40ae9e0 0x7ff4c415d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:46.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.383+0000 7ff4c9e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c415f220 0x7ff4c41f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:46.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.383+0000 7ff4c9e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c40b3280 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.383+0000 7ff4c9e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c40b2fa0 con 0x7ff4c40727f0 2024-04-24T23:59:46.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.383+0000 7ff4c9e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c40b3560 con 0x7ff4c415f220 2024-04-24T23:59:46.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.383+0000 7ff4c2000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c40ae9e0 0x7ff4c415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:46.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.383+0000 7ff4c2000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c40ae9e0 0x7ff4c415d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51632/0 (socket says 172.21.15.96:51632) 2024-04-24T23:59:46.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.383+0000 7ff4c2000640 1 -- 172.21.15.96:0/4030310035 learned_addr learned my addr 172.21.15.96:0/4030310035 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:46.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4c3400640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c415f220 0x7ff4c41f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:46.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4c2a00640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4c40727f0 0x7ff4c41535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:46.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4c2000640 1 -- 172.21.15.96:0/4030310035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c415f220 msgr2=0x7ff4c41f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4c2000640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c415f220 0x7ff4c41f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4c2000640 1 -- 172.21.15.96:0/4030310035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4c40727f0 msgr2=0x7ff4c41535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4c2000640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4c40727f0 0x7ff4c41535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4c2000640 1 -- 172.21.15.96:0/4030310035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c4153ae0 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4c3400640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c415f220 0x7ff4c41f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4c2000640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c40ae9e0 0x7ff4c415d660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00098c0 tx=0x7ff4b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.384+0000 7ff4bb400640 1 -- 172.21.15.96:0/4030310035 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0037040 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.385+0000 7ff4bb400640 1 -- 172.21.15.96:0/4030310035 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b0030770 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.385+0000 7ff4bb400640 1 -- 172.21.15.96:0/4030310035 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0030b40 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.385+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c4166f00 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.385+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c41674c0 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.386+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c4069110 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.387+0000 7ff4bb400640 1 -- 172.21.15.96:0/4030310035 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff4b0044020 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.388+0000 7ff4bb400640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff4a406c010 0x7ff4a406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:46.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.388+0000 7ff4bb400640 1 -- 172.21.15.96:0/4030310035 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7ff4b00ab450 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.388+0000 7ff4c2a00640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff4a406c010 0x7ff4a406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:46.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.389+0000 7ff4c2a00640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff4a406c010 0x7ff4a406e4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006fd0 tx=0x7ff4b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:46.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.392+0000 7ff4bb400640 1 -- 172.21.15.96:0/4030310035 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff4b0032e20 con 0x7ff4c40ae9e0 2024-04-24T23:59:46.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:46.601+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff4c4068410 con 0x7ff4c40ae9e0 2024-04-24T23:59:47.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.162+0000 7ff4bb400640 1 -- 172.21.15.96:0/4030310035 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7ff4b0079d70 con 0x7ff4c40ae9e0 2024-04-24T23:59:47.163 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2024-04-24T23:59:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff4a406c010 msgr2=0x7ff4a406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff4a406c010 0x7ff4a406e4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006fd0 tx=0x7ff4b4008040 comp rx=0 tx=0).stop 2024-04-24T23:59:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c40ae9e0 msgr2=0x7ff4c415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c40ae9e0 0x7ff4c415d660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00098c0 tx=0x7ff4b00046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 shutdown_connections 2024-04-24T23:59:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4c415f220 0x7ff4c41f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7ff4a406c010 0x7ff4a406e4d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4c40ae9e0 0x7ff4c415d660 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 --2- 172.21.15.96:0/4030310035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4c40727f0 0x7ff4c41535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 >> 172.21.15.96:0/4030310035 conn(0x7ff4c40b19c0 msgr2=0x7ff4c406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 shutdown_connections 2024-04-24T23:59:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.166+0000 7ff4c9e00640 1 -- 172.21.15.96:0/4030310035 wait complete. 2024-04-24T23:59:47.191 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-24T23:59:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.383+0000 7f3906a00640 1 Processor -- start 2024-04-24T23:59:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.384+0000 7f3906a00640 1 -- start start 2024-04-24T23:59:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.385+0000 7f3906a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f390015cfe0 0x7f39000cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.385+0000 7f3906a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001415d0 0x7f3900141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.385+0000 7f3906a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39000ce620 con 0x7f390013ef60 2024-04-24T23:59:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.385+0000 7f3906a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f39000ce900 con 0x7f390015cfe0 2024-04-24T23:59:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.385+0000 7f3906a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39000cebe0 con 0x7f39001415d0 2024-04-24T23:59:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.386+0000 7f3905600640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f390013ef60 0x7f39000cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51554/0 (socket says 172.21.15.96:51554) 2024-04-24T23:59:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.386+0000 7f3905600640 1 -- 172.21.15.96:0/1549225546 learned_addr learned my addr 172.21.15.96:0/1549225546 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.386+0000 7f3904c00640 1 --2- 172.21.15.96:0/1549225546 >> v2:172.21.15.155:3300/0 conn(0x7f390015cfe0 0x7f39000cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.386+0000 7f3906000640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001415d0 0x7f3900141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.386+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897091456 0 0) 0x7f39000ce620 con 0x7f390013ef60 2024-04-24T23:59:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.386+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38e8003520 con 0x7f390013ef60 2024-04-24T23:59:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.386+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3583895405 0 0) 0x7f38e8003520 con 0x7f390013ef60 2024-04-24T23:59:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.386+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001415d0 msgr2=0x7f3900141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.386+0000 7f38ffe00640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001415d0 0x7f3900141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 >> v2:172.21.15.155:3300/0 conn(0x7f390015cfe0 msgr2=0x7f39000cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 --2- 172.21.15.96:0/1549225546 >> v2:172.21.15.155:3300/0 conn(0x7f390015cfe0 0x7f39000cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39000ccb10 con 0x7f390013ef60 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f38f4001670 con 0x7f390013ef60 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 >> v1:172.21.15.96:6789/0 conn(0x7f390013ef60 legacy=0x7f39000cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001415d0 0x7f38e80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38e8003f80 0x7f38e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f38e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f39000ce900 con 0x7f38e8004d40 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f39000cebe0 con 0x7f38e8003f80 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f38e800b9c0 con 0x7f39001415d0 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f3906000640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f38e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f3905600640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001415d0 0x7f38e80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f3906000640 1 -- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001415d0 msgr2=0x7f38e80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f3906000640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001415d0 0x7f38e80039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f3904c00640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38e8003f80 0x7f38e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f3906000640 1 -- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38e8003f80 msgr2=0x7f38e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f3906000640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38e8003f80 0x7f38e8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.387+0000 7f3906000640 1 -- 172.21.15.96:0/1549225546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e8003520 con 0x7f38e8004d40 2024-04-24T23:59:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.388+0000 7f3906000640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f38e80051c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f38f800e170 tx=0x7f38e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6918ea42214e60c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8034020 con 0x7f38e8004d40 2024-04-24T23:59:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f80305f0 con 0x7f38e8004d40 2024-04-24T23:59:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f38ffe00640 1 -- 172.21.15.96:0/1549225546 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8009c10 con 0x7f38e8004d40 2024-04-24T23:59:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f3906a00640 1 -- 172.21.15.96:0/1549225546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 msgr2=0x7f38e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f3906a00640 1 --2- 172.21.15.96:0/1549225546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f38e80051c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f38f800e170 tx=0x7f38e8005830 comp rx=0 tx=0).stop 2024-04-24T23:59:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f3906000640 1 -- 172.21.15.96:0/1549225546 reap_dead start 2024-04-24T23:59:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f3906a00640 1 -- 172.21.15.96:0/1549225546 shutdown_connections 2024-04-24T23:59:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f3906a00640 1 -- 172.21.15.96:0/1549225546 >> 172.21.15.96:0/1549225546 conn(0x7f39000b18b0 msgr2=0x7f39000b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f3906a00640 1 -- 172.21.15.96:0/1549225546 shutdown_connections 2024-04-24T23:59:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.389+0000 7f3906a00640 1 -- 172.21.15.96:0/1549225546 wait complete. 2024-04-24T23:59:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.391+0000 7f3906a00640 1 Processor -- start 2024-04-24T23:59:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.391+0000 7f3906a00640 1 -- start start 2024-04-24T23:59:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.392+0000 7f3906a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f390013b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.392+0000 7f3906a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390013c9a0 0x7f390013ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.392+0000 7f3906a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3900072080 0x7f3900072500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.392+0000 7f3906a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3900141be0 con 0x7f38e8004d40 2024-04-24T23:59:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.392+0000 7f3906a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3900141a60 con 0x7f390013c9a0 2024-04-24T23:59:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.392+0000 7f3906a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3900141d60 con 0x7f3900072080 2024-04-24T23:59:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.392+0000 7f3905600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f390013b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.393+0000 7f3905600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f390013b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34522/0 (socket says 172.21.15.96:34522) 2024-04-24T23:59:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.393+0000 7f3905600640 1 -- 172.21.15.96:0/2849486660 learned_addr learned my addr 172.21.15.96:0/2849486660 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.393+0000 7f3905600640 1 -- 172.21.15.96:0/2849486660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3900072080 msgr2=0x7f3900072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.393+0000 7f3905600640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3900072080 0x7f3900072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.393+0000 7f3905600640 1 -- 172.21.15.96:0/2849486660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390013c9a0 msgr2=0x7f390013ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.393+0000 7f3905600640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390013c9a0 0x7f390013ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.393+0000 7f3905600640 1 -- 172.21.15.96:0/2849486660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390013bd70 con 0x7f38e8004d40 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.393+0000 7f3905600640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f390013b830 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f38f400d790 tx=0x7f38f400dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.393+0000 7f38fd600640 1 -- 172.21.15.96:0/2849486660 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4019070 con 0x7f38e8004d40 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.394+0000 7f38fd600640 1 -- 172.21.15.96:0/2849486660 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f40074e0 con 0x7f38e8004d40 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.394+0000 7f38fd600640 1 -- 172.21.15.96:0/2849486660 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40049e0 con 0x7f38e8004d40 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.394+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39000b2aa0 con 0x7f38e8004d40 2024-04-24T23:59:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.394+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39000b3060 con 0x7f38e8004d40 2024-04-24T23:59:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.395+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39000755d0 con 0x7f38e8004d40 2024-04-24T23:59:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.396+0000 7f38fd600640 1 -- 172.21.15.96:0/2849486660 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f38f401c070 con 0x7f38e8004d40 2024-04-24T23:59:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.397+0000 7f38fd600640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f38e006bfe0 0x7f38e006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.397+0000 7f38fd600640 1 -- 172.21.15.96:0/2849486660 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f38f408ab00 con 0x7f38e8004d40 2024-04-24T23:59:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.397+0000 7f3904c00640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f38e006bfe0 0x7f38e006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.398+0000 7f3904c00640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f38e006bfe0 0x7f38e006e4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f39000b3dd0 tx=0x7f38ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.401+0000 7f38fd600640 1 -- 172.21.15.96:0/2849486660 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f38f4059380 con 0x7f38e8004d40 2024-04-24T23:59:47.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.599+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f390006e6d0 con 0x7f38e8004d40 2024-04-24T23:59:47.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.606+0000 7f38fd600640 1 -- 172.21.15.96:0/2849486660 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f38f4058c80 con 0x7f38e8004d40 2024-04-24T23:59:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f38e006bfe0 msgr2=0x7f38e006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f38e006bfe0 0x7f38e006e4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f39000b3dd0 tx=0x7f38ec008040 comp rx=0 tx=0).stop 2024-04-24T23:59:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 msgr2=0x7f390013b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f390013b830 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f38f400d790 tx=0x7f38f400dc50 comp rx=0 tx=0).stop 2024-04-24T23:59:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 shutdown_connections 2024-04-24T23:59:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3900072080 0x7f3900072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390013c9a0 0x7f390013ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f38e006bfe0 0x7f38e006e4a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 --2- 172.21.15.96:0/2849486660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e8004d40 0x7f390013b830 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.609+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 >> 172.21.15.96:0/2849486660 conn(0x7f39000b18b0 msgr2=0x7f39000cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:47.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.610+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 shutdown_connections 2024-04-24T23:59:47.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.610+0000 7f3906a00640 1 -- 172.21.15.96:0/2849486660 wait complete. 2024-04-24T23:59:47.629 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-04-24T23:59:47.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.826+0000 7fd202800640 1 Processor -- start 2024-04-24T23:59:47.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.827+0000 7fd202800640 1 -- start start 2024-04-24T23:59:47.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.828+0000 7fd202800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd1fc1553f0 0x7fd1fc15b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.828+0000 7fd202800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1fc0ce100 con 0x7fd1fc071470 2024-04-24T23:59:47.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.828+0000 7fd202800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1fc0ce3e0 con 0x7fd1fc0cdbd0 2024-04-24T23:59:47.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.828+0000 7fd202800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd1fc0ce6c0 con 0x7fd1fc1553f0 2024-04-24T23:59:47.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.829+0000 7fd201400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd1fc1553f0 0x7fd1fc15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.829+0000 7fd201e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd1fc071470 0x7fd1fc06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51568/0 (socket says 172.21.15.96:51568) 2024-04-24T23:59:47.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.829+0000 7fd201e00640 1 -- 172.21.15.96:0/3334987413 learned_addr learned my addr 172.21.15.96:0/3334987413 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:47.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.829+0000 7fd1fbe00640 1 -- 172.21.15.96:0/3334987413 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032570780 0 0) 0x7fd1fc0ce100 con 0x7fd1fc071470 2024-04-24T23:59:47.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.829+0000 7fd1fbe00640 1 -- 172.21.15.96:0/3334987413 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e4003520 con 0x7fd1fc071470 2024-04-24T23:59:47.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.829+0000 7fd201400640 1 -- 172.21.15.96:0/3334987413 >> v1:172.21.15.155:6789/0 conn(0x7fd1fc0cdbd0 legacy=0x7fd1fc070d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-24T23:59:47.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.829+0000 7fd201400640 1 -- 172.21.15.96:0/3334987413 >> v1:172.21.15.96:6789/0 conn(0x7fd1fc071470 legacy=0x7fd1fc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.829+0000 7fd201400640 1 -- 172.21.15.96:0/3334987413 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1fc0ce9a0 con 0x7fd1fc1553f0 2024-04-24T23:59:47.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.830+0000 7fd201400640 1 --2- 172.21.15.96:0/3334987413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc1553f0 0x7fd1fc15b530 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00097a0 tx=0x7fd1f002c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40a00c7094dca92 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:47.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.831+0000 7fd1fbe00640 1 -- 172.21.15.96:0/3334987413 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0039070 con 0x7fd1fc1553f0 2024-04-24T23:59:47.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.831+0000 7fd1fbe00640 1 -- 172.21.15.96:0/3334987413 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f0034640 con 0x7fd1fc1553f0 2024-04-24T23:59:47.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.831+0000 7fd1fbe00640 1 -- 172.21.15.96:0/3334987413 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0034a10 con 0x7fd1fc1553f0 2024-04-24T23:59:47.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.831+0000 7fd202800640 1 -- 172.21.15.96:0/3334987413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc1553f0 msgr2=0x7fd1fc15b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:47.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.831+0000 7fd202800640 1 --2- 172.21.15.96:0/3334987413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc1553f0 0x7fd1fc15b530 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00097a0 tx=0x7fd1f002c3f0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.831+0000 7fd202800640 1 -- 172.21.15.96:0/3334987413 shutdown_connections 2024-04-24T23:59:47.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.831+0000 7fd202800640 1 --2- 172.21.15.96:0/3334987413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc1553f0 0x7fd1fc15b530 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.831+0000 7fd202800640 1 -- 172.21.15.96:0/3334987413 >> 172.21.15.96:0/3334987413 conn(0x7fd1fc0b1f10 msgr2=0x7fd1fc0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:47.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.831+0000 7fd202800640 1 -- 172.21.15.96:0/3334987413 shutdown_connections 2024-04-24T23:59:47.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.832+0000 7fd202800640 1 -- 172.21.15.96:0/3334987413 wait complete. 2024-04-24T23:59:47.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.833+0000 7fd202800640 1 Processor -- start 2024-04-24T23:59:47.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.833+0000 7fd202800640 1 -- start start 2024-04-24T23:59:47.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.834+0000 7fd202800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc071470 0x7fd1fc14c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.834+0000 7fd202800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1fc0cdbd0 0x7fd1fc09b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.834+0000 7fd202800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1fc1553f0 0x7fd1fc0addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.834+0000 7fd202800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd1fc155950 con 0x7fd1fc071470 2024-04-24T23:59:47.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.834+0000 7fd202800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd1fc1557d0 con 0x7fd1fc0cdbd0 2024-04-24T23:59:47.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.834+0000 7fd202800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd1fc0cf1a0 con 0x7fd1fc1553f0 2024-04-24T23:59:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.834+0000 7fd201400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc071470 0x7fd1fc14c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd201400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc071470 0x7fd1fc14c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34536/0 (socket says 172.21.15.96:34536) 2024-04-24T23:59:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd201400640 1 -- 172.21.15.96:0/440308666 learned_addr learned my addr 172.21.15.96:0/440308666 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd201400640 1 -- 172.21.15.96:0/440308666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1fc1553f0 msgr2=0x7fd1fc0addf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-24T23:59:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd201400640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1fc1553f0 0x7fd1fc0addf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd201400640 1 -- 172.21.15.96:0/440308666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1fc0cdbd0 msgr2=0x7fd1fc09b410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-24T23:59:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd201400640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1fc0cdbd0 0x7fd1fc09b410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd201400640 1 -- 172.21.15.96:0/440308666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1fc09c960 con 0x7fd1fc071470 2024-04-24T23:59:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd201400640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc071470 0x7fd1fc14c570 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0000c00 tx=0x7fd1f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:47.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd1f9600640 1 -- 172.21.15.96:0/440308666 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0039040 con 0x7fd1fc071470 2024-04-24T23:59:47.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd1f9600640 1 -- 172.21.15.96:0/440308666 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f0044070 con 0x7fd1fc071470 2024-04-24T23:59:47.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.835+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1fc09cc40 con 0x7fd1fc071470 2024-04-24T23:59:47.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.836+0000 7fd1f9600640 1 -- 172.21.15.96:0/440308666 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0006e10 con 0x7fd1fc071470 2024-04-24T23:59:47.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.836+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1fc09d200 con 0x7fd1fc071470 2024-04-24T23:59:47.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.837+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1fc067e40 con 0x7fd1fc071470 2024-04-24T23:59:47.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.838+0000 7fd1f9600640 1 -- 172.21.15.96:0/440308666 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fd1f00329b0 con 0x7fd1fc071470 2024-04-24T23:59:47.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.839+0000 7fd1f9600640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd1dc06bfe0 0x7fd1dc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:47.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.839+0000 7fd1f9600640 1 -- 172.21.15.96:0/440308666 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fd1f00ab810 con 0x7fd1fc071470 2024-04-24T23:59:47.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.839+0000 7fd200a00640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd1dc06bfe0 0x7fd1dc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:47.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.840+0000 7fd200a00640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd1dc06bfe0 0x7fd1dc06e4a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc072710 tx=0x7fd1e8006bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:47.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:47.843+0000 7fd1f9600640 1 -- 172.21.15.96:0/440308666 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd1f007a350 con 0x7fd1fc071470 2024-04-24T23:59:48.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.118+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7fd1fc0d0930 con 0x7fd1fc071470 2024-04-24T23:59:48.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.178+0000 7fd1f9600640 1 -- 172.21.15.96:0/440308666 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v117) ==== 167+0+0 (secure 0 0 0) 0x7fd1f0079c50 con 0x7fd1fc071470 2024-04-24T23:59:48.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd1dc06bfe0 msgr2=0x7fd1dc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd1dc06bfe0 0x7fd1dc06e4a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc072710 tx=0x7fd1e8006bd0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc071470 msgr2=0x7fd1fc14c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc071470 0x7fd1fc14c570 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0000c00 tx=0x7fd1f00046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 shutdown_connections 2024-04-24T23:59:48.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1fc1553f0 0x7fd1fc0addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1fc0cdbd0 0x7fd1fc09b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd1dc06bfe0 0x7fd1dc06e4a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 --2- 172.21.15.96:0/440308666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1fc071470 0x7fd1fc14c570 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 >> 172.21.15.96:0/440308666 conn(0x7fd1fc0b1f10 msgr2=0x7fd1fc06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:48.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 shutdown_connections 2024-04-24T23:59:48.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.182+0000 7fd202800640 1 -- 172.21.15.96:0/440308666 wait complete. 2024-04-24T23:59:48.201 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ok 2024-04-24T23:59:48.202 INFO:tasks.cephfs_test_runner: 2024-04-24T23:59:48.202 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-24T23:59:48.202 INFO:tasks.cephfs_test_runner:Ran 1 test in 63.155s 2024-04-24T23:59:48.202 INFO:tasks.cephfs_test_runner: 2024-04-24T23:59:48.202 INFO:tasks.cephfs_test_runner:OK 2024-04-24T23:59:48.202 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-24T23:59:48.212 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-24T23:59:48.260 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.462+0000 7faea5800640 1 Processor -- start 2024-04-24T23:59:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.462+0000 7faea5800640 1 -- start start 2024-04-24T23:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.464+0000 7faea5800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faea015f6b0 0x7faea00ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.464+0000 7faea5800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faea00ccdf0 0x7faea0070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.464+0000 7faea5800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea015fa90 con 0x7faea00b4ec0 2024-04-24T23:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.464+0000 7faea5800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7faea00b4a30 con 0x7faea015f6b0 2024-04-24T23:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.464+0000 7faea5800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faea00b3e20 con 0x7faea00ccdf0 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.464+0000 7fae9fe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faea015f6b0 0x7faea00ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.464+0000 7fae9f400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7faea00b4ec0 0x7faea00cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51572/0 (socket says 172.21.15.96:51572) 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.464+0000 7fae9f400640 1 -- 172.21.15.96:0/232993890 learned_addr learned my addr 172.21.15.96:0/232993890 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.465+0000 7faea4e00640 1 --2- 172.21.15.96:0/232993890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faea00ccdf0 0x7faea0070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.465+0000 7fae9ea00640 1 -- 172.21.15.96:0/232993890 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130754529 0 0) 0x7faea015fa90 con 0x7faea00b4ec0 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.465+0000 7fae9ea00640 1 -- 172.21.15.96:0/232993890 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae84003520 con 0x7faea00b4ec0 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.465+0000 7fae9fe00640 1 -- 172.21.15.96:0/232993890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faea00ccdf0 msgr2=0x7faea0070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.465+0000 7fae9fe00640 1 --2- 172.21.15.96:0/232993890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faea00ccdf0 0x7faea0070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.465+0000 7fae9fe00640 1 -- 172.21.15.96:0/232993890 >> v1:172.21.15.96:6789/0 conn(0x7faea00b4ec0 legacy=0x7faea00cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.465+0000 7fae9fe00640 1 -- 172.21.15.96:0/232993890 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea00b4100 con 0x7faea015f6b0 2024-04-24T23:59:48.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.466+0000 7fae9fe00640 1 --2- 172.21.15.96:0/232993890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea015f6b0 0x7faea00ce5e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fae900097a0 tx=0x7fae9002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5687081e9c3153ab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.466+0000 7fae9ea00640 1 -- 172.21.15.96:0/232993890 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90037070 con 0x7faea015f6b0 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7fae9ea00640 1 -- 172.21.15.96:0/232993890 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae90032440 con 0x7faea015f6b0 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7fae9ea00640 1 -- 172.21.15.96:0/232993890 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90032810 con 0x7faea015f6b0 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7faea5800640 1 -- 172.21.15.96:0/232993890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea015f6b0 msgr2=0x7faea00ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7faea5800640 1 --2- 172.21.15.96:0/232993890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea015f6b0 0x7faea00ce5e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fae900097a0 tx=0x7fae9002a180 comp rx=0 tx=0).stop 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7faea5800640 1 -- 172.21.15.96:0/232993890 shutdown_connections 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7faea5800640 1 --2- 172.21.15.96:0/232993890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faea00ccdf0 0x7faea0070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7faea5800640 1 --2- 172.21.15.96:0/232993890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea015f6b0 0x7faea00ce5e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7faea5800640 1 -- 172.21.15.96:0/232993890 >> 172.21.15.96:0/232993890 conn(0x7faea00b1f10 msgr2=0x7faea00cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7faea5800640 1 -- 172.21.15.96:0/232993890 shutdown_connections 2024-04-24T23:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.467+0000 7faea5800640 1 -- 172.21.15.96:0/232993890 wait complete. 2024-04-24T23:59:48.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.469+0000 7faea5800640 1 Processor -- start 2024-04-24T23:59:48.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.469+0000 7faea5800640 1 -- start start 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.470+0000 7faea5800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea00b4ec0 0x7faea009d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.470+0000 7faea5800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faea00ccdf0 0x7faea014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.470+0000 7faea5800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faea015f6b0 0x7faea014cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.470+0000 7faea5800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7faea00ceb20 con 0x7faea00b4ec0 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.470+0000 7faea5800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faea00b46c0 con 0x7faea015f6b0 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.470+0000 7faea5800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faea00cf1c0 con 0x7faea00ccdf0 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.470+0000 7fae9fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea00b4ec0 0x7faea009d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.470+0000 7fae9fe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea00b4ec0 0x7faea009d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34556/0 (socket says 172.21.15.96:34556) 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.470+0000 7fae9fe00640 1 -- 172.21.15.96:0/3794326388 learned_addr learned my addr 172.21.15.96:0/3794326388 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.471+0000 7fae9fe00640 1 -- 172.21.15.96:0/3794326388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faea00ccdf0 msgr2=0x7faea014c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.471+0000 7fae9fe00640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faea00ccdf0 0x7faea014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.471+0000 7fae9fe00640 1 -- 172.21.15.96:0/3794326388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faea015f6b0 msgr2=0x7faea014cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.471+0000 7fae9fe00640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faea015f6b0 0x7faea014cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.471+0000 7fae9fe00640 1 -- 172.21.15.96:0/3794326388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea015cf70 con 0x7faea00b4ec0 2024-04-24T23:59:48.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.471+0000 7fae9fe00640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea00b4ec0 0x7faea009d540 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fae90035040 tx=0x7fae900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:48.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.471+0000 7fae97e00640 1 -- 172.21.15.96:0/3794326388 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90037040 con 0x7faea00b4ec0 2024-04-24T23:59:48.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.471+0000 7fae97e00640 1 -- 172.21.15.96:0/3794326388 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae90030500 con 0x7faea00b4ec0 2024-04-24T23:59:48.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.471+0000 7fae97e00640 1 -- 172.21.15.96:0/3794326388 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90030910 con 0x7faea00b4ec0 2024-04-24T23:59:48.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.472+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea015d250 con 0x7faea00b4ec0 2024-04-24T23:59:48.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.472+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea015cc20 con 0x7faea00b4ec0 2024-04-24T23:59:48.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.473+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea0067e40 con 0x7faea00b4ec0 2024-04-24T23:59:48.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.474+0000 7fae97e00640 1 -- 172.21.15.96:0/3794326388 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fae90044020 con 0x7faea00b4ec0 2024-04-24T23:59:48.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.475+0000 7fae97e00640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fae8006c010 0x7fae8006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.475+0000 7fae97e00640 1 -- 172.21.15.96:0/3794326388 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fae900ab1a0 con 0x7faea00b4ec0 2024-04-24T23:59:48.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.475+0000 7fae9f400640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fae8006c010 0x7fae8006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:48.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.476+0000 7fae9f400640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fae8006c010 0x7fae8006e4d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fae8c000f60 tx=0x7fae8c0078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:48.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.479+0000 7fae97e00640 1 -- 172.21.15.96:0/3794326388 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fae90079b30 con 0x7faea00b4ec0 2024-04-24T23:59:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.687+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faea00756b0 con 0x7faea00b4ec0 2024-04-24T23:59:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.688+0000 7fae97e00640 1 -- 172.21.15.96:0/3794326388 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+12972 (secure 0 0 0) 0x7fae90079430 con 0x7faea00b4ec0 2024-04-24T23:59:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:48.689 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":36,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:47.159610+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:6835/3672280349":"2024-04-25T23:59:44.060275+0000","172.21.15.96:6834/3672280349":"2024-04-25T23:59:44.060275+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.691+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fae8006c010 msgr2=0x7fae8006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.691+0000 7faea5800640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fae8006c010 0x7fae8006e4d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fae8c000f60 tx=0x7fae8c0078f0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.691+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea00b4ec0 msgr2=0x7faea009d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.691+0000 7faea5800640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea00b4ec0 0x7faea009d540 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fae90035040 tx=0x7fae900046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.692+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 shutdown_connections 2024-04-24T23:59:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.692+0000 7faea5800640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faea015f6b0 0x7faea014cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.692+0000 7faea5800640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faea00ccdf0 0x7faea014c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.692+0000 7faea5800640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fae8006c010 0x7fae8006e4d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.692+0000 7faea5800640 1 --2- 172.21.15.96:0/3794326388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea00b4ec0 0x7faea009d540 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.692+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 >> 172.21.15.96:0/3794326388 conn(0x7faea00b1f10 msgr2=0x7faea0074210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.692+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 shutdown_connections 2024-04-24T23:59:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.692+0000 7faea5800640 1 -- 172.21.15.96:0/3794326388 wait complete. 2024-04-24T23:59:48.710 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:57:54.373346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:59:48.711 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:59:48.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.910+0000 7fd6dc600640 1 Processor -- start 2024-04-24T23:59:48.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.910+0000 7fd6dc600640 1 -- start start 2024-04-24T23:59:48.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.911+0000 7fd6dc600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6d415cd10 0x7fd6d4163610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.911+0000 7fd6dc600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6d40b45a0 0x7fd6d40acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.911+0000 7fd6dc600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d40b3080 con 0x7fd6d40b4120 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.911+0000 7fd6dc600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d40b3c90 con 0x7fd6d415cd10 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.911+0000 7fd6dc600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d4163b50 con 0x7fd6d40b45a0 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.912+0000 7fd6d9c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6d415cd10 0x7fd6d4163610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.912+0000 7fd6d9c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6d415cd10 0x7fd6d4163610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34560/0 (socket says 172.21.15.96:34560) 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.912+0000 7fd6d9c00640 1 -- 172.21.15.96:0/1160056010 learned_addr learned my addr 172.21.15.96:0/1160056010 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.912+0000 7fd6da600640 1 --2- 172.21.15.96:0/1160056010 >> v2:172.21.15.155:3300/0 conn(0x7fd6d40b45a0 0x7fd6d40acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.912+0000 7fd6d9c00640 1 -- 172.21.15.96:0/1160056010 >> v2:172.21.15.155:3300/0 conn(0x7fd6d40b45a0 msgr2=0x7fd6d40acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.912+0000 7fd6d9c00640 1 --2- 172.21.15.96:0/1160056010 >> v2:172.21.15.155:3300/0 conn(0x7fd6d40b45a0 0x7fd6d40acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.912+0000 7fd6d9c00640 1 -- 172.21.15.96:0/1160056010 >> v1:172.21.15.155:6789/0 conn(0x7fd6d40b4120 legacy=0x7fd6d406cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:48.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.912+0000 7fd6d9c00640 1 -- 172.21.15.96:0/1160056010 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d40b3360 con 0x7fd6d415cd10 2024-04-24T23:59:48.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.914+0000 7fd6d9c00640 1 --2- 172.21.15.96:0/1160056010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d415cd10 0x7fd6d4163610 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4070bd0 tx=0x7fd6c402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aafb3c69fdf790 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:48.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.914+0000 7fd6d3e00640 1 -- 172.21.15.96:0/1160056010 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4037070 con 0x7fd6d415cd10 2024-04-24T23:59:48.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.914+0000 7fd6d3e00640 1 -- 172.21.15.96:0/1160056010 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c4032440 con 0x7fd6d415cd10 2024-04-24T23:59:48.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.914+0000 7fd6d3e00640 1 -- 172.21.15.96:0/1160056010 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4032810 con 0x7fd6d415cd10 2024-04-24T23:59:48.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.915+0000 7fd6dc600640 1 -- 172.21.15.96:0/1160056010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d415cd10 msgr2=0x7fd6d4163610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.915+0000 7fd6dc600640 1 --2- 172.21.15.96:0/1160056010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d415cd10 0x7fd6d4163610 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4070bd0 tx=0x7fd6c402a230 comp rx=0 tx=0).stop 2024-04-24T23:59:48.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.915+0000 7fd6dc600640 1 -- 172.21.15.96:0/1160056010 shutdown_connections 2024-04-24T23:59:48.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.915+0000 7fd6dc600640 1 --2- 172.21.15.96:0/1160056010 >> v2:172.21.15.155:3300/0 conn(0x7fd6d40b45a0 0x7fd6d40acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.915+0000 7fd6dc600640 1 --2- 172.21.15.96:0/1160056010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d415cd10 0x7fd6d4163610 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.915+0000 7fd6dc600640 1 -- 172.21.15.96:0/1160056010 >> 172.21.15.96:0/1160056010 conn(0x7fd6d40b19c0 msgr2=0x7fd6d40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:48.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.915+0000 7fd6dc600640 1 -- 172.21.15.96:0/1160056010 shutdown_connections 2024-04-24T23:59:48.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.915+0000 7fd6dc600640 1 -- 172.21.15.96:0/1160056010 wait complete. 2024-04-24T23:59:48.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.917+0000 7fd6dc600640 1 Processor -- start 2024-04-24T23:59:48.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.917+0000 7fd6dc600640 1 -- start start 2024-04-24T23:59:48.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6dc600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d40b4120 0x7fd6d41f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6dc600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d40b45a0 0x7fd6d41fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6dc600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d415cd10 0x7fd6d4158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6dc600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d406ee90 con 0x7fd6d40b4120 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6dc600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d40b3920 con 0x7fd6d415cd10 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6dc600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d406f010 con 0x7fd6d40b45a0 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6d9c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d40b4120 0x7fd6d41f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6d9c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d40b4120 0x7fd6d41f86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34576/0 (socket says 172.21.15.96:34576) 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6d9c00640 1 -- 172.21.15.96:0/4007751788 learned_addr learned my addr 172.21.15.96:0/4007751788 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6d9c00640 1 -- 172.21.15.96:0/4007751788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d40b45a0 msgr2=0x7fd6d41fb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6d9c00640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d40b45a0 0x7fd6d41fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6d9c00640 1 -- 172.21.15.96:0/4007751788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d415cd10 msgr2=0x7fd6d4158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6d9c00640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d415cd10 0x7fd6d4158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:48.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.918+0000 7fd6d9c00640 1 -- 172.21.15.96:0/4007751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d41f8c20 con 0x7fd6d40b4120 2024-04-24T23:59:48.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.919+0000 7fd6d9c00640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d40b4120 0x7fd6d41f86e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd6c402a270 tx=0x7fd6c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:48.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.919+0000 7fd6d1600640 1 -- 172.21.15.96:0/4007751788 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4041020 con 0x7fd6d40b4120 2024-04-24T23:59:48.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.919+0000 7fd6d1600640 1 -- 172.21.15.96:0/4007751788 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c40306c0 con 0x7fd6d40b4120 2024-04-24T23:59:48.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.919+0000 7fd6d1600640 1 -- 172.21.15.96:0/4007751788 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4037040 con 0x7fd6d40b4120 2024-04-24T23:59:48.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.919+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d41fba20 con 0x7fd6d40b4120 2024-04-24T23:59:48.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.919+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d41654e0 con 0x7fd6d40b4120 2024-04-24T23:59:48.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.920+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d40af580 con 0x7fd6d40b4120 2024-04-24T23:59:48.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.921+0000 7fd6d1600640 1 -- 172.21.15.96:0/4007751788 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fd6c4044020 con 0x7fd6d40b4120 2024-04-24T23:59:48.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.922+0000 7fd6d1600640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd6b406c030 0x7fd6b406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:48.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.922+0000 7fd6d1600640 1 -- 172.21.15.96:0/4007751788 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fd6c40ab300 con 0x7fd6d40b4120 2024-04-24T23:59:48.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.923+0000 7fd6d9200640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd6b406c030 0x7fd6b406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:48.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.923+0000 7fd6d9200640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd6b406c030 0x7fd6b406e4f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40b4da0 tx=0x7fd6c00079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:48.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:48.927+0000 7fd6d1600640 1 -- 172.21.15.96:0/4007751788 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd6d40af580 con 0x7fd6d40b4120 2024-04-24T23:59:49.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.126+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd6d40689c0 con 0x7fd6d40b4120 2024-04-24T23:59:49.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.126+0000 7fd6d1600640 1 -- 172.21.15.96:0/4007751788 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fd6d40689c0 con 0x7fd6d40b4120 2024-04-24T23:59:49.127 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-24T23:59:49.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.129+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd6b406c030 msgr2=0x7fd6b406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:49.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.129+0000 7fd6dc600640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd6b406c030 0x7fd6b406e4f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40b4da0 tx=0x7fd6c00079b0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.129+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d40b4120 msgr2=0x7fd6d41f86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.129+0000 7fd6dc600640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d40b4120 0x7fd6d41f86e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd6c402a270 tx=0x7fd6c40046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.130+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 shutdown_connections 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.130+0000 7fd6dc600640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d415cd10 0x7fd6d4158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.130+0000 7fd6dc600640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d40b45a0 0x7fd6d41fb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.130+0000 7fd6dc600640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd6b406c030 0x7fd6b406e4f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.130+0000 7fd6dc600640 1 --2- 172.21.15.96:0/4007751788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d40b4120 0x7fd6d41f86e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.130+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 >> 172.21.15.96:0/4007751788 conn(0x7fd6d40b19c0 msgr2=0x7fd6d40acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.130+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 shutdown_connections 2024-04-24T23:59:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.130+0000 7fd6dc600640 1 -- 172.21.15.96:0/4007751788 wait complete. 2024-04-24T23:59:49.149 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-24T23:59:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.353+0000 7f30b8000640 1 Processor -- start 2024-04-24T23:59:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.353+0000 7f30b8000640 1 -- start start 2024-04-24T23:59:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.355+0000 7f30b8000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f30b00af120 0x7f30b0071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.355+0000 7f30b8000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30b00acda0 0x7f30b006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.355+0000 7f30b8000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b0160b20 con 0x7f30b015c230 2024-04-24T23:59:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.355+0000 7f30b8000640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f30b015c610 con 0x7f30b00af120 2024-04-24T23:59:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.355+0000 7f30b8000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30b00ad230 con 0x7f30b00acda0 2024-04-24T23:59:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.355+0000 7f30b4c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f30b00af120 0x7f30b0071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.355+0000 7f30b4c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f30b00af120 0x7f30b0071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34586/0 (socket says 172.21.15.96:34586) 2024-04-24T23:59:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.355+0000 7f30b4c00640 1 -- 172.21.15.96:0/3405923941 learned_addr learned my addr 172.21.15.96:0/3405923941 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.356+0000 7f30b4c00640 1 -- 172.21.15.96:0/3405923941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30b00acda0 msgr2=0x7f30b006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.356+0000 7f30b4c00640 1 --2- 172.21.15.96:0/3405923941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30b00acda0 0x7f30b006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.356+0000 7f30b4c00640 1 -- 172.21.15.96:0/3405923941 >> v1:172.21.15.155:6789/0 conn(0x7f30b015c230 legacy=0x7f30b00aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.356+0000 7f30b4c00640 1 -- 172.21.15.96:0/3405923941 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b015fd60 con 0x7f30b00af120 2024-04-24T23:59:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.357+0000 7f30b4c00640 1 --2- 172.21.15.96:0/3405923941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00af120 0x7f30b0071800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f309c009870 tx=0x7f309c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29463a91de4651d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.357+0000 7f30afe00640 1 -- 172.21.15.96:0/3405923941 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c037070 con 0x7f30b00af120 2024-04-24T23:59:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.357+0000 7f30afe00640 1 -- 172.21.15.96:0/3405923941 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c032440 con 0x7f30b00af120 2024-04-24T23:59:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.357+0000 7f30afe00640 1 -- 172.21.15.96:0/3405923941 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c032810 con 0x7f30b00af120 2024-04-24T23:59:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.358+0000 7f30b8000640 1 -- 172.21.15.96:0/3405923941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00af120 msgr2=0x7f30b0071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.358+0000 7f30b8000640 1 --2- 172.21.15.96:0/3405923941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00af120 0x7f30b0071800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f309c009870 tx=0x7f309c02a210 comp rx=0 tx=0).stop 2024-04-24T23:59:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.358+0000 7f30b8000640 1 -- 172.21.15.96:0/3405923941 shutdown_connections 2024-04-24T23:59:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.358+0000 7f30b8000640 1 --2- 172.21.15.96:0/3405923941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30b00acda0 0x7f30b006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.358+0000 7f30b8000640 1 --2- 172.21.15.96:0/3405923941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00af120 0x7f30b0071800 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.358+0000 7f30b8000640 1 -- 172.21.15.96:0/3405923941 >> 172.21.15.96:0/3405923941 conn(0x7f30b00b19c0 msgr2=0x7f30b00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.358+0000 7f30b8000640 1 -- 172.21.15.96:0/3405923941 shutdown_connections 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.358+0000 7f30b8000640 1 -- 172.21.15.96:0/3405923941 wait complete. 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.360+0000 7f30b8000640 1 Processor -- start 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.360+0000 7f30b8000640 1 -- start start 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b8000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00acda0 0x7f30b015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b8000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30b00af120 0x7f30b00b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b8000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30b015c230 0x7f30b015dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b8000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0160600 con 0x7f30b00acda0 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b8000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0160320 con 0x7f30b015c230 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b8000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30b00ad4d0 con 0x7f30b00af120 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b5600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00acda0 0x7f30b015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b5600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00acda0 0x7f30b015c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34600/0 (socket says 172.21.15.96:34600) 2024-04-24T23:59:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b5600640 1 -- 172.21.15.96:0/328924435 learned_addr learned my addr 172.21.15.96:0/328924435 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b5600640 1 -- 172.21.15.96:0/328924435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30b00af120 msgr2=0x7f30b00b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b4c00640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30b00af120 0x7f30b00b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b6000640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30b015c230 0x7f30b015dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.361+0000 7f30b5600640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30b00af120 0x7f30b00b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30b5600640 1 -- 172.21.15.96:0/328924435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30b015c230 msgr2=0x7f30b015dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30b5600640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30b015c230 0x7f30b015dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30b5600640 1 -- 172.21.15.96:0/328924435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b01f8250 con 0x7f30b00acda0 2024-04-24T23:59:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30b6000640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30b015c230 0x7f30b015dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30b5600640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00acda0 0x7f30b015c790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b3e0 tx=0x7f30a400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30ad600640 1 -- 172.21.15.96:0/328924435 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4015020 con 0x7f30b00acda0 2024-04-24T23:59:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30ad600640 1 -- 172.21.15.96:0/328924435 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4011850 con 0x7f30b00acda0 2024-04-24T23:59:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30ad600640 1 -- 172.21.15.96:0/328924435 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4011c40 con 0x7f30b00acda0 2024-04-24T23:59:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b01f79b0 con 0x7f30b00acda0 2024-04-24T23:59:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.362+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b01f7f70 con 0x7f30b00acda0 2024-04-24T23:59:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.363+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b0069110 con 0x7f30b00acda0 2024-04-24T23:59:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.365+0000 7f30ad600640 1 -- 172.21.15.96:0/328924435 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f30a4018020 con 0x7f30b00acda0 2024-04-24T23:59:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.365+0000 7f30ad600640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f309006bfe0 0x7f309006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.366+0000 7f30ad600640 1 -- 172.21.15.96:0/328924435 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f30a408ad30 con 0x7f30b00acda0 2024-04-24T23:59:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.366+0000 7f30b4c00640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f309006bfe0 0x7f309006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:49.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.367+0000 7f30b4c00640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f309006bfe0 0x7f309006e4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f309c034000 tx=0x7f309c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.370+0000 7f30ad600640 1 -- 172.21.15.96:0/328924435 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f30a401f020 con 0x7f30b00acda0 2024-04-24T23:59:49.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.621+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f30b015ccd0 con 0x7f30b00acda0 2024-04-24T23:59:49.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.638+0000 7f30ad600640 1 -- 172.21.15.96:0/328924435 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v7) ==== 81+0+471195 (secure 0 0 0) 0x7f30a40172c0 con 0x7f30b00acda0 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 7, 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: "active_gid": 4101, 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: "active_name": "y", 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: "active_addrs": { 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-24T23:59:49.646 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6832", 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2887634096 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6833", 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2887634096 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: "active_addr": "172.21.15.96:6833/2887634096", 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: "active_change": "2024-04-24T23:57:46.281687+0000", 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: "active_mgr_features": 4540701547738038271, 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: "available": true, 2024-04-24T23:59:49.647 INFO:teuthology.orchestra.run.smithi096.stdout: "standbys": [ 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "gid": 4106, 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "x", 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_features": 4540701547738038271, 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "available_modules": [ 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "alerts", 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:49.648 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "How frequently to reexamine health status", 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.649 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.650 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.651 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.652 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.653 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_destination": { 2024-04-24T23:59:49.654 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_destination", 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Email address to send alerts to", 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.655 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_from_name": { 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_from_name", 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "Ceph", 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Email From: name", 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_host": { 2024-04-24T23:59:49.656 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_host", 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "SMTP server", 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.657 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_password": { 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_password", 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Password to authenticate with", 2024-04-24T23:59:49.658 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_port": { 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_port", 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "465", 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "SMTP port", 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.659 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_sender": { 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_sender", 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "SMTP envelope sender", 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.660 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_ssl": { 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_ssl", 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-24T23:59:49.661 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_user": { 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_user", 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "User to authenticate as", 2024-04-24T23:59:49.662 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "balancer", 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "active": { 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "active", 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.663 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "automatically balance PGs across cluster", 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "begin_time": { 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "begin_time", 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.664 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0000", 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "beginning time of day to automatically balance", 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "begin_weekday": { 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "begin_weekday", 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.665 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "0", 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "6", 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_compat_max_iterations": { 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crush_compat_max_iterations", 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.666 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "25", 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1", 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "250", 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_compat_metrics": { 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crush_compat_metrics", 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "pgs,objects,bytes", 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_compat_step": { 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crush_compat_step", 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0.5", 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "0.001", 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "0.999", 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "aggressiveness of optimization", 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "end_time": { 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "end_time", 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "2359", 2024-04-24T23:59:49.669 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "ending time of day to automatically balance", 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "end_weekday": { 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "end_weekday", 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.670 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "0", 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "6", 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.671 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.673 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.675 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "min_score": { 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "min_score", 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "mode": { 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mode", 2024-04-24T23:59:49.677 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "upmap", 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-compat", 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "none", 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "read", 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "upmap", 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "upmap-read" 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.678 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Balancer mode", 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_ids": { 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "pool_ids", 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-24T23:59:49.680 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "upmap_max_deviation": { 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "upmap_max_deviation", 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5", 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1", 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-24T23:59:49.681 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "upmap_max_optimizations": { 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "upmap_max_optimizations", 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-24T23:59:49.682 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cephadm", 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "agent_down_multiplier": { 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "agent_down_multiplier", 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:49.683 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "3.0", 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "agent_refresh_rate": { 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "agent_refresh_rate", 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.684 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "20", 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "agent_starting_port": { 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "agent_starting_port", 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.685 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "4721", 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_ptrace": { 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "allow_ptrace", 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.686 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "autotune_interval": { 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "autotune_interval", 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.687 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "autotune_memory_target_ratio": { 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "autotune_memory_target_ratio", 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0.7", 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "cephadm_log_destination": { 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cephadm_log_destination", 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "file", 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "file,syslog", 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "syslog" 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "cgroups_split": { 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cgroups_split", 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "config_checks_enabled": { 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "config_checks_enabled", 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "config_dashboard": { 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "config_dashboard", 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_alertmanager": { 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_alertmanager", 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Prometheus container image", 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_base": { 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_base", 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Container image name, without the tag", 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.695 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_elasticsearch": { 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_elasticsearch", 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "elasticsearch container image", 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_grafana": { 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_grafana", 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Prometheus container image", 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.697 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_haproxy": { 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_haproxy", 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "HAproxy container image", 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.698 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_jaeger_agent": { 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_jaeger_agent", 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Jaeger agent container image", 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_jaeger_collector": { 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_jaeger_collector", 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Jaeger collector container image", 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.700 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_jaeger_query": { 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_jaeger_query", 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Jaeger query container image", 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_keepalived": { 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_keepalived", 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Keepalived container image", 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.702 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_loki": { 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_loki", 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Loki container image", 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.703 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_node_exporter": { 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_node_exporter", 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Prometheus container image", 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_nvmeof": { 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_nvmeof", 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Nvme-of container image", 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_prometheus": { 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_prometheus", 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Prometheus container image", 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_promtail": { 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_promtail", 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Promtail container image", 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_samba": { 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_samba", 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Samba/SMB container image", 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.708 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_snmp_gateway": { 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_snmp_gateway", 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "SNMP Gateway container image", 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.709 INFO:teuthology.orchestra.run.smithi096.stdout: "container_init": { 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_init", 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Run podman/docker with `--init`", 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.710 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "daemon_cache_timeout": { 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "daemon_cache_timeout", 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.711 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "default_cephadm_command_timeout": { 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "default_cephadm_command_timeout", 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "900", 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.712 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "default_registry": { 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "default_registry", 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "docker.io", 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "device_cache_timeout": { 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "device_cache_timeout", 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "1800", 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "seconds to cache device inventory", 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "device_enhanced_scan": { 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "device_enhanced_scan", 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "facts_cache_timeout": { 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "facts_cache_timeout", 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "seconds to cache host facts data", 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "grafana_dashboards_path": { 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "grafana_dashboards_path", 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "host_check_interval": { 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "host_check_interval", 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to perform a host check", 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "hw_monitoring": { 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "hw_monitoring", 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.719 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "inventory_list_all": { 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "inventory_list_all", 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.720 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.721 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "log_refresh_metadata": { 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_refresh_metadata", 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.722 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.723 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.724 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.726 INFO:teuthology.orchestra.run.smithi096.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.727 INFO:teuthology.orchestra.run.smithi096.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "*", 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.728 INFO:teuthology.orchestra.run.smithi096.stdout: "max_count_per_host": { 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_count_per_host", 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "max number of daemons per service per host", 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.729 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd_draining_count": { 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_osd_draining_count", 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.730 INFO:teuthology.orchestra.run.smithi096.stdout: "migration_current": { 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "migration_current", 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "internal - do not modify", 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.731 INFO:teuthology.orchestra.run.smithi096.stdout: "mode": { 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mode", 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "root", 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "cephadm-package", 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "root" 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "mode for remote execution of cephadm", 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.732 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "oob_default_addr": { 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "oob_default_addr", 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "169.254.1.1", 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.733 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "prometheus_alerts_path": { 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "prometheus_alerts_path", 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.734 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "registry_insecure": { 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "registry_insecure", 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.735 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "registry_password": { 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "registry_password", 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-24T23:59:49.736 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "registry_url": { 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "registry_url", 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.737 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "registry_username": { 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "registry_username", 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-24T23:59:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "secure_monitoring_stack": { 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "secure_monitoring_stack", 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.739 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "service_discovery_port": { 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "service_discovery_port", 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8765", 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "cephadm service discovery port", 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.740 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "ssh_config_file": { 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ssh_config_file", 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "use_agent": { 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "use_agent", 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "use_repo_digest": { 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "use_repo_digest", 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.743 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_on_failed_host_check": { 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_on_failed_host_check", 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "raise a health warning if the host check fails", 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_on_stray_daemons": { 2024-04-24T23:59:49.744 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_on_stray_daemons", 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_on_stray_hosts": { 2024-04-24T23:59:49.745 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_on_stray_hosts", 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.746 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crash", 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.748 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.749 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.750 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.753 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.753 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.753 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.753 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.753 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.754 INFO:teuthology.orchestra.run.smithi096.stdout: "retain_interval": { 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "retain_interval", 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "31536000", 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_recent_interval": { 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_recent_interval", 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "1209600", 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.756 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "dashboard", 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.757 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "ALERTMANAGER_API_HOST": { 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.758 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.759 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "AUDIT_API_ENABLED": { 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "AUDIT_API_ENABLED", 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.760 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.761 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "ENABLE_BROWSABLE_API": { 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-24T23:59:49.762 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-24T23:59:49.763 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-24T23:59:49.764 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-24T23:59:49.765 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-24T23:59:49.766 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-24T23:59:49.767 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-24T23:59:49.768 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-24T23:59:49.769 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-24T23:59:49.770 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_API_PASSWORD": { 2024-04-24T23:59:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "admin", 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.772 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.774 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_API_URL": { 2024-04-24T23:59:49.774 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_API_URL", 2024-04-24T23:59:49.774 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.774 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.774 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.774 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.774 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_API_USERNAME": { 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "admin", 2024-04-24T23:59:49.775 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.776 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.777 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.778 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.779 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "PROMETHEUS_API_HOST": { 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.780 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.781 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.782 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.783 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.784 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.785 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.786 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.787 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.788 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_ENABLED": { 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.789 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.791 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.792 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8", 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.793 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "45", 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "RGW_API_ACCESS_KEY": { 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.794 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "admin", 2024-04-24T23:59:49.795 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "RGW_API_SECRET_KEY": { 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.796 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "RGW_API_SSL_VERIFY": { 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.799 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.800 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5", 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "cross_origin_url": { 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cross_origin_url", 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.801 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "crt_file": { 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crt_file", 2024-04-24T23:59:49.802 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "debug": { 2024-04-24T23:59:49.803 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "debug", 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Enable/disable debug options", 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.804 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "jwt_token_ttl": { 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "jwt_token_ttl", 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "28800", 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.805 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "key_file": { 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "key_file", 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.806 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.807 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.808 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.810 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.811 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "motd": { 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "motd", 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "The message of the day", 2024-04-24T23:59:49.812 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "redirect_resolve_ip_addr": { 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "redirect_resolve_ip_addr", 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.813 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "server_addr": { 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_addr", 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "::", 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.814 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "server_port": { 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_port", 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8080", 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.815 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ssl": { 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ssl", 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.816 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "ssl_server_port": { 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ssl_server_port", 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8443", 2024-04-24T23:59:49.817 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "standby_behaviour": { 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "standby_behaviour", 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.818 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "redirect", 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "redirect" 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.819 INFO:teuthology.orchestra.run.smithi096.stdout: "standby_error_status_code": { 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "standby_error_status_code", 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "500", 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "400", 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "599", 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.820 INFO:teuthology.orchestra.run.smithi096.stdout: "url_prefix": { 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "url_prefix", 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.821 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "devicehealth", 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: "enable_monitoring": { 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "enable_monitoring", 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.822 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "monitor device health metrics", 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.823 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.824 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.825 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.826 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.827 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "mark_out_threshold": { 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mark_out_threshold", 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "2419200", 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.829 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": { 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "pool_name", 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "device_health_metrics", 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.830 INFO:teuthology.orchestra.run.smithi096.stdout: "retention_period": { 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "retention_period", 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "15552000", 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how long to retain device health metrics", 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.831 INFO:teuthology.orchestra.run.smithi096.stdout: "scrape_frequency": { 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "scrape_frequency", 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "86400", 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "self_heal": { 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "self_heal", 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.833 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:49.834 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to wake up and check device health", 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_threshold": { 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_threshold", 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "7257600", 2024-04-24T23:59:49.835 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.836 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.836 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.836 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-24T23:59:49.836 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.836 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.836 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.836 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.836 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "diskprediction_local", 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.837 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.838 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.839 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.840 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.841 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.842 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.842 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.842 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.842 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.842 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.842 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.842 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.842 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "predict_interval": { 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "predict_interval", 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "86400", 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.844 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: "predictor_model": { 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "predictor_model", 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.845 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "prophetstor", 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.846 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "influx", 2024-04-24T23:59:49.847 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": false, 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "influxdb python module not found", 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "batch_size": { 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "batch_size", 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5000", 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.848 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "database": { 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "database", 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "ceph", 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.849 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": { 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "hostname", 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.850 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "InfluxDB server hostname", 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "30", 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "5", 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.851 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.852 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.853 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.854 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.855 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.856 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "password": { 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "password", 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "password of InfluxDB server user", 2024-04-24T23:59:49.857 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "port": { 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "port", 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8086", 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "InfluxDB server port", 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.858 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "ssl": { 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ssl", 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "false", 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.859 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "threads": { 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "threads", 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5", 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1", 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "32", 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.860 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "username": { 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "username", 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "username of InfluxDB server user", 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "verify_ssl": { 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "verify_ssl", 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "true", 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-24T23:59:49.862 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "insights", 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.863 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.864 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.865 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.866 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.867 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.868 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "iostat", 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.869 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.870 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.871 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.872 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.873 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.874 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "localpool", 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.875 INFO:teuthology.orchestra.run.smithi096.stdout: "failure_domain": { 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "failure_domain", 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "host", 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "failure domain for any created local pool", 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-24T23:59:49.876 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.877 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.880 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.881 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.881 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.881 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.881 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.881 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.881 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.881 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.881 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": { 2024-04-24T23:59:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "min_size", 2024-04-24T23:59:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "default min_size for any created local pool", 2024-04-24T23:59:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "num_rep": { 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "num_rep", 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "3", 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "default replica count for any created local pool", 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": { 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "pg_num", 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "128", 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "default pg_num for any created local pool", 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "prefix": { 2024-04-24T23:59:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "prefix", 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "name prefix for any created local pool", 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "subtree": { 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "subtree", 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "rack", 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mds_autoscaler", 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.894 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mirroring", 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.895 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.896 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.897 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.898 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.899 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "nfs", 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.901 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.902 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.903 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.904 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.905 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "orchestrator", 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.906 INFO:teuthology.orchestra.run.smithi096.stdout: "fail_fs": { 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "fail_fs", 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.907 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.908 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.909 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.910 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.912 INFO:teuthology.orchestra.run.smithi096.stdout: "orchestrator": { 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "orchestrator", 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "cephadm", 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "rook", 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "test_orchestrator" 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Orchestrator backend", 2024-04-24T23:59:49.913 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "osd_perf_query", 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.914 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.916 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.918 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.919 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.921 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "osd_support", 2024-04-24T23:59:49.921 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.921 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.921 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.921 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.921 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.921 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.921 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.921 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.922 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.923 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.924 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.925 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.926 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.927 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "pg_autoscaler", 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.928 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.929 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.930 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.931 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.932 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "threshold": { 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "threshold", 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.934 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "3.0", 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1.0", 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "scaling threshold", 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "progress", 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.935 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_pg_recovery_event": { 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "allow_pg_recovery_event", 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.936 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "enabled": { 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "enabled", 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.937 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.938 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.939 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.941 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.942 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "max_completed_events": { 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_completed_events", 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "50", 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "number of past completed events to remember", 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.943 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5", 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how long the module is going to sleep", 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.944 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "prometheus", 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "cache": { 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cache", 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.945 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "exclude_perf_counters": { 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "exclude_perf_counters", 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.946 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.947 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.948 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.949 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.950 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.951 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_stats_pools": { 2024-04-24T23:59:49.952 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rbd_stats_pools", 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-24T23:59:49.953 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "300", 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "scrape_interval": { 2024-04-24T23:59:49.954 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "scrape_interval", 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "15.0", 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "server_addr": { 2024-04-24T23:59:49.955 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_addr", 2024-04-24T23:59:49.956 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.956 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.956 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.956 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "::", 2024-04-24T23:59:49.956 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.956 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.956 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: "server_port": { 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_port", 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.957 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "9283", 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.958 INFO:teuthology.orchestra.run.smithi096.stdout: "stale_cache_strategy": { 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "stale_cache_strategy", 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "log", 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "standby_behaviour": { 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "standby_behaviour", 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "default", 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "default", 2024-04-24T23:59:49.960 INFO:teuthology.orchestra.run.smithi096.stdout: "error" 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "standby_error_status_code": { 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "standby_error_status_code", 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.961 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "500", 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "400", 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "599", 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rbd_support", 2024-04-24T23:59:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.963 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.963 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.963 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.963 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.963 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.963 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.963 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.963 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.963 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.964 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.965 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.966 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "max_concurrent_snap_create": { 2024-04-24T23:59:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_concurrent_snap_create", 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.970 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mirror_snapshot_schedule": { 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mirror_snapshot_schedule", 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.971 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "trash_purge_schedule": { 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "trash_purge_schedule", 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.972 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "restful", 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.973 INFO:teuthology.orchestra.run.smithi096.stdout: "enable_auth": { 2024-04-24T23:59:49.974 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "enable_auth", 2024-04-24T23:59:49.974 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.974 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.974 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.974 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "key_file": { 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "key_file", 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.975 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.976 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.977 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.978 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.979 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.980 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "server_addr": { 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_addr", 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.981 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "server_port": { 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_port", 2024-04-24T23:59:49.982 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.983 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rgw", 2024-04-24T23:59:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.988 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rook", 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.989 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.990 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.991 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.992 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "storage_class": { 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "storage_class", 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "local", 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "selftest", 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:49.998 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:49.999 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.000 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "roption1": { 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "roption1", 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.001 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "roption2": { 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "roption2", 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.002 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "xyz", 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption1": { 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption1", 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.003 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption2": { 2024-04-24T23:59:50.004 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption2", 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.005 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption3": { 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption3", 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.006 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption4": { 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption4", 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.007 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption5": { 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption5", 2024-04-24T23:59:50.008 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.010 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption6": { 2024-04-24T23:59:50.010 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption6", 2024-04-24T23:59:50.010 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.010 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.010 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.010 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.010 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.010 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.010 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption7": { 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption7", 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1", 2024-04-24T23:59:50.011 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "42", 2024-04-24T23:59:50.012 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.012 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.012 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.012 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.012 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.012 INFO:teuthology.orchestra.run.smithi096.stdout: "testkey": { 2024-04-24T23:59:50.012 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "testkey", 2024-04-24T23:59:50.012 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.013 INFO:teuthology.orchestra.run.smithi096.stdout: "testlkey": { 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "testlkey", 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.014 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: "testnewline": { 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "testnewline", 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.015 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.016 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "snap_schedule", 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_m_granularity": { 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "allow_m_granularity", 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.017 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "allow minute scheduled snapshots", 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: "dump_on_update": { 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "dump_on_update", 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.018 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "dump database to debug log on update", 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.019 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.020 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.021 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.022 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.023 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.024 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "stats", 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.025 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.026 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.027 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.028 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.029 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "status", 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.031 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.032 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.033 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.035 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "telegraf", 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "address": { 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "address", 2024-04-24T23:59:50.036 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:50.037 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "15", 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.038 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.039 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.040 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.041 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.042 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.043 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "telemetry", 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_basic": { 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_basic", 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.044 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_crash": { 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_crash", 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.045 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-24T23:59:50.046 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.046 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.046 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.046 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_device": { 2024-04-24T23:59:50.046 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_device", 2024-04-24T23:59:50.046 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.046 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.046 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_ident": { 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_ident", 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.047 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_perf": { 2024-04-24T23:59:50.048 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_perf", 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "contact": { 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "contact", 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.050 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.051 INFO:teuthology.orchestra.run.smithi096.stdout: "description": { 2024-04-24T23:59:50.051 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "description", 2024-04-24T23:59:50.051 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.051 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.051 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.051 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.051 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.051 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "device_url": { 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "device_url", 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.052 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "enabled": { 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "enabled", 2024-04-24T23:59:50.053 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.054 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "24", 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "8", 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.055 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "last_opt_revision": { 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "last_opt_revision", 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "1", 2024-04-24T23:59:50.056 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: "leaderboard": { 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "leaderboard", 2024-04-24T23:59:50.057 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.058 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "leaderboard_description": { 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "leaderboard_description", 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.059 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.060 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.061 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.062 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.063 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.064 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "organization": { 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "organization", 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.065 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "proxy": { 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "proxy", 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.066 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "url": { 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "url", 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.067 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "test_orchestrator", 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.068 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.069 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.070 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.071 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.072 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.073 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "volumes", 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.074 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.075 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.076 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.077 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.078 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "max_concurrent_clones": { 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_concurrent_clones", 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.079 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "4", 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "periodic_async_work": { 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "periodic_async_work", 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.080 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Periodically check for async work", 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "snapshot_clone_delay": { 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "snapshot_clone_delay", 2024-04-24T23:59:50.081 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.082 INFO:teuthology.orchestra.run.smithi096.stdout: "snapshot_clone_no_wait": { 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "snapshot_clone_no_wait", 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.083 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "zabbix", 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "discovery_interval": { 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "discovery_interval", 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.084 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "100", 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "identifier": { 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "identifier", 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.085 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.086 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.086 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.086 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.086 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.086 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.086 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.086 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.086 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.088 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.089 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.090 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.090 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.090 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.090 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.090 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.090 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.090 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.090 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.090 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.091 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.092 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "zabbix_host": { 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "zabbix_host", 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.094 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "zabbix_port": { 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "zabbix_port", 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10051", 2024-04-24T23:59:50.095 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "zabbix_sender": { 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "zabbix_sender", 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.096 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.097 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: "modules": [ 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: "iostat", 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: "nfs", 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: "restful" 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: "available_modules": [ 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.098 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "alerts", 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:50.099 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "How frequently to reexamine health status", 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.100 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.103 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.104 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_destination": { 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_destination", 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.105 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Email address to send alerts to", 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_from_name": { 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_from_name", 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.106 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "Ceph", 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Email From: name", 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_host": { 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_host", 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.107 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "SMTP server", 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_password": { 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_password", 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.108 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Password to authenticate with", 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_port": { 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_port", 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.109 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "465", 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "SMTP port", 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_sender": { 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_sender", 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.110 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "SMTP envelope sender", 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_ssl": { 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_ssl", 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.111 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "smtp_user": { 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "smtp_user", 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.112 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "User to authenticate as", 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "balancer", 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "active": { 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "active", 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.114 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "automatically balance PGs across cluster", 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "begin_time": { 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "begin_time", 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0000", 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.115 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "beginning time of day to automatically balance", 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "begin_weekday": { 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "begin_weekday", 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "0", 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "6", 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.116 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_compat_max_iterations": { 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crush_compat_max_iterations", 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "25", 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1", 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "250", 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_compat_metrics": { 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crush_compat_metrics", 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "pgs,objects,bytes", 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.118 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_compat_step": { 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crush_compat_step", 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0.5", 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "0.001", 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "0.999", 2024-04-24T23:59:50.119 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "aggressiveness of optimization", 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "end_time": { 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "end_time", 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "2359", 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "ending time of day to automatically balance", 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "end_weekday": { 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "end_weekday", 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "0", 2024-04-24T23:59:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "6", 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.125 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.126 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.126 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.126 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.126 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.126 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.126 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.126 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.126 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.126 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.127 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "min_score": { 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "min_score", 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.128 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: "mode": { 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mode", 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.129 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "upmap", 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-compat", 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "none", 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "read", 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "upmap", 2024-04-24T23:59:50.130 INFO:teuthology.orchestra.run.smithi096.stdout: "upmap-read" 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Balancer mode", 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_ids": { 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "pool_ids", 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.131 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:50.132 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.133 INFO:teuthology.orchestra.run.smithi096.stdout: "upmap_max_deviation": { 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "upmap_max_deviation", 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5", 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1", 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-24T23:59:50.134 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "upmap_max_optimizations": { 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "upmap_max_optimizations", 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.135 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cephadm", 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.136 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "agent_down_multiplier": { 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "agent_down_multiplier", 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "3.0", 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.137 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.138 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-24T23:59:50.138 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.138 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.138 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.138 INFO:teuthology.orchestra.run.smithi096.stdout: "agent_refresh_rate": { 2024-04-24T23:59:50.138 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "agent_refresh_rate", 2024-04-24T23:59:50.138 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.138 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "20", 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.139 INFO:teuthology.orchestra.run.smithi096.stdout: "agent_starting_port": { 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "agent_starting_port", 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "4721", 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_ptrace": { 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "allow_ptrace", 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.141 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "autotune_interval": { 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "autotune_interval", 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "autotune_memory_target_ratio": { 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "autotune_memory_target_ratio", 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0.7", 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.143 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "cephadm_log_destination": { 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cephadm_log_destination", 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.144 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: "file", 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: "file,syslog", 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: "syslog" 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: "cgroups_split": { 2024-04-24T23:59:50.145 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cgroups_split", 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.146 INFO:teuthology.orchestra.run.smithi096.stdout: "config_checks_enabled": { 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "config_checks_enabled", 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.147 INFO:teuthology.orchestra.run.smithi096.stdout: "config_dashboard": { 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "config_dashboard", 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.148 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_alertmanager": { 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_alertmanager", 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Prometheus container image", 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_base": { 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_base", 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Container image name, without the tag", 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.150 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_elasticsearch": { 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_elasticsearch", 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "elasticsearch container image", 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.151 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_grafana": { 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_grafana", 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Prometheus container image", 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.152 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_haproxy": { 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_haproxy", 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "HAproxy container image", 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_jaeger_agent": { 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_jaeger_agent", 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Jaeger agent container image", 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.154 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_jaeger_collector": { 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_jaeger_collector", 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Jaeger collector container image", 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.155 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_jaeger_query": { 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_jaeger_query", 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Jaeger query container image", 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.156 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_keepalived": { 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_keepalived", 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Keepalived container image", 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.157 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_loki": { 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_loki", 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Loki container image", 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.158 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_node_exporter": { 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_node_exporter", 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Prometheus container image", 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.159 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_nvmeof": { 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_nvmeof", 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Nvme-of container image", 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_prometheus": { 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_prometheus", 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Prometheus container image", 2024-04-24T23:59:50.161 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_promtail": { 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_promtail", 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.162 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Promtail container image", 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_samba": { 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_samba", 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.163 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Samba/SMB container image", 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image_snmp_gateway": { 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_image_snmp_gateway", 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.164 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "SNMP Gateway container image", 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "container_init": { 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "container_init", 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.165 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Run podman/docker with `--init`", 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "daemon_cache_timeout": { 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "daemon_cache_timeout", 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.166 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "default_cephadm_command_timeout": { 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "default_cephadm_command_timeout", 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "900", 2024-04-24T23:59:50.167 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: "default_registry": { 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "default_registry", 2024-04-24T23:59:50.168 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "docker.io", 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.169 INFO:teuthology.orchestra.run.smithi096.stdout: "device_cache_timeout": { 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "device_cache_timeout", 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "1800", 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "seconds to cache device inventory", 2024-04-24T23:59:50.170 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "device_enhanced_scan": { 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "device_enhanced_scan", 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.171 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: "facts_cache_timeout": { 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "facts_cache_timeout", 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.172 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "seconds to cache host facts data", 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "grafana_dashboards_path": { 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "grafana_dashboards_path", 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.173 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.174 INFO:teuthology.orchestra.run.smithi096.stdout: "host_check_interval": { 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "host_check_interval", 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to perform a host check", 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.175 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "hw_monitoring": { 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "hw_monitoring", 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.176 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: "inventory_list_all": { 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "inventory_list_all", 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.177 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.178 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.179 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: "log_refresh_metadata": { 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_refresh_metadata", 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.180 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.181 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.182 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.183 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.184 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.185 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "*", 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.186 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "max_count_per_host": { 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_count_per_host", 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "max number of daemons per service per host", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd_draining_count": { 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_osd_draining_count", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "migration_current": { 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "migration_current", 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "internal - do not modify", 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "mode": { 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mode", 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "root", 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "cephadm-package", 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "root" 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "mode for remote execution of cephadm", 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "oob_default_addr": { 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "oob_default_addr", 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "169.254.1.1", 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-24T23:59:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "prometheus_alerts_path": { 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "prometheus_alerts_path", 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.192 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "registry_insecure": { 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "registry_insecure", 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.193 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "registry_password": { 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "registry_password", 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.194 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "registry_url": { 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "registry_url", 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.195 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "registry_username": { 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "registry_username", 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.196 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "secure_monitoring_stack": { 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "secure_monitoring_stack", 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.197 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "service_discovery_port": { 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "service_discovery_port", 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8765", 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "cephadm service discovery port", 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "ssh_config_file": { 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ssh_config_file", 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.199 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "use_agent": { 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "use_agent", 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "use_repo_digest": { 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "use_repo_digest", 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_on_failed_host_check": { 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_on_failed_host_check", 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "raise a health warning if the host check fails", 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_on_stray_daemons": { 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_on_stray_daemons", 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.203 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_on_stray_hosts": { 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_on_stray_hosts", 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.204 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crash", 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.205 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.206 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.207 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.210 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "retain_interval": { 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "retain_interval", 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "31536000", 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.211 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_recent_interval": { 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_recent_interval", 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "1209600", 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-24T23:59:50.212 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "dashboard", 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.213 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "ALERTMANAGER_API_HOST": { 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.214 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-24T23:59:50.215 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "AUDIT_API_ENABLED": { 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "AUDIT_API_ENABLED", 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.216 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.217 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "ENABLE_BROWSABLE_API": { 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-24T23:59:50.218 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-24T23:59:50.219 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.220 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.221 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.222 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.223 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.224 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.225 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.226 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_API_PASSWORD": { 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.227 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "admin", 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.228 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_API_URL": { 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_API_URL", 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.229 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_API_USERNAME": { 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.230 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "admin", 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-24T23:59:50.231 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-24T23:59:50.232 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-24T23:59:50.233 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "PROMETHEUS_API_HOST": { 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.237 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.238 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.239 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.240 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.242 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.244 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_ENABLED": { 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.245 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.246 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.247 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8", 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.248 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "45", 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.249 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "RGW_API_ACCESS_KEY": { 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.250 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "admin", 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.251 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "RGW_API_SECRET_KEY": { 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.252 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "RGW_API_SSL_VERIFY": { 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.253 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.254 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:50.255 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5", 2024-04-24T23:59:50.256 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "cross_origin_url": { 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cross_origin_url", 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.257 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "crt_file": { 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "crt_file", 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.258 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "debug": { 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "debug", 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.259 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Enable/disable debug options", 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "jwt_token_ttl": { 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "jwt_token_ttl", 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "28800", 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.260 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "key_file": { 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "key_file", 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.261 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.262 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.263 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.264 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.265 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.266 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "motd": { 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "motd", 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.267 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "The message of the day", 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "redirect_resolve_ip_addr": { 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "redirect_resolve_ip_addr", 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.268 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "server_addr": { 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_addr", 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "::", 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.269 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "server_port": { 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_port", 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8080", 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.270 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "ssl": { 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ssl", 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.271 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "ssl_server_port": { 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ssl_server_port", 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8443", 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.272 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "standby_behaviour": { 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "standby_behaviour", 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "redirect", 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.273 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "redirect" 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "standby_error_status_code": { 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "standby_error_status_code", 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "500", 2024-04-24T23:59:50.274 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "400", 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "599", 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "url_prefix": { 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "url_prefix", 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.275 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "devicehealth", 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.276 INFO:teuthology.orchestra.run.smithi096.stdout: "enable_monitoring": { 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "enable_monitoring", 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "monitor device health metrics", 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.277 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.278 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.279 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.280 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.281 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "mark_out_threshold": { 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mark_out_threshold", 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "2419200", 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": { 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "pool_name", 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "device_health_metrics", 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-24T23:59:50.284 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "retention_period": { 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "retention_period", 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "15552000", 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how long to retain device health metrics", 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.285 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "scrape_frequency": { 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "scrape_frequency", 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "86400", 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-24T23:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "self_heal": { 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "self_heal", 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-24T23:59:50.287 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how frequently to wake up and check device health", 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.288 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "warn_threshold": { 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "warn_threshold", 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "7257600", 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.289 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "diskprediction_local", 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.290 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.291 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.292 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.293 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "predict_interval": { 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "predict_interval", 2024-04-24T23:59:50.295 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "86400", 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "predictor_model": { 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "predictor_model", 2024-04-24T23:59:50.296 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "prophetstor", 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:50.297 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "600", 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "influx", 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": false, 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "influxdb python module not found", 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "batch_size": { 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "batch_size", 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5000", 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "database": { 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "database", 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "ceph", 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": { 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "hostname", 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "InfluxDB server hostname", 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "30", 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "5", 2024-04-24T23:59:50.302 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.303 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.304 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.305 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.306 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.307 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "password": { 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "password", 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.308 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "password of InfluxDB server user", 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "port": { 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "port", 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "8086", 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "InfluxDB server port", 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "ssl": { 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "ssl", 2024-04-24T23:59:50.310 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "false", 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "threads": { 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "threads", 2024-04-24T23:59:50.311 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5", 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1", 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "32", 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "username": { 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "username", 2024-04-24T23:59:50.312 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "username of InfluxDB server user", 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "verify_ssl": { 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "verify_ssl", 2024-04-24T23:59:50.313 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "true", 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.314 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "insights", 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.315 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.316 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.317 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.318 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.319 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "iostat", 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.320 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.321 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.324 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "localpool", 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "failure_domain": { 2024-04-24T23:59:50.325 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "failure_domain", 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "host", 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "failure domain for any created local pool", 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.326 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.327 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.328 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.329 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.330 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": { 2024-04-24T23:59:50.331 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "min_size", 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "default min_size for any created local pool", 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "num_rep": { 2024-04-24T23:59:50.332 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "num_rep", 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "3", 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "default replica count for any created local pool", 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": { 2024-04-24T23:59:50.333 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "pg_num", 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "128", 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "default pg_num for any created local pool", 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.334 INFO:teuthology.orchestra.run.smithi096.stdout: "prefix": { 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "prefix", 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "name prefix for any created local pool", 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "subtree": { 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "subtree", 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "rack", 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.336 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mds_autoscaler", 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.337 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.338 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.339 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.340 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.341 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.342 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mirroring", 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.343 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.344 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.345 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.346 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.347 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.348 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "nfs", 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.349 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.351 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.352 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.353 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "orchestrator", 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.354 INFO:teuthology.orchestra.run.smithi096.stdout: "fail_fs": { 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "fail_fs", 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.355 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.356 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.357 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.358 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.359 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "orchestrator": { 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "orchestrator", 2024-04-24T23:59:50.360 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "cephadm", 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "rook", 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "test_orchestrator" 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Orchestrator backend", 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.361 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "osd_perf_query", 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.362 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.363 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.364 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.365 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.366 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "osd_support", 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.367 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.368 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.369 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.370 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.371 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.372 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "pg_autoscaler", 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.373 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.374 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.375 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.376 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.377 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.378 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "threshold": { 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "threshold", 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "3.0", 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1.0", 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "scaling threshold", 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.379 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "progress", 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_pg_recovery_event": { 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "allow_pg_recovery_event", 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.380 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "enabled": { 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "enabled", 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.381 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "max_completed_events": { 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_completed_events", 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "50", 2024-04-24T23:59:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "number of past completed events to remember", 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "sleep_interval": { 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "sleep_interval", 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "5", 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "how long the module is going to sleep", 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "prometheus", 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "cache": { 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cache", 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.390 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "exclude_perf_counters": { 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "exclude_perf_counters", 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.392 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.393 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.394 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.396 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_stats_pools": { 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rbd_stats_pools", 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.397 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "300", 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.398 INFO:teuthology.orchestra.run.smithi096.stdout: "scrape_interval": { 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "scrape_interval", 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "15.0", 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "server_addr": { 2024-04-24T23:59:50.399 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_addr", 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "::", 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "server_port": { 2024-04-24T23:59:50.400 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_port", 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "9283", 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "stale_cache_strategy": { 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "stale_cache_strategy", 2024-04-24T23:59:50.401 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "log", 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "standby_behaviour": { 2024-04-24T23:59:50.402 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "standby_behaviour", 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "default", 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "default", 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "error" 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.403 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "standby_error_status_code": { 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "standby_error_status_code", 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "500", 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "400", 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "599", 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.404 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rbd_support", 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.405 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.406 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.407 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.408 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.410 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "max_concurrent_snap_create": { 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_concurrent_snap_create", 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10", 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.411 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "mirror_snapshot_schedule": { 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mirror_snapshot_schedule", 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.412 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "trash_purge_schedule": { 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "trash_purge_schedule", 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.413 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "restful", 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "enable_auth": { 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "enable_auth", 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.414 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "key_file": { 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "key_file", 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.415 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.416 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.417 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.418 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.419 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.420 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "server_addr": { 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_addr", 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.421 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "server_port": { 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "server_port", 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.422 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rgw", 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.424 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.425 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.426 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.427 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.428 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rook", 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.429 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.430 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.431 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.433 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "storage_class": { 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "storage_class", 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "local", 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.434 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "selftest", 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.435 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.436 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.437 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.440 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "roption1": { 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "roption1", 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.441 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "roption2": { 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "roption2", 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "xyz", 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.442 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption1": { 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption1", 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.443 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption2": { 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption2", 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.444 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption3": { 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption3", 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "float", 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.445 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption4": { 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption4", 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.446 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption5": { 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption5", 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.447 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption6": { 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption6", 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.448 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "rwoption7": { 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rwoption7", 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "1", 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "42", 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.449 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "testkey": { 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "testkey", 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.450 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "testlkey": { 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "testlkey", 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.451 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "testnewline": { 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "testnewline", 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.452 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "snap_schedule", 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_m_granularity": { 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "allow_m_granularity", 2024-04-24T23:59:50.453 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "allow minute scheduled snapshots", 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "dump_on_update": { 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "dump_on_update", 2024-04-24T23:59:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "dump database to debug log on update", 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.459 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "stats", 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.461 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.462 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.463 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.464 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.465 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "status", 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.466 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.467 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.468 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.470 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "telegraf", 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "address": { 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "address", 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.472 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "15", 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.473 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.474 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.475 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.476 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.477 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.478 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "telemetry", 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.479 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_basic": { 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_basic", 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.480 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_crash": { 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_crash", 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_device": { 2024-04-24T23:59:50.481 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_device", 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_ident": { 2024-04-24T23:59:50.482 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_ident", 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "channel_perf": { 2024-04-24T23:59:50.483 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "channel_perf", 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "contact": { 2024-04-24T23:59:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "contact", 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "description": { 2024-04-24T23:59:50.485 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "description", 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "device_url": { 2024-04-24T23:59:50.486 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "device_url", 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "enabled": { 2024-04-24T23:59:50.487 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "enabled", 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:50.488 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "24", 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "8", 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "last_opt_revision": { 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "last_opt_revision", 2024-04-24T23:59:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "1", 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "leaderboard": { 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "leaderboard", 2024-04-24T23:59:50.490 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "leaderboard_description": { 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "leaderboard_description", 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.491 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.492 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.493 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.494 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.495 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.496 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "organization": { 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "organization", 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.497 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "proxy": { 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "proxy", 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.498 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "url": { 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "url", 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.499 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "test_orchestrator", 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.500 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.501 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.502 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.503 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.504 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "volumes", 2024-04-24T23:59:50.505 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.506 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.507 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.508 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.509 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "max_concurrent_clones": { 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "max_concurrent_clones", 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "4", 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "periodic_async_work": { 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "periodic_async_work", 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.512 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Periodically check for async work", 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "snapshot_clone_delay": { 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "snapshot_clone_delay", 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "0", 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-24T23:59:50.513 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "snapshot_clone_no_wait": { 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "snapshot_clone_no_wait", 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "True", 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.514 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "zabbix", 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "can_run": true, 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "error_string": "", 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "module_options": { 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "discovery_interval": { 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "discovery_interval", 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "uint", 2024-04-24T23:59:50.515 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "100", 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "identifier": { 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "identifier", 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.516 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "interval": { 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "interval", 2024-04-24T23:59:50.517 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "secs", 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "60", 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "log_level": { 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_level", 2024-04-24T23:59:50.518 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.519 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster": { 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster", 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.520 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_cluster_level": { 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_cluster_level", 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "info", 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [ 2024-04-24T23:59:50.521 INFO:teuthology.orchestra.run.smithi096.stdout: "", 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "critical", 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "debug", 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "error", 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "info", 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "warning" 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": { 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "log_to_file", 2024-04-24T23:59:50.522 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "bool", 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "False", 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.523 INFO:teuthology.orchestra.run.smithi096.stdout: "zabbix_host": { 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "zabbix_host", 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "", 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "zabbix_port": { 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "zabbix_port", 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "int", 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "10051", 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.525 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "zabbix_sender": { 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "zabbix_sender", 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "str", 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "level": "advanced", 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 0, 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "min": "", 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "max": "", 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "enum_allowed": [], 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "desc": "", 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "long_desc": "", 2024-04-24T23:59:50.526 INFO:teuthology.orchestra.run.smithi096.stdout: "tags": [], 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "see_also": [] 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "services": {}, 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "always_on_modules": { 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus": [ 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "balancer", 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "devicehealth", 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "orchestrator", 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscaler", 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "progress", 2024-04-24T23:59:50.527 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_support", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "status", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "telemetry", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "volumes" 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific": [ 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "balancer", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "devicehealth", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "orchestrator", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscaler", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "progress", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_support", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "status", 2024-04-24T23:59:50.528 INFO:teuthology.orchestra.run.smithi096.stdout: "telemetry", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "volumes" 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy": [ 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "balancer", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "devicehealth", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "orchestrator", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscaler", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "progress", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_support", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "status", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "telemetry", 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "volumes" 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.529 INFO:teuthology.orchestra.run.smithi096.stdout: "reef": [ 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "balancer", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "devicehealth", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "orchestrator", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscaler", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "progress", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_support", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "status", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "telemetry", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "volumes" 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "squid": [ 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "balancer", 2024-04-24T23:59:50.530 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "devicehealth", 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "orchestrator", 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscaler", 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "progress", 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_support", 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "status", 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "telemetry", 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "volumes" 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "last_failure_osd_epoch": 0, 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "active_clients": [ 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "devicehealth", 2024-04-24T23:59:50.531 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 4164771447 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "libcephsqlite", 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1144248579 2024-04-24T23:59:50.532 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "rbd_support", 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1924116012 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "volumes", 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2370784008 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "volumes", 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1412155072 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "volumes", 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 935003757 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "volumes", 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 4220705840 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-24T23:59:50.536 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f309006bfe0 msgr2=0x7f309006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f309006bfe0 0x7f309006e4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f309c034000 tx=0x7f309c02e000 comp rx=0 tx=0).stop 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00acda0 msgr2=0x7f30b015c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00acda0 0x7f30b015c790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b3e0 tx=0x7f30a400b8a0 comp rx=0 tx=0).stop 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 shutdown_connections 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30b015c230 0x7f30b015dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30b00af120 0x7f30b00b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f309006bfe0 0x7f309006e4a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 --2- 172.21.15.96:0/328924435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00acda0 0x7f30b015c790 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 >> 172.21.15.96:0/328924435 conn(0x7f30b00b19c0 msgr2=0x7f30b00af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 shutdown_connections 2024-04-24T23:59:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:49.645+0000 7f30b8000640 1 -- 172.21.15.96:0/328924435 wait complete. 2024-04-24T23:59:50.543 DEBUG:tasks.check_counter:Getting stats from y 2024-04-24T23:59:50.544 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.y.asok perf dump 2024-04-24T23:59:50.745 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:50.745 INFO:teuthology.orchestra.run.smithi096.stdout: "AsyncMessenger::Worker-0": { 2024-04-24T23:59:50.745 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_recv_messages": 255, 2024-04-24T23:59:50.745 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_messages": 129, 2024-04-24T23:59:50.745 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_recv_bytes": 3330288, 2024-04-24T23:59:50.745 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_bytes": 160579, 2024-04-24T23:59:50.745 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_created_connections": 71, 2024-04-24T23:59:50.745 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_active_connections": 16, 2024-04-24T23:59:50.745 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_total_time": 0.135862412, 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_send_time": 0.012835047, 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_recv_time": 0.119392930, 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_fast_dispatch_time": 0.000023499, 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_messages_queue_lat": { 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 108, 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.224273749, 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.002076608 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_handle_ack_lat": { 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 72, 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000024032, 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000333 2024-04-24T23:59:50.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_recv_encrypted_bytes": 3330288, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_encrypted_bytes": 160448 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "AsyncMessenger::Worker-1": { 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_recv_messages": 490, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_messages": 209, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_recv_bytes": 3969360, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_bytes": 59523, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_created_connections": 87, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_active_connections": 20, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_total_time": 0.176666515, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_send_time": 0.023574986, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_recv_time": 0.205791254, 2024-04-24T23:59:50.747 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_fast_dispatch_time": 0.000118915, 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_messages_queue_lat": { 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 194, 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.238991198, 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.001231913 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_handle_ack_lat": { 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 285, 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000067585, 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000237 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_recv_encrypted_bytes": 3969360, 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_encrypted_bytes": 59392 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.748 INFO:teuthology.orchestra.run.smithi096.stdout: "AsyncMessenger::Worker-2": { 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_recv_messages": 858, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_messages": 628, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_recv_bytes": 2720432, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_bytes": 7343592, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_created_connections": 181, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_active_connections": 20, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_total_time": 0.317305255, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_send_time": 0.084322893, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_recv_time": 0.250174591, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_running_fast_dispatch_time": 0.007820202, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_messages_queue_lat": { 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 614, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.296464814, 2024-04-24T23:59:50.749 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000482841 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_handle_ack_lat": { 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 142, 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000034300, 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000241 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_recv_encrypted_bytes": 2720432, 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "msgr_send_encrypted_bytes": 7343592 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "cct": { 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "total_workers": 0, 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "unhealthy_workers": 0 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.750 INFO:teuthology.orchestra.run.smithi096.stdout: "client": { 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "reply": { 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "lat": { 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "wrlat": { 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.751 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "rdlat": { 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "fsync": { 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mdavg": 0.000000000, 2024-04-24T23:59:50.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsqsum": 0, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mdops": 0, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "readavg": 0.000000000, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "readsqsum": 0, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "rdops": 0, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "writeavg": 0.000000000, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "writesqsum": 0, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "rdops": 0 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "client-0x5565ce1ca0a0": { 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "reply": { 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 53, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.128364721, 2024-04-24T23:59:50.753 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.002421975 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "lat": { 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 53, 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.128364721, 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.002421975 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "wrlat": { 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "rdlat": { 2024-04-24T23:59:50.754 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "fsync": { 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mdavg": 0.002421965, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsqsum": 452288995882171, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mdops": 53, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "readavg": 0.000000000, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "readsqsum": 0, 2024-04-24T23:59:50.755 INFO:teuthology.orchestra.run.smithi096.stdout: "rdops": 0, 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "writeavg": 0.000000000, 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "writesqsum": 0, 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "rdops": 0 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "client-0x5565ce1ca460": { 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "reply": { 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 68, 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 1.940187761, 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.028532172 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "lat": { 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 68, 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 1.940187761, 2024-04-24T23:59:50.756 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.028532172 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "wrlat": { 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 18, 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000506285, 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000028126 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "rdlat": { 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 18, 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000629577, 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000034976 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "fsync": { 2024-04-24T23:59:50.757 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 3, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.020700412, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.006900137 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mdavg": 0.028532158, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsqsum": 3022439595452155392, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mdops": 68, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "readavg": 0.000034972, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "readsqsum": 4154040679, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "rdops": 18, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "writeavg": 0.000028122, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "writesqsum": 4783254093, 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: "rdops": 18 2024-04-24T23:59:50.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "client-0x5565ce1cabe0": { 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "reply": { 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 22, 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 2.221354179, 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.100970644 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "lat": { 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 22, 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 2.221354179, 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.100970644 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "wrlat": { 2024-04-24T23:59:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "rdlat": { 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "fsync": { 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.760 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mdavg": 0.100970640, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsqsum": 4471519870771273216, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mdops": 22, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "readavg": 0.000000000, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "readsqsum": 0, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "rdops": 0, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "writeavg": 0.000000000, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "writesqsum": 0, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "rdops": 0 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-Mgr": { 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.761 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 2, 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.046740536, 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.023370268 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-MgrStandby": { 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.762 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-balancer": { 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-cmd_finisher": { 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 17, 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.001575157, 2024-04-24T23:59:50.763 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000092656 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-crash": { 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-devicehealth": { 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.764 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-iostat": { 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.765 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-nfs": { 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-orchestrator": { 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.766 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-pg_autoscaler": { 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-progress": { 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.767 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-rbd_support": { 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-restful": { 2024-04-24T23:59:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 18, 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.005855752, 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000325319 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-status": { 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-telemetry": { 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "finisher-volumes": { 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "queue_len": 0, 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "complete_latency": { 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 9, 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 2.049367485, 2024-04-24T23:59:50.770 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.227707498 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "libcephsqlite_striper": { 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "update_metadata": 8, 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "update_allocated": 2, 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "update_size": 6, 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "update_version": 8, 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "shrink": 0, 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "shrink_bytes": 0, 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "lock": 11, 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "unlock": 11 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.771 INFO:teuthology.orchestra.run.smithi096.stdout: "libcephsqlite_vfs": { 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "op_open": { 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 2, 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.250994424, 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.125497212 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "op_delete": { 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "op_access": { 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.772 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "op_fullpathname": { 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 1, 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "op_currenttime": { 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 4, 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_close": { 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.773 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_read": { 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 20, 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.027999380, 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.001399969 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_write": { 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 85, 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.012999712, 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000152937 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_truncate": { 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_sync": { 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 24, 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.215995202, 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.008999800 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_filesize": { 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 20, 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_lock": { 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 27, 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.060998643, 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.002259209 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_unlock": { 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 19, 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.045998978, 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.002420998 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_checkreservedlock": { 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 9, 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.776 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_filecontrol": { 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 26, 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_sectorsize": { 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "opf_devicecharacteristics": { 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 30, 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.777 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "mempool": { 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bloom_filter_bytes": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bloom_filter_items": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_alloc_bytes": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_alloc_items": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_data_bytes": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_data_items": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_onode_items": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_meta_items": 0, 2024-04-24T23:59:50.778 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_other_bytes": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_other_items": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_buffer_items": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_bytes": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_items": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_blob_bytes": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_blob_items": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_shared_blob_items": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_inline_bl_items": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_bytes": 0, 2024-04-24T23:59:50.779 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_items": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_txc_bytes": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_txc_items": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_writing_deferred_items": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_writing_bytes": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_writing_items": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_bytes": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_items": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_file_reader_bytes": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_file_reader_items": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_file_writer_bytes": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_file_writer_items": 0, 2024-04-24T23:59:50.780 INFO:teuthology.orchestra.run.smithi096.stdout: "buffer_anon_bytes": 1646180, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "buffer_anon_items": 337, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "buffer_meta_bytes": 1496, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "buffer_meta_items": 17, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_bytes": 0, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_items": 0, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mapbl_bytes": 0, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mapbl_items": 0, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pglog_bytes": 0, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pglog_items": 0, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_bytes": 49320, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_items": 809, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_mapping_bytes": 0, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_mapping_items": 0, 2024-04-24T23:59:50.781 INFO:teuthology.orchestra.run.smithi096.stdout: "pgmap_bytes": 75168, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "pgmap_items": 414, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_co_bytes": 0, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_co_items": 0, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "unittest_1_bytes": 0, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "unittest_1_items": 0, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "unittest_2_bytes": 0, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "unittest_2_items": 0 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_hit": 0, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_miss": 0 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.782 INFO:teuthology.orchestra.run.smithi096.stdout: "objectcacher-libcephfs": { 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_ops_hit": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_ops_miss": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_bytes_hit": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_bytes_miss": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "data_read": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "data_written": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "data_flushed": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "data_overwritten_while_flushing": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "write_ops_blocked": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "write_bytes_blocked": 0, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "write_time_blocked": 0.000000000 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "objectcacher-libcephfs-0x5565cd5cd5e0": { 2024-04-24T23:59:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_ops_hit": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_ops_miss": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_bytes_hit": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_bytes_miss": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "data_read": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "data_written": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "data_flushed": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "data_overwritten_while_flushing": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "write_ops_blocked": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "write_bytes_blocked": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "write_time_blocked": 0.000000000 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "objectcacher-libcephfs-0x5565ce1ca140": { 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_ops_hit": 0, 2024-04-24T23:59:50.784 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_ops_miss": 0, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_bytes_hit": 0, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_bytes_miss": 0, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "data_read": 0, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "data_written": 0, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "data_flushed": 0, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "data_overwritten_while_flushing": 0, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "write_ops_blocked": 0, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "write_bytes_blocked": 0, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "write_time_blocked": 0.000000000 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "objectcacher-libcephfs-0x5565ce1ca320": { 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_ops_hit": 9, 2024-04-24T23:59:50.785 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_ops_miss": 0, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_bytes_hit": 1233, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_bytes_miss": 0, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "data_read": 1233, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "data_written": 411, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "data_flushed": 411, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "data_overwritten_while_flushing": 0, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "write_ops_blocked": 0, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "write_bytes_blocked": 0, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "write_time_blocked": 0.000000000 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter": { 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "op_active": 0, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "op_laggy": 0, 2024-04-24T23:59:50.786 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send": 0, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send_bytes": 0, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "op_resend": 0, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "op_reply": 0, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "op_latency": { 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "op_inflight": 0, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "oplen_avg": { 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.787 INFO:teuthology.orchestra.run.smithi096.stdout: "op": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "op_r": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "op_w": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "op_rmw": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "op_pg": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_stat": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_create": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_read": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_write": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writefull": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writesame": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_append": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_zero": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_truncate": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_delete": 0, 2024-04-24T23:59:50.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_mapext": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_sparse_read": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_clonerange": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_getxattr": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_setxattr": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_cmpxattr": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_rmxattr": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_resetxattrs": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_call": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_watch": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_notify": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_src_cmpxattr": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls": 0, 2024-04-24T23:59:50.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls_filter": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_other": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_active": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_send": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_resend": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_ping": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_active": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_send": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_resend": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_active": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_send": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_resend": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_active": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_send": 0, 2024-04-24T23:59:50.790 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_resend": 0, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "command_active": 0, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "command_send": 8, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "command_resend": 0, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "map_epoch": 36, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "map_full": 0, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "map_inc": 35, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_sessions": 8, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_open": 8, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_close": 0, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_laggy": 0, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_wr": 0, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_rd": 0, 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_del": 0 2024-04-24T23:59:50.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter-0x5565cd32e140": { 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "op_active": 0, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "op_laggy": 0, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send": 0, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send_bytes": 0, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "op_resend": 0, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "op_reply": 0, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "op_latency": { 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.792 INFO:teuthology.orchestra.run.smithi096.stdout: "op_inflight": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "oplen_avg": { 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "op": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "op_r": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "op_w": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "op_rmw": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "op_pg": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_stat": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_create": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_read": 0, 2024-04-24T23:59:50.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_write": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writefull": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writesame": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_append": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_zero": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_truncate": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_delete": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_mapext": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_sparse_read": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_clonerange": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_getxattr": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_setxattr": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_cmpxattr": 0, 2024-04-24T23:59:50.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_rmxattr": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_resetxattrs": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_call": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_watch": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_notify": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_src_cmpxattr": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls_filter": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_other": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_active": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_send": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_resend": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_ping": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_active": 0, 2024-04-24T23:59:50.795 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_send": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_resend": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_active": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_send": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_resend": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_active": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_send": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_resend": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "command_active": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "command_send": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "command_resend": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "map_epoch": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "map_full": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "map_inc": 0, 2024-04-24T23:59:50.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_sessions": 0, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_open": 0, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_close": 0, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_laggy": 0, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_wr": 0, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_rd": 0, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_del": 0 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter-0x5565cd32eb40": { 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "op_active": 0, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "op_laggy": 0, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send": 163, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send_bytes": 2434716, 2024-04-24T23:59:50.797 INFO:teuthology.orchestra.run.smithi096.stdout: "op_resend": 0, 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "op_reply": 163, 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "op_latency": { 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 163, 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 1.361969749, 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.008355642 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "op_inflight": 0, 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "oplen_avg": { 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 163, 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 307 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "op": 163, 2024-04-24T23:59:50.798 INFO:teuthology.orchestra.run.smithi096.stdout: "op_r": 46, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "op_w": 117, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "op_rmw": 0, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "op_pg": 0, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_stat": 0, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_create": 2, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_read": 20, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_write": 85, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writefull": 0, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writesame": 0, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_append": 0, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_zero": 0, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_truncate": 0, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_delete": 0, 2024-04-24T23:59:50.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_mapext": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_sparse_read": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_clonerange": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_getxattr": 104, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_setxattr": 52, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_cmpxattr": 22, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_rmxattr": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_resetxattrs": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_call": 22, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_watch": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_notify": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_src_cmpxattr": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls_filter": 0, 2024-04-24T23:59:50.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_other": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_active": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_send": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_resend": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_ping": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_active": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_send": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_resend": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_active": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_send": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_resend": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_active": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_send": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_resend": 0, 2024-04-24T23:59:50.801 INFO:teuthology.orchestra.run.smithi096.stdout: "command_active": 0, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "command_send": 0, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "command_resend": 0, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "map_epoch": 16, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "map_full": 0, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "map_inc": 6, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_sessions": 1, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_open": 1, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_close": 0, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_laggy": 0, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_wr": 0, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_rd": 0, 2024-04-24T23:59:50.802 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_del": 0 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter-0x5565cd32f0e0": { 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "op_active": 0, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "op_laggy": 0, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send": 0, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send_bytes": 0, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "op_resend": 0, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "op_reply": 0, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "op_latency": { 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.803 INFO:teuthology.orchestra.run.smithi096.stdout: "op_inflight": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "oplen_avg": { 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "op": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "op_r": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "op_w": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "op_rmw": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "op_pg": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_stat": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_create": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_read": 0, 2024-04-24T23:59:50.804 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_write": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writefull": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writesame": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_append": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_zero": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_truncate": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_delete": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_mapext": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_sparse_read": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_clonerange": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_getxattr": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_setxattr": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_cmpxattr": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_rmxattr": 0, 2024-04-24T23:59:50.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_resetxattrs": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_call": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_watch": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_notify": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_src_cmpxattr": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls_filter": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_other": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_active": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_send": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_resend": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_ping": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_active": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_send": 0, 2024-04-24T23:59:50.806 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_resend": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_active": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_send": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_resend": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_active": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_send": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_resend": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "command_active": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "command_send": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "command_resend": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "map_epoch": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "map_full": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "map_inc": 0, 2024-04-24T23:59:50.807 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_sessions": 0, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_open": 0, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_close": 0, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_laggy": 0, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_wr": 0, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_rd": 0, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_del": 0 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter-0x5565cd5ccb40": { 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "op_active": 0, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "op_laggy": 0, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send": 1, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send_bytes": 39, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "op_resend": 0, 2024-04-24T23:59:50.808 INFO:teuthology.orchestra.run.smithi096.stdout: "op_reply": 1, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "op_latency": { 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 1, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.002999933, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.002999933 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "op_inflight": 0, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "oplen_avg": { 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 1, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 1 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "op": 1, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "op_r": 1, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "op_w": 0, 2024-04-24T23:59:50.809 INFO:teuthology.orchestra.run.smithi096.stdout: "op_rmw": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "op_pg": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_stat": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_create": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_read": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_write": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writefull": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writesame": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_append": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_zero": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_truncate": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_delete": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_mapext": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_sparse_read": 0, 2024-04-24T23:59:50.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_clonerange": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_getxattr": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_setxattr": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_cmpxattr": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_rmxattr": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_resetxattrs": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_call": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_watch": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_notify": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_src_cmpxattr": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls_filter": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_other": 1, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_active": 0, 2024-04-24T23:59:50.811 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_send": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_resend": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_ping": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_active": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_send": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_resend": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_active": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_send": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_resend": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_active": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_send": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_resend": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "command_active": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "command_send": 0, 2024-04-24T23:59:50.812 INFO:teuthology.orchestra.run.smithi096.stdout: "command_resend": 0, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "map_epoch": 0, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "map_full": 0, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "map_inc": 0, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_sessions": 1, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_open": 1, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_close": 0, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_laggy": 0, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_wr": 0, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_rd": 0, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_del": 0 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter-0x5565cd5cd7c0": { 2024-04-24T23:59:50.813 INFO:teuthology.orchestra.run.smithi096.stdout: "op_active": 0, 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "op_laggy": 0, 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send": 0, 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send_bytes": 0, 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "op_resend": 0, 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "op_reply": 0, 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "op_latency": { 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.814 INFO:teuthology.orchestra.run.smithi096.stdout: "op_inflight": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "oplen_avg": { 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "op": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "op_r": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "op_w": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "op_rmw": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "op_pg": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_stat": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_create": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_read": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_write": 0, 2024-04-24T23:59:50.815 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writefull": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writesame": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_append": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_zero": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_truncate": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_delete": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_mapext": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_sparse_read": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_clonerange": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_getxattr": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_setxattr": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_cmpxattr": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_rmxattr": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_resetxattrs": 0, 2024-04-24T23:59:50.816 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_call": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_watch": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_notify": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_src_cmpxattr": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls_filter": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_other": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_active": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_send": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_resend": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_ping": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_active": 0, 2024-04-24T23:59:50.817 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_send": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_resend": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_active": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_send": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_resend": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_active": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_send": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_resend": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "command_active": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "command_send": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "command_resend": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "map_epoch": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "map_full": 0, 2024-04-24T23:59:50.818 INFO:teuthology.orchestra.run.smithi096.stdout: "map_inc": 0, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_sessions": 0, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_open": 0, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_close": 0, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_laggy": 0, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_wr": 0, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_rd": 0, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_del": 0 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter-0x5565ce1ca3c0": { 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "op_active": 0, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "op_laggy": 0, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send": 3, 2024-04-24T23:59:50.819 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send_bytes": 411, 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "op_resend": 0, 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "op_reply": 3, 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "op_latency": { 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 3, 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.017999601, 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.005999867 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "op_inflight": 0, 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "oplen_avg": { 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 3, 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 3 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.820 INFO:teuthology.orchestra.run.smithi096.stdout: "op": 3, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "op_r": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "op_w": 3, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "op_rmw": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "op_pg": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_stat": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_create": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_read": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_write": 3, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writefull": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writesame": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_append": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_zero": 0, 2024-04-24T23:59:50.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_truncate": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_delete": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_mapext": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_sparse_read": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_clonerange": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_getxattr": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_setxattr": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_cmpxattr": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_rmxattr": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_resetxattrs": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_call": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_watch": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_notify": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_src_cmpxattr": 0, 2024-04-24T23:59:50.822 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls_filter": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_other": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_active": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_send": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_resend": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_ping": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_active": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_send": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_resend": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_active": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_send": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_resend": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_active": 0, 2024-04-24T23:59:50.823 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_send": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_resend": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "command_active": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "command_send": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "command_resend": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "map_epoch": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "map_full": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "map_inc": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_sessions": 2, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_open": 2, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_close": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_laggy": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_wr": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_rd": 0, 2024-04-24T23:59:50.824 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_del": 0 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter-0x5565ce1cab40": { 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "op_active": 0, 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "op_laggy": 0, 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send": 0, 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "op_send_bytes": 0, 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "op_resend": 0, 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "op_reply": 0, 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "op_latency": { 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "op_inflight": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "oplen_avg": { 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "op": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "op_r": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "op_w": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "op_rmw": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "op_pg": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_stat": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_create": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_read": 0, 2024-04-24T23:59:50.826 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_write": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writefull": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_writesame": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_append": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_zero": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_truncate": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_delete": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_mapext": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_sparse_read": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_clonerange": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_getxattr": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_setxattr": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_cmpxattr": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_rmxattr": 0, 2024-04-24T23:59:50.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_resetxattrs": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_call": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_watch": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_notify": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_src_cmpxattr": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_pgls_filter": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "osdop_other": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_active": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_send": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_resend": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_ping": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_active": 0, 2024-04-24T23:59:50.828 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_send": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "poolop_resend": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_active": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_send": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "poolstat_resend": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_active": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_send": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_resend": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "command_active": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "command_send": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "command_resend": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "map_epoch": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "map_full": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "map_inc": 0, 2024-04-24T23:59:50.829 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_sessions": 0, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_open": 0, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_session_close": 0, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_laggy": 0, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_wr": 0, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_rd": 0, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "omap_del": 0 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-mgr_client_bytes": { 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 134217728, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.830 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 67, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 171612, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 67, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 67, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 171612, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.831 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-mgr_client_messages": { 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 512, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 67, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 67, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 67, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 67, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 67, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.832 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-mgr_mds_bytes": { 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 134217728, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 102, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 827410, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 102, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.833 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 102, 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 827410, 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-mgr_mds_messsages": { 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 128, 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 102, 2024-04-24T23:59:50.834 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 102, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 102, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 102, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 102, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-mgr_mon_bytes": { 2024-04-24T23:59:50.835 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 134217728, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 78, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 508433, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 78, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 78, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 508433, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.836 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-mgr_mon_messsages": { 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 128, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 78, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 78, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 78, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.837 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 78, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 78, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-mgr_osd_bytes": { 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 536870912, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 432, 2024-04-24T23:59:50.838 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 5367956, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 432, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 432, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 5367956, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.839 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-mgr_osd_messsages": { 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 8192, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 432, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 432, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 432, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 432, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 432, 2024-04-24T23:59:50.840 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-msgr_dispatch_throttler-client": { 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 172, 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 66997, 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.841 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 172, 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 172, 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 66997, 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-msgr_dispatch_throttler-client-0x5565cd5cc780": { 2024-04-24T23:59:50.842 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 83, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 44150, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 83, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 83, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 44150, 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.843 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-msgr_dispatch_throttler-client-0x5565ce1caaa0": { 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 39, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 22005, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 39, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.844 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 39, 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 22005, 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 388, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 873376, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 388, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 388, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 873376, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.846 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-msgr_dispatch_throttler-mgr-0x5565ca539c20": { 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 679, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 6875411, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 679, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 679, 2024-04-24T23:59:50.847 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 6875411, 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 177, 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 543262, 2024-04-24T23:59:50.848 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 177, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 177, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 543262, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x5565cd32f180": { 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 11, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 500419, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 11, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 11, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 500419, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.850 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x5565cd5cc500": { 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 12, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 500443, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 12, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 12, 2024-04-24T23:59:50.851 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 500443, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x5565cd5ccd20": { 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 10, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 368214, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 10, 2024-04-24T23:59:50.852 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 10, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 368214, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_bytes": { 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.853 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_bytes-0x5565cd32ebe0": { 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 163, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 2433027, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 163, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 163, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 2433027, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.855 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_bytes-0x5565cd32fae0": { 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.856 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_bytes-0x5565cd32fea0": { 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_bytes-0x5565cd5cc5a0": { 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_bytes-0x5565cd5ccc80": { 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 1, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 1, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 1, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.860 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_bytes-0x5565ce1ca6e0": { 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 3, 2024-04-24T23:59:50.861 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 411, 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 3, 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 411, 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_bytes-0x5565ce1caa00": { 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 104857600, 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.862 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_ops": { 2024-04-24T23:59:50.863 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 1024, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.864 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_ops-0x5565cd32ec80": { 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 1024, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 163, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 163, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 163, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 163, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 163, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_ops-0x5565cd32ff40": { 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 1024, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_ops-0x5565cd5cc1e0": { 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 1024, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 1, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 1, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 1, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 1, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 1, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_ops-0x5565cd5cc640": { 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 1024, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_ops-0x5565cd5cc820": { 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 1024, 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_ops-0x5565ce1ca000": { 2024-04-24T23:59:50.871 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 1024, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.872 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "throttle-objecter_ops-0x5565ce1ca280": { 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "val": 0, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "max": 1024, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "get_started": 0, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "get": 0, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "get_sum": 0, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_fail": 0, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "get_or_fail_success": 0, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "take": 3, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "take_sum": 3, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "put": 3, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "put_sum": 3, 2024-04-24T23:59:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: "wait": { 2024-04-24T23:59:50.874 INFO:teuthology.orchestra.run.smithi096.stdout: "avgcount": 0, 2024-04-24T23:59:50.874 INFO:teuthology.orchestra.run.smithi096.stdout: "sum": 0.000000000, 2024-04-24T23:59:50.874 INFO:teuthology.orchestra.run.smithi096.stdout: "avgtime": 0.000000000 2024-04-24T23:59:50.874 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.874 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-24T23:59:50.874 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:50.876 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.complete_latency.avgcount=9 2024-04-24T23:59:50.876 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.queue_len=0 2024-04-24T23:59:50.876 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-24T23:59:50.886 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-24T23:59:50.886 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:59:50.886 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:50.943 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052731,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498000k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248996k,nr_inodes=812249,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498000k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:59:50.943 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-24T23:59:50.943 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:50.996 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052731,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498000k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248996k,nr_inodes=812249,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498000k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:59:50.996 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:59:50.996 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:51.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:59:51.054 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-24T23:59:51.054 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:59:51.110 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:59:51.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.110 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-24T23:59:51.168 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:59:51.168 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:59:51.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.169 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:59:51.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.256 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:59:51.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.327 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-04-24T23:59:51.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.455 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-24T23:59:51.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.500 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-04-24T23:59:51.615 INFO:teuthology.orchestra.run.smithi096.stderr:Cannot find device "ceph-brx" 2024-04-24T23:59:51.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:59:51.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.695 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-24T23:59:51.752 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-24T23:59:51.752 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-24T23:59:51.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.753 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:59:51.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.846 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-24T23:59:51.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:51.924 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-04-24T23:59:52.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:52.050 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-24T23:59:52.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:59:52.092 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-04-24T23:59:52.213 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-04-24T23:59:52.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:59:52.217 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T23:59:52.227 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T23:59:52.227 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:59:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.437+0000 7f6992a00640 1 Processor -- start 2024-04-24T23:59:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.437+0000 7f6992a00640 1 -- start start 2024-04-24T23:59:52.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.438+0000 7f6992a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f698c15c230 0x7f698c071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.438+0000 7f6992a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f698c0af120 0x7f698c06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6992a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698c160b20 con 0x7f698c0acda0 2024-04-24T23:59:52.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6992a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f698c15c610 con 0x7f698c0af120 2024-04-24T23:59:52.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6992a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f698c0ad230 con 0x7f698c15c230 2024-04-24T23:59:52.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6990a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f698c0af120 0x7f698c06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6990a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f698c0af120 0x7f698c06cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34614/0 (socket says 172.21.15.96:34614) 2024-04-24T23:59:52.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6990a00640 1 -- 172.21.15.96:0/3252572867 learned_addr learned my addr 172.21.15.96:0/3252572867 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f698be00640 1 --2- 172.21.15.96:0/3252572867 >> v2:172.21.15.155:3300/0 conn(0x7f698c15c230 0x7f698c071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6990a00640 1 -- 172.21.15.96:0/3252572867 >> v2:172.21.15.155:3300/0 conn(0x7f698c15c230 msgr2=0x7f698c071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6990a00640 1 --2- 172.21.15.96:0/3252572867 >> v2:172.21.15.155:3300/0 conn(0x7f698c15c230 0x7f698c071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6990a00640 1 -- 172.21.15.96:0/3252572867 >> v1:172.21.15.155:6789/0 conn(0x7f698c0acda0 legacy=0x7f698c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.439+0000 7f6990a00640 1 -- 172.21.15.96:0/3252572867 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c15fd60 con 0x7f698c0af120 2024-04-24T23:59:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.440+0000 7f6990a00640 1 --2- 172.21.15.96:0/3252572867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 0x7f698c06cb70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f698c06c070 tx=0x7f698402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef110fe15612c30b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:52.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f698aa00640 1 -- 172.21.15.96:0/3252572867 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984037070 con 0x7f698c0af120 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f698aa00640 1 -- 172.21.15.96:0/3252572867 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6984032440 con 0x7f698c0af120 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f698aa00640 1 -- 172.21.15.96:0/3252572867 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984032810 con 0x7f698c0af120 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f6992a00640 1 -- 172.21.15.96:0/3252572867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 msgr2=0x7f698c06cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f6992a00640 1 --2- 172.21.15.96:0/3252572867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 0x7f698c06cb70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f698c06c070 tx=0x7f698402a230 comp rx=0 tx=0).stop 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f6992a00640 1 -- 172.21.15.96:0/3252572867 shutdown_connections 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f6992a00640 1 --2- 172.21.15.96:0/3252572867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 0x7f698c06cb70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f6992a00640 1 --2- 172.21.15.96:0/3252572867 >> v2:172.21.15.155:3300/0 conn(0x7f698c15c230 0x7f698c071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f6992a00640 1 -- 172.21.15.96:0/3252572867 >> 172.21.15.96:0/3252572867 conn(0x7f698c0b19c0 msgr2=0x7f698c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.441+0000 7f6992a00640 1 -- 172.21.15.96:0/3252572867 shutdown_connections 2024-04-24T23:59:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.442+0000 7f6992a00640 1 -- 172.21.15.96:0/3252572867 wait complete. 2024-04-24T23:59:52.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.443+0000 7f6992a00640 1 Processor -- start 2024-04-24T23:59:52.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.444+0000 7f6992a00640 1 -- start start 2024-04-24T23:59:52.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6992a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f698c0acda0 0x7f698c153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6992a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 0x7f698c09c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6992a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f698c15c230 0x7f698c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6992a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f698c160600 con 0x7f698c0af120 2024-04-24T23:59:52.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6992a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f698c160320 con 0x7f698c0acda0 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6992a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f698c0ad4d0 con 0x7f698c15c230 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698b400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 0x7f698c09c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698b400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 0x7f698c09c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34616/0 (socket says 172.21.15.96:34616) 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698b400640 1 -- 172.21.15.96:0/1189455646 learned_addr learned my addr 172.21.15.96:0/1189455646 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698be00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f698c0acda0 0x7f698c153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6990a00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f698c15c230 0x7f698c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698b400640 1 -- 172.21.15.96:0/1189455646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f698c15c230 msgr2=0x7f698c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698b400640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f698c15c230 0x7f698c15a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698b400640 1 -- 172.21.15.96:0/1189455646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f698c0acda0 msgr2=0x7f698c153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698b400640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f698c0acda0 0x7f698c153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698b400640 1 -- 172.21.15.96:0/1189455646 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c09ce90 con 0x7f698c0af120 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698be00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f698c0acda0 0x7f698c153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f698b400640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 0x7f698c09c640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f697400c7a0 tx=0x7f697400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6983e00640 1 -- 172.21.15.96:0/1189455646 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6974017070 con 0x7f698c0af120 2024-04-24T23:59:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6983e00640 1 -- 172.21.15.96:0/1189455646 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6974003da0 con 0x7f698c0af120 2024-04-24T23:59:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6983e00640 1 -- 172.21.15.96:0/1189455646 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69740052b0 con 0x7f698c0af120 2024-04-24T23:59:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c09d170 con 0x7f698c0af120 2024-04-24T23:59:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.446+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c0b3240 con 0x7f698c0af120 2024-04-24T23:59:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.447+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698c069110 con 0x7f698c0af120 2024-04-24T23:59:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.448+0000 7f6983e00640 1 -- 172.21.15.96:0/1189455646 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f697401a070 con 0x7f698c0af120 2024-04-24T23:59:52.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.449+0000 7f6983e00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f696806bfe0 0x7f696806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.449+0000 7f6983e00640 1 -- 172.21.15.96:0/1189455646 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f697408a580 con 0x7f698c0af120 2024-04-24T23:59:52.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.450+0000 7f698be00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f696806bfe0 0x7f696806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.450+0000 7f698be00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f696806bfe0 0x7f696806e4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f697c006fd0 tx=0x7f697c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.454+0000 7f6983e00640 1 -- 172.21.15.96:0/1189455646 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6974058fa0 con 0x7f698c0af120 2024-04-24T23:59:52.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.649+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f698c09cb80 con 0x7f696806bfe0 2024-04-24T23:59:52.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.650+0000 7f6983e00640 1 -- 172.21.15.96:0/1189455646 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13487 (secure 0 0 0) 0x7f698c09cb80 con 0x7f696806bfe0 2024-04-24T23:59:52.651 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:52.651 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-24T23:59:52.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.652+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f696806bfe0 msgr2=0x7f696806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:52.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.652+0000 7f6992a00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f696806bfe0 0x7f696806e4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f697c006fd0 tx=0x7f697c008040 comp rx=0 tx=0).stop 2024-04-24T23:59:52.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.652+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 msgr2=0x7f698c09c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:52.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.652+0000 7f6992a00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 0x7f698c09c640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f697400c7a0 tx=0x7f697400cc60 comp rx=0 tx=0).stop 2024-04-24T23:59:52.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.653+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 shutdown_connections 2024-04-24T23:59:52.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.653+0000 7f6992a00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f698c15c230 0x7f698c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.653+0000 7f6992a00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f696806bfe0 0x7f696806e4a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.653+0000 7f6992a00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f698c0af120 0x7f698c09c640 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.653+0000 7f6992a00640 1 --2- 172.21.15.96:0/1189455646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f698c0acda0 0x7f698c153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.653+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 >> 172.21.15.96:0/1189455646 conn(0x7f698c0b19c0 msgr2=0x7f698c0cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:52.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.653+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 shutdown_connections 2024-04-24T23:59:52.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.653+0000 7f6992a00640 1 -- 172.21.15.96:0/1189455646 wait complete. 2024-04-24T23:59:52.672 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-04-24T23:59:52.333499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224768,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749952,"statfs":{"total":773094113280,"available":772863950848,"internally_reserved":0,"allocated":4530176,"data_stored":2496152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-143648,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-116,"num_write_kb":-192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002087"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-24T23:59:48.135496+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:59:48.135496+0000","last_peered":"2024-04-24T23:59:48.135496+0000","last_clean":"2024-04-24T23:59:48.135496+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:59:48.135496+0000","last_undegraded":"2024-04-24T23:59:48.135496+0000","last_fullsized":"2024-04-24T23:59:48.135496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:59:52.673 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:59:52.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.856+0000 7f78c5400640 1 Processor -- start 2024-04-24T23:59:52.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.856+0000 7f78c5400640 1 -- start start 2024-04-24T23:59:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.857+0000 7f78c5400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f78c015c230 0x7f78c0071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78c5400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c0160b20 con 0x7f78c00acda0 2024-04-24T23:59:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78c5400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c00ad230 con 0x7f78c00af120 2024-04-24T23:59:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78c5400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f78c015c610 con 0x7f78c015c230 2024-04-24T23:59:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78be800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f78c015c230 0x7f78c0071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78b7e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f78c00acda0 0x7f78c00aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51586/0 (socket says 172.21.15.96:51586) 2024-04-24T23:59:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78b7e00640 1 -- 172.21.15.96:0/2884315237 learned_addr learned my addr 172.21.15.96:0/2884315237 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78be800640 1 -- 172.21.15.96:0/2884315237 >> v1:172.21.15.155:6789/0 conn(0x7f78c00af120 legacy=0x7f78c006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78be800640 1 -- 172.21.15.96:0/2884315237 >> v1:172.21.15.96:6789/0 conn(0x7f78c00acda0 legacy=0x7f78c00aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78bde00640 1 -- 172.21.15.96:0/2884315237 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890956860 0 0) 0x7f78c0160b20 con 0x7f78c00acda0 2024-04-24T23:59:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.858+0000 7f78be800640 1 -- 172.21.15.96:0/2884315237 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c015fd60 con 0x7f78c015c230 2024-04-24T23:59:52.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.859+0000 7f78be800640 1 --2- 172.21.15.96:0/2884315237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 0x7f78c0071800 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f78b00097a0 tx=0x7f78b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f118ae2a5245e13a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:52.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.860+0000 7f78bde00640 1 -- 172.21.15.96:0/2884315237 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0037070 con 0x7f78c015c230 2024-04-24T23:59:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.860+0000 7f78bde00640 1 -- 172.21.15.96:0/2884315237 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b0032440 con 0x7f78c015c230 2024-04-24T23:59:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.860+0000 7f78bde00640 1 -- 172.21.15.96:0/2884315237 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0032810 con 0x7f78c015c230 2024-04-24T23:59:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.860+0000 7f78c5400640 1 -- 172.21.15.96:0/2884315237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 msgr2=0x7f78c0071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.860+0000 7f78c5400640 1 --2- 172.21.15.96:0/2884315237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 0x7f78c0071800 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f78b00097a0 tx=0x7f78b002a1e0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.860+0000 7f78c5400640 1 -- 172.21.15.96:0/2884315237 shutdown_connections 2024-04-24T23:59:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.860+0000 7f78c5400640 1 --2- 172.21.15.96:0/2884315237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 0x7f78c0071800 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.860+0000 7f78c5400640 1 -- 172.21.15.96:0/2884315237 >> 172.21.15.96:0/2884315237 conn(0x7f78c00b19c0 msgr2=0x7f78c00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.860+0000 7f78c5400640 1 -- 172.21.15.96:0/2884315237 shutdown_connections 2024-04-24T23:59:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.861+0000 7f78c5400640 1 -- 172.21.15.96:0/2884315237 wait complete. 2024-04-24T23:59:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.862+0000 7f78c5400640 1 Processor -- start 2024-04-24T23:59:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.862+0000 7f78c5400640 1 -- start start 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.863+0000 7f78c5400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c00acda0 0x7f78c014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.863+0000 7f78c5400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c00af120 0x7f78c00b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.863+0000 7f78c5400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 0x7f78c009b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.863+0000 7f78c5400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f78c0160600 con 0x7f78c015c230 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.863+0000 7f78c5400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f78c0160320 con 0x7f78c00af120 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.863+0000 7f78c5400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f78c00ad4d0 con 0x7f78c00acda0 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.863+0000 7f78bf200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 0x7f78c009b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78bf200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 0x7f78c009b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34642/0 (socket says 172.21.15.96:34642) 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78bf200640 1 -- 172.21.15.96:0/4172576479 learned_addr learned my addr 172.21.15.96:0/4172576479 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78b7e00640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c00af120 0x7f78c00b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78bf200640 1 -- 172.21.15.96:0/4172576479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c00acda0 msgr2=0x7f78c014b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78bf200640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c00acda0 0x7f78c014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78bf200640 1 -- 172.21.15.96:0/4172576479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c00af120 msgr2=0x7f78c00b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:52.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78bf200640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c00af120 0x7f78c00b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:52.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78bf200640 1 -- 172.21.15.96:0/4172576479 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c014bce0 con 0x7f78c015c230 2024-04-24T23:59:52.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78bf200640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 0x7f78c009b030 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c780 tx=0x7f78b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:52.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78b6a00640 1 -- 172.21.15.96:0/4172576479 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8017070 con 0x7f78c015c230 2024-04-24T23:59:52.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78b6a00640 1 -- 172.21.15.96:0/4172576479 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b8003da0 con 0x7f78c015c230 2024-04-24T23:59:52.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.864+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c00c94d0 con 0x7f78c015c230 2024-04-24T23:59:52.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.865+0000 7f78b6a00640 1 -- 172.21.15.96:0/4172576479 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b80052b0 con 0x7f78c015c230 2024-04-24T23:59:52.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.865+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c00c9d70 con 0x7f78c015c230 2024-04-24T23:59:52.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.866+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c0069110 con 0x7f78c015c230 2024-04-24T23:59:52.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.867+0000 7f78b6a00640 1 -- 172.21.15.96:0/4172576479 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f78b801a070 con 0x7f78c015c230 2024-04-24T23:59:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.868+0000 7f78b6a00640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789c06bfe0 0x7f789c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.868+0000 7f78b6a00640 1 -- 172.21.15.96:0/4172576479 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f78b808a480 con 0x7f78c015c230 2024-04-24T23:59:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.868+0000 7f78be800640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789c06bfe0 0x7f789c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.868+0000 7f78be800640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789c06bfe0 0x7f789c06e4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f78b0034000 tx=0x7f78b002c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:52.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:52.872+0000 7f78b6a00640 1 -- 172.21.15.96:0/4172576479 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f78c014bce0 con 0x7f78c015c230 2024-04-24T23:59:53.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.065+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78c0071330 con 0x7f789c06bfe0 2024-04-24T23:59:53.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.067+0000 7f78b6a00640 1 -- 172.21.15.96:0/4172576479 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13487 (secure 0 0 0) 0x7f78c0071330 con 0x7f789c06bfe0 2024-04-24T23:59:53.068 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:53.068 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-24T23:59:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789c06bfe0 msgr2=0x7f789c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789c06bfe0 0x7f789c06e4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f78b0034000 tx=0x7f78b002c000 comp rx=0 tx=0).stop 2024-04-24T23:59:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 msgr2=0x7f78c009b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 0x7f78c009b030 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c780 tx=0x7f78b800cc40 comp rx=0 tx=0).stop 2024-04-24T23:59:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 shutdown_connections 2024-04-24T23:59:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f789c06bfe0 0x7f789c06e4a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78c015c230 0x7f78c009b030 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c00af120 0x7f78c00b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 --2- 172.21.15.96:0/4172576479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c00acda0 0x7f78c014b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 >> 172.21.15.96:0/4172576479 conn(0x7f78c00b19c0 msgr2=0x7f78c00b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 shutdown_connections 2024-04-24T23:59:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.070+0000 7f78c5400640 1 -- 172.21.15.96:0/4172576479 wait complete. 2024-04-24T23:59:53.091 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-04-24T23:59:52.333499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224768,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749952,"statfs":{"total":773094113280,"available":772863950848,"internally_reserved":0,"allocated":4530176,"data_stored":2496152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-143648,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-116,"num_write_kb":-192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002087"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-24T23:59:48.135496+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:59:48.135496+0000","last_peered":"2024-04-24T23:59:48.135496+0000","last_clean":"2024-04-24T23:59:48.135496+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:59:48.135496+0000","last_undegraded":"2024-04-24T23:59:48.135496+0000","last_fullsized":"2024-04-24T23:59:48.135496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:59:53.092 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T23:59:53.092 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:59:53.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.294+0000 7fc24be00640 1 Processor -- start 2024-04-24T23:59:53.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.294+0000 7fc24be00640 1 -- start start 2024-04-24T23:59:53.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.295+0000 7fc24be00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc24c15f6b0 0x7fc24c0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.295+0000 7fc24be00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc24c0ccdf0 0x7fc24c070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.295+0000 7fc24be00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c15fa90 con 0x7fc24c0b4ec0 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.295+0000 7fc24be00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc24c0b4a30 con 0x7fc24c15f6b0 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.295+0000 7fc24be00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc24c0b3e20 con 0x7fc24c0ccdf0 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.296+0000 7fc24aa00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc24c15f6b0 0x7fc24c0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.296+0000 7fc24aa00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc24c15f6b0 0x7fc24c0ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34650/0 (socket says 172.21.15.96:34650) 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.296+0000 7fc24aa00640 1 -- 172.21.15.96:0/2082229994 learned_addr learned my addr 172.21.15.96:0/2082229994 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.296+0000 7fc24b400640 1 --2- 172.21.15.96:0/2082229994 >> v2:172.21.15.155:3300/0 conn(0x7fc24c0ccdf0 0x7fc24c070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.296+0000 7fc24aa00640 1 -- 172.21.15.96:0/2082229994 >> v2:172.21.15.155:3300/0 conn(0x7fc24c0ccdf0 msgr2=0x7fc24c070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.296+0000 7fc24aa00640 1 --2- 172.21.15.96:0/2082229994 >> v2:172.21.15.155:3300/0 conn(0x7fc24c0ccdf0 0x7fc24c070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.296+0000 7fc24aa00640 1 -- 172.21.15.96:0/2082229994 >> v1:172.21.15.155:6789/0 conn(0x7fc24c0b4ec0 legacy=0x7fc24c0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.296+0000 7fc24aa00640 1 -- 172.21.15.96:0/2082229994 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c0b4100 con 0x7fc24c15f6b0 2024-04-24T23:59:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.296+0000 7fc24b400640 1 --2- 172.21.15.96:0/2082229994 >> v2:172.21.15.155:3300/0 conn(0x7fc24c0ccdf0 0x7fc24c070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:53.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.297+0000 7fc24aa00640 1 --2- 172.21.15.96:0/2082229994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 0x7fc24c0ce5e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0d07a0 tx=0x7fc23c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a982b558e29a425 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:53.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.298+0000 7fc249600640 1 -- 172.21.15.96:0/2082229994 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c037070 con 0x7fc24c15f6b0 2024-04-24T23:59:53.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.298+0000 7fc249600640 1 -- 172.21.15.96:0/2082229994 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23c032440 con 0x7fc24c15f6b0 2024-04-24T23:59:53.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.298+0000 7fc249600640 1 -- 172.21.15.96:0/2082229994 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c032810 con 0x7fc24c15f6b0 2024-04-24T23:59:53.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.298+0000 7fc24be00640 1 -- 172.21.15.96:0/2082229994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 msgr2=0x7fc24c0ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.298+0000 7fc24be00640 1 --2- 172.21.15.96:0/2082229994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 0x7fc24c0ce5e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0d07a0 tx=0x7fc23c02a230 comp rx=0 tx=0).stop 2024-04-24T23:59:53.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.299+0000 7fc24be00640 1 -- 172.21.15.96:0/2082229994 shutdown_connections 2024-04-24T23:59:53.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.299+0000 7fc24be00640 1 --2- 172.21.15.96:0/2082229994 >> v2:172.21.15.155:3300/0 conn(0x7fc24c0ccdf0 0x7fc24c070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.299+0000 7fc24be00640 1 --2- 172.21.15.96:0/2082229994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 0x7fc24c0ce5e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.299+0000 7fc24be00640 1 -- 172.21.15.96:0/2082229994 >> 172.21.15.96:0/2082229994 conn(0x7fc24c0b1f10 msgr2=0x7fc24c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:53.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.299+0000 7fc24be00640 1 -- 172.21.15.96:0/2082229994 shutdown_connections 2024-04-24T23:59:53.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.299+0000 7fc24be00640 1 -- 172.21.15.96:0/2082229994 wait complete. 2024-04-24T23:59:53.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.300+0000 7fc24be00640 1 Processor -- start 2024-04-24T23:59:53.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.300+0000 7fc24be00640 1 -- start start 2024-04-24T23:59:53.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.301+0000 7fc24be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc24c0b4ec0 0x7fc24c153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.301+0000 7fc24be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc24c0ccdf0 0x7fc24c09ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.301+0000 7fc24be00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 0x7fc24c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.301+0000 7fc24be00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c0ceb20 con 0x7fc24c15f6b0 2024-04-24T23:59:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.301+0000 7fc24be00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c0b46c0 con 0x7fc24c0ccdf0 2024-04-24T23:59:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.301+0000 7fc24be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc24c0cf1c0 con 0x7fc24c0b4ec0 2024-04-24T23:59:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24b400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 0x7fc24c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24b400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 0x7fc24c06cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34658/0 (socket says 172.21.15.96:34658) 2024-04-24T23:59:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24b400640 1 -- 172.21.15.96:0/2553086530 learned_addr learned my addr 172.21.15.96:0/2553086530 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24a000640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc24c0ccdf0 0x7fc24c09ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24b400640 1 -- 172.21.15.96:0/2553086530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc24c0b4ec0 msgr2=0x7fc24c153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24aa00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc24c0b4ec0 0x7fc24c153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24b400640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc24c0b4ec0 0x7fc24c153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24b400640 1 -- 172.21.15.96:0/2553086530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc24c0ccdf0 msgr2=0x7fc24c09ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24b400640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc24c0ccdf0 0x7fc24c09ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24b400640 1 -- 172.21.15.96:0/2553086530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c0ca220 con 0x7fc24c15f6b0 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.302+0000 7fc24a000640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc24c0ccdf0 0x7fc24c09ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.303+0000 7fc24b400640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 0x7fc24c06cae0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc24400cea0 tx=0x7fc24400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.303+0000 7fc242a00640 1 -- 172.21.15.96:0/2553086530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244003b90 con 0x7fc24c15f6b0 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.303+0000 7fc242a00640 1 -- 172.21.15.96:0/2553086530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc244003d50 con 0x7fc24c15f6b0 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.303+0000 7fc242a00640 1 -- 172.21.15.96:0/2553086530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244004260 con 0x7fc24c15f6b0 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.303+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24c06d390 con 0x7fc24c15f6b0 2024-04-24T23:59:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.303+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24c06d020 con 0x7fc24c15f6b0 2024-04-24T23:59:53.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.304+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24c0756b0 con 0x7fc24c15f6b0 2024-04-24T23:59:53.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.305+0000 7fc242a00640 1 -- 172.21.15.96:0/2553086530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fc244004400 con 0x7fc24c15f6b0 2024-04-24T23:59:53.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.306+0000 7fc242a00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc22806bfe0 0x7fc22806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.306+0000 7fc242a00640 1 -- 172.21.15.96:0/2553086530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fc24408b8c0 con 0x7fc24c15f6b0 2024-04-24T23:59:53.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.306+0000 7fc24aa00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc22806bfe0 0x7fc22806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.307+0000 7fc24aa00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc22806bfe0 0x7fc22806e4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc23c034000 tx=0x7fc23c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:53.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.310+0000 7fc242a00640 1 -- 172.21.15.96:0/2553086530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc24c06d390 con 0x7fc24c15f6b0 2024-04-24T23:59:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.503+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc24c0cca60 con 0x7fc22806bfe0 2024-04-24T23:59:53.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.505+0000 7fc242a00640 1 -- 172.21.15.96:0/2553086530 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13487 (secure 0 0 0) 0x7fc24c0cca60 con 0x7fc22806bfe0 2024-04-24T23:59:53.504 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:53.504 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-24T23:59:53.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc22806bfe0 msgr2=0x7fc22806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc22806bfe0 0x7fc22806e4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc23c034000 tx=0x7fc23c02e000 comp rx=0 tx=0).stop 2024-04-24T23:59:53.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 msgr2=0x7fc24c06cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 0x7fc24c06cae0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc24400cea0 tx=0x7fc24400cf90 comp rx=0 tx=0).stop 2024-04-24T23:59:53.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 shutdown_connections 2024-04-24T23:59:53.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fc22806bfe0 0x7fc22806e4a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc24c15f6b0 0x7fc24c06cae0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc24c0ccdf0 0x7fc24c09ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 --2- 172.21.15.96:0/2553086530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc24c0b4ec0 0x7fc24c153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 >> 172.21.15.96:0/2553086530 conn(0x7fc24c0b1f10 msgr2=0x7fc24c160590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:53.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 shutdown_connections 2024-04-24T23:59:53.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.507+0000 7fc24be00640 1 -- 172.21.15.96:0/2553086530 wait complete. 2024-04-24T23:59:53.525 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-04-24T23:59:52.333499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224768,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749952,"statfs":{"total":773094113280,"available":772863950848,"internally_reserved":0,"allocated":4530176,"data_stored":2496152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-143648,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-116,"num_write_kb":-192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002087"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-24T23:59:48.135496+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:59:48.135496+0000","last_peered":"2024-04-24T23:59:48.135496+0000","last_clean":"2024-04-24T23:59:48.135496+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:59:48.135496+0000","last_undegraded":"2024-04-24T23:59:48.135496+0000","last_fullsized":"2024-04-24T23:59:48.135496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:59:53.526 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:59:53.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.714+0000 7fe17c400640 1 Processor -- start 2024-04-24T23:59:53.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.714+0000 7fe17c400640 1 -- start start 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.716+0000 7fe17c400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe174070df0 0x7fe17415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.716+0000 7fe17c400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe1740b2cc0 0x7fe1740b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.716+0000 7fe17c400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1740713d0 con 0x7fe17415b220 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.716+0000 7fe17c400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe1740aee00 con 0x7fe174070df0 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.716+0000 7fe17c400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe1740ae4d0 con 0x7fe1740b2cc0 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.716+0000 7fe179000640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe174070df0 0x7fe17415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.716+0000 7fe179a00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe17415b220 0x7fe17415ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51598/0 (socket says 172.21.15.96:51598) 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.716+0000 7fe179a00640 1 -- 172.21.15.96:0/318116293 learned_addr learned my addr 172.21.15.96:0/318116293 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.717+0000 7fe17a400640 1 --2- 172.21.15.96:0/318116293 >> v2:172.21.15.155:3300/0 conn(0x7fe1740b2cc0 0x7fe1740b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.717+0000 7fe179000640 1 -- 172.21.15.96:0/318116293 >> v2:172.21.15.155:3300/0 conn(0x7fe1740b2cc0 msgr2=0x7fe1740b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.717+0000 7fe179000640 1 --2- 172.21.15.96:0/318116293 >> v2:172.21.15.155:3300/0 conn(0x7fe1740b2cc0 0x7fe1740b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.717+0000 7fe179000640 1 -- 172.21.15.96:0/318116293 >> v1:172.21.15.96:6789/0 conn(0x7fe17415b220 legacy=0x7fe17415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.717+0000 7fe179000640 1 -- 172.21.15.96:0/318116293 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1740ae7b0 con 0x7fe174070df0 2024-04-24T23:59:53.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.717+0000 7fe173e00640 1 -- 172.21.15.96:0/318116293 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 257335859 0 0) 0x7fe1740713d0 con 0x7fe17415b220 2024-04-24T23:59:53.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.718+0000 7fe179000640 1 --2- 172.21.15.96:0/318116293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 0x7fe17415f380 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe174070d80 tx=0x7fe16002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927dd109ba58ecb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:53.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.718+0000 7fe173e00640 1 -- 172.21.15.96:0/318116293 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160037070 con 0x7fe174070df0 2024-04-24T23:59:53.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.718+0000 7fe173e00640 1 -- 172.21.15.96:0/318116293 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe160032440 con 0x7fe174070df0 2024-04-24T23:59:53.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.718+0000 7fe173e00640 1 -- 172.21.15.96:0/318116293 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160032810 con 0x7fe174070df0 2024-04-24T23:59:53.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.719+0000 7fe17c400640 1 -- 172.21.15.96:0/318116293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 msgr2=0x7fe17415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.719+0000 7fe17c400640 1 --2- 172.21.15.96:0/318116293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 0x7fe17415f380 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe174070d80 tx=0x7fe16002a1a0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.719+0000 7fe17c400640 1 -- 172.21.15.96:0/318116293 shutdown_connections 2024-04-24T23:59:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.719+0000 7fe17c400640 1 --2- 172.21.15.96:0/318116293 >> v2:172.21.15.155:3300/0 conn(0x7fe1740b2cc0 0x7fe1740b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.719+0000 7fe17c400640 1 --2- 172.21.15.96:0/318116293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 0x7fe17415f380 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.719+0000 7fe17c400640 1 -- 172.21.15.96:0/318116293 >> 172.21.15.96:0/318116293 conn(0x7fe1740b19c0 msgr2=0x7fe1740b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.719+0000 7fe17c400640 1 -- 172.21.15.96:0/318116293 shutdown_connections 2024-04-24T23:59:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.719+0000 7fe17c400640 1 -- 172.21.15.96:0/318116293 wait complete. 2024-04-24T23:59:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.720+0000 7fe17c400640 1 Processor -- start 2024-04-24T23:59:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.721+0000 7fe17c400640 1 -- start start 2024-04-24T23:59:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.721+0000 7fe17c400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 0x7fe1741497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.721+0000 7fe17c400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1740b2cc0 0x7fe17409c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.721+0000 7fe17c400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe17415b220 0x7fe174154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.721+0000 7fe17c400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe17406ed10 con 0x7fe174070df0 2024-04-24T23:59:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.721+0000 7fe17c400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe17406eb90 con 0x7fe17415b220 2024-04-24T23:59:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe17c400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe17415f8c0 con 0x7fe1740b2cc0 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe179a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 0x7fe1741497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe179a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 0x7fe1741497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34668/0 (socket says 172.21.15.96:34668) 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe179a00640 1 -- 172.21.15.96:0/2769669755 learned_addr learned my addr 172.21.15.96:0/2769669755 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe17a400640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe17415b220 0x7fe174154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe179a00640 1 -- 172.21.15.96:0/2769669755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1740b2cc0 msgr2=0x7fe17409c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe179a00640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1740b2cc0 0x7fe17409c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe179a00640 1 -- 172.21.15.96:0/2769669755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe17415b220 msgr2=0x7fe174154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe179a00640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe17415b220 0x7fe174154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.722+0000 7fe179a00640 1 -- 172.21.15.96:0/2769669755 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17415c000 con 0x7fe174070df0 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.723+0000 7fe179a00640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 0x7fe1741497f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c500 tx=0x7fe16800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.723+0000 7fe171600640 1 -- 172.21.15.96:0/2769669755 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168018070 con 0x7fe174070df0 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.723+0000 7fe171600640 1 -- 172.21.15.96:0/2769669755 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe168007560 con 0x7fe174070df0 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.723+0000 7fe171600640 1 -- 172.21.15.96:0/2769669755 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168004a20 con 0x7fe174070df0 2024-04-24T23:59:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.723+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17415c270 con 0x7fe174070df0 2024-04-24T23:59:53.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.723+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17409d350 con 0x7fe174070df0 2024-04-24T23:59:53.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.724+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe174069110 con 0x7fe174070df0 2024-04-24T23:59:53.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.725+0000 7fe171600640 1 -- 172.21.15.96:0/2769669755 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fe168004bc0 con 0x7fe174070df0 2024-04-24T23:59:53.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.726+0000 7fe171600640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe15406bfe0 0x7fe15406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:53.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.726+0000 7fe171600640 1 -- 172.21.15.96:0/2769669755 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fe16808a100 con 0x7fe174070df0 2024-04-24T23:59:53.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.726+0000 7fe179000640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe15406bfe0 0x7fe15406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:53.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.727+0000 7fe179000640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe15406bfe0 0x7fe15406e4a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe160034000 tx=0x7fe16002c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:53.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.730+0000 7fe171600640 1 -- 172.21.15.96:0/2769669755 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe168058b30 con 0x7fe174070df0 2024-04-24T23:59:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.929+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe17406e610 con 0x7fe174070df0 2024-04-24T23:59:53.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.931+0000 7fe171600640 1 -- 172.21.15.96:0/2769669755 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+12972 (secure 0 0 0) 0x7fe168058430 con 0x7fe174070df0 2024-04-24T23:59:53.930 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-24T23:59:53.930 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":36,"fsid":"c95ce1e9-7a69-4f8e-a964-bd4778092d3c","created":"2024-04-24T23:57:41.036539+0000","modified":"2024-04-24T23:59:47.159610+0000","last_up_change":"2024-04-24T23:57:53.589075+0000","last_in_change":"2024-04-24T23:57:44.483938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:57:54.373346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0389f3b-91ca-4e0e-b21d-9a9d38be69b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6817","nonce":4135409848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6819","nonce":4135409848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6823","nonce":4135409848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":4135409848},{"type":"v1","addr":"172.21.15.96:6821","nonce":4135409848}]},"public_addr":"172.21.15.96:6817/4135409848","cluster_addr":"172.21.15.96:6819/4135409848","heartbeat_back_addr":"172.21.15.96:6823/4135409848","heartbeat_front_addr":"172.21.15.96:6821/4135409848","state":["exists","up"]},{"osd":1,"uuid":"14f7d06f-d9bb-4285-8d4c-5c86de912529","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6801","nonce":940576727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6803","nonce":940576727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6807","nonce":940576727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":940576727},{"type":"v1","addr":"172.21.15.96:6805","nonce":940576727}]},"public_addr":"172.21.15.96:6801/940576727","cluster_addr":"172.21.15.96:6803/940576727","heartbeat_back_addr":"172.21.15.96:6807/940576727","heartbeat_front_addr":"172.21.15.96:6805/940576727","state":["exists","up"]},{"osd":2,"uuid":"9570a31b-f631-4603-b3a5-10672507eaec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6825","nonce":515371231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6827","nonce":515371231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6831","nonce":515371231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":515371231},{"type":"v1","addr":"172.21.15.96:6829","nonce":515371231}]},"public_addr":"172.21.15.96:6825/515371231","cluster_addr":"172.21.15.96:6827/515371231","heartbeat_back_addr":"172.21.15.96:6831/515371231","heartbeat_front_addr":"172.21.15.96:6829/515371231","state":["exists","up"]},{"osd":3,"uuid":"4a98e265-fd07-4543-a871-921ce673500b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6809","nonce":1162768165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6811","nonce":1162768165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6815","nonce":1162768165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1162768165},{"type":"v1","addr":"172.21.15.96:6813","nonce":1162768165}]},"public_addr":"172.21.15.96:6809/1162768165","cluster_addr":"172.21.15.96:6811/1162768165","heartbeat_back_addr":"172.21.15.96:6815/1162768165","heartbeat_front_addr":"172.21.15.96:6813/1162768165","state":["exists","up"]},{"osd":4,"uuid":"143d5098-bf88-4698-bdff-116597e598e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6801","nonce":810886372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6803","nonce":810886372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6807","nonce":810886372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":810886372},{"type":"v1","addr":"172.21.15.155:6805","nonce":810886372}]},"public_addr":"172.21.15.155:6801/810886372","cluster_addr":"172.21.15.155:6803/810886372","heartbeat_back_addr":"172.21.15.155:6807/810886372","heartbeat_front_addr":"172.21.15.155:6805/810886372","state":["exists","up"]},{"osd":5,"uuid":"6b9a01d2-7234-4d42-8062-1bf82c81aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6824","nonce":841571603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6827","nonce":841571603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6831","nonce":841571603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":841571603},{"type":"v1","addr":"172.21.15.155:6829","nonce":841571603}]},"public_addr":"172.21.15.155:6824/841571603","cluster_addr":"172.21.15.155:6827/841571603","heartbeat_back_addr":"172.21.15.155:6831/841571603","heartbeat_front_addr":"172.21.15.155:6829/841571603","state":["exists","up"]},{"osd":6,"uuid":"86918891-3b52-46fb-af9c-2e1b526e9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6809","nonce":2968414204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6811","nonce":2968414204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6815","nonce":2968414204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2968414204},{"type":"v1","addr":"172.21.15.155:6813","nonce":2968414204}]},"public_addr":"172.21.15.155:6809/2968414204","cluster_addr":"172.21.15.155:6811/2968414204","heartbeat_back_addr":"172.21.15.155:6815/2968414204","heartbeat_front_addr":"172.21.15.155:6813/2968414204","state":["exists","up"]},{"osd":7,"uuid":"ec46fd06-12ff-48dd-ac6b-2a65da5ec402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6817","nonce":654840370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6819","nonce":654840370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6825","nonce":654840370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":654840370},{"type":"v1","addr":"172.21.15.155:6822","nonce":654840370}]},"public_addr":"172.21.15.155:6817/654840370","cluster_addr":"172.21.15.155:6819/654840370","heartbeat_back_addr":"172.21.15.155:6825/654840370","heartbeat_front_addr":"172.21.15.155:6822/654840370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.920486+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:50.084807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.904639+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.847366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.798126+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.928798+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.864887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:57:49.884141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:6835/3672280349":"2024-04-25T23:59:44.060275+0000","172.21.15.96:6834/3672280349":"2024-04-25T23:59:44.060275+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:59:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.933+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe15406bfe0 msgr2=0x7fe15406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.933+0000 7fe17c400640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe15406bfe0 0x7fe15406e4a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe160034000 tx=0x7fe16002c000 comp rx=0 tx=0).stop 2024-04-24T23:59:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 msgr2=0x7fe1741497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 0x7fe1741497f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c500 tx=0x7fe16800c9c0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 shutdown_connections 2024-04-24T23:59:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe17415b220 0x7fe174154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1740b2cc0 0x7fe17409c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fe15406bfe0 0x7fe15406e4a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 --2- 172.21.15.96:0/2769669755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe174070df0 0x7fe1741497f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 >> 172.21.15.96:0/2769669755 conn(0x7fe1740b19c0 msgr2=0x7fe1740b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 shutdown_connections 2024-04-24T23:59:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:53.934+0000 7fe17c400640 1 -- 172.21.15.96:0/2769669755 wait complete. 2024-04-24T23:59:54.953 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T23:59:54.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:59:55.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.172+0000 7f7b99400640 1 Processor -- start 2024-04-24T23:59:55.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.172+0000 7f7b99400640 1 -- start start 2024-04-24T23:59:55.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.174+0000 7f7b99400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b94072470 0x7f7b940ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.174+0000 7f7b99400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b940cf0e0 0x7f7b940cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.174+0000 7f7b99400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b940cfa20 con 0x7f7b94072850 2024-04-24T23:59:55.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.174+0000 7f7b99400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7b940ccfa0 con 0x7f7b940cf0e0 2024-04-24T23:59:55.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.174+0000 7f7b99400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b940cdc00 con 0x7f7b94072470 2024-04-24T23:59:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.174+0000 7f7b98a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b940cf0e0 0x7f7b940cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.175+0000 7f7b98a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b940cf0e0 0x7f7b940cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34684/0 (socket says 172.21.15.96:34684) 2024-04-24T23:59:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.175+0000 7f7b98a00640 1 -- 172.21.15.96:0/1541921271 learned_addr learned my addr 172.21.15.96:0/1541921271 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.175+0000 7f7b93e00640 1 --2- 172.21.15.96:0/1541921271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b94072470 0x7f7b940ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.175+0000 7f7b98a00640 1 -- 172.21.15.96:0/1541921271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b94072470 msgr2=0x7f7b940ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:55.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.175+0000 7f7b98a00640 1 --2- 172.21.15.96:0/1541921271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b94072470 0x7f7b940ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.175+0000 7f7b98a00640 1 -- 172.21.15.96:0/1541921271 >> v1:172.21.15.155:6789/0 conn(0x7f7b94072850 legacy=0x7f7b940cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.175+0000 7f7b98a00640 1 -- 172.21.15.96:0/1541921271 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b940cdee0 con 0x7f7b940cf0e0 2024-04-24T23:59:55.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.176+0000 7f7b98a00640 1 --2- 172.21.15.96:0/1541921271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 0x7f7b940cf4e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009e50 tx=0x7f7b8c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4129bc57b172813b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.177+0000 7f7b93400640 1 -- 172.21.15.96:0/1541921271 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c036070 con 0x7f7b940cf0e0 2024-04-24T23:59:55.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.177+0000 7f7b93400640 1 -- 172.21.15.96:0/1541921271 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8c031600 con 0x7f7b940cf0e0 2024-04-24T23:59:55.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.177+0000 7f7b93400640 1 -- 172.21.15.96:0/1541921271 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0319d0 con 0x7f7b940cf0e0 2024-04-24T23:59:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.177+0000 7f7b99400640 1 -- 172.21.15.96:0/1541921271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 msgr2=0x7f7b940cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.177+0000 7f7b99400640 1 --2- 172.21.15.96:0/1541921271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 0x7f7b940cf4e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009e50 tx=0x7f7b8c02a710 comp rx=0 tx=0).stop 2024-04-24T23:59:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.177+0000 7f7b99400640 1 -- 172.21.15.96:0/1541921271 shutdown_connections 2024-04-24T23:59:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.177+0000 7f7b99400640 1 --2- 172.21.15.96:0/1541921271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 0x7f7b940cf4e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.177+0000 7f7b99400640 1 --2- 172.21.15.96:0/1541921271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b94072470 0x7f7b940ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.177+0000 7f7b99400640 1 -- 172.21.15.96:0/1541921271 >> 172.21.15.96:0/1541921271 conn(0x7f7b940b1f80 msgr2=0x7f7b940cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.178+0000 7f7b99400640 1 -- 172.21.15.96:0/1541921271 shutdown_connections 2024-04-24T23:59:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.178+0000 7f7b99400640 1 -- 172.21.15.96:0/1541921271 wait complete. 2024-04-24T23:59:55.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.179+0000 7f7b99400640 1 Processor -- start 2024-04-24T23:59:55.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.179+0000 7f7b99400640 1 -- start start 2024-04-24T23:59:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.180+0000 7f7b99400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b94072470 0x7f7b940ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.180+0000 7f7b99400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b94072850 0x7f7b9406b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.180+0000 7f7b99400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 0x7f7b94151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.180+0000 7f7b99400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7b940cccc0 con 0x7f7b940cf0e0 2024-04-24T23:59:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.180+0000 7f7b99400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b940ce4a0 con 0x7f7b94072850 2024-04-24T23:59:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.180+0000 7f7b99400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b9415d490 con 0x7f7b94072470 2024-04-24T23:59:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.181+0000 7f7b98a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 0x7f7b94151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.181+0000 7f7b98a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 0x7f7b94151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34698/0 (socket says 172.21.15.96:34698) 2024-04-24T23:59:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.181+0000 7f7b98a00640 1 -- 172.21.15.96:0/991432219 learned_addr learned my addr 172.21.15.96:0/991432219 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.181+0000 7f7b98a00640 1 -- 172.21.15.96:0/991432219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b94072470 msgr2=0x7f7b940ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.181+0000 7f7b98a00640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b94072470 0x7f7b940ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.181+0000 7f7b98a00640 1 -- 172.21.15.96:0/991432219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b94072850 msgr2=0x7f7b9406b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.181+0000 7f7b98a00640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b94072850 0x7f7b9406b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.181+0000 7f7b98a00640 1 -- 172.21.15.96:0/991432219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b941f7a00 con 0x7f7b940cf0e0 2024-04-24T23:59:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.181+0000 7f7b98a00640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 0x7f7b94151420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c034040 tx=0x7f7b8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.182+0000 7f7b90c00640 1 -- 172.21.15.96:0/991432219 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c036050 con 0x7f7b940cf0e0 2024-04-24T23:59:55.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.182+0000 7f7b90c00640 1 -- 172.21.15.96:0/991432219 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8c042070 con 0x7f7b940cf0e0 2024-04-24T23:59:55.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.182+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b941f7ce0 con 0x7f7b940cf0e0 2024-04-24T23:59:55.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.182+0000 7f7b90c00640 1 -- 172.21.15.96:0/991432219 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c009510 con 0x7f7b940cf0e0 2024-04-24T23:59:55.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.182+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b941f82a0 con 0x7f7b940cf0e0 2024-04-24T23:59:55.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.183+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b940756b0 con 0x7f7b940cf0e0 2024-04-24T23:59:55.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.184+0000 7f7b90c00640 1 -- 172.21.15.96:0/991432219 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f7b8c007c50 con 0x7f7b940cf0e0 2024-04-24T23:59:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.185+0000 7f7b90c00640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7b7006bfe0 0x7f7b7006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.185+0000 7f7b90c00640 1 -- 172.21.15.96:0/991432219 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f7b8c0abe50 con 0x7f7b940cf0e0 2024-04-24T23:59:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.185+0000 7f7b93e00640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7b7006bfe0 0x7f7b7006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.185+0000 7f7b90c00640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f7b70071ea0 0x7f7b700742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.185+0000 7f7b90c00640 1 -- 172.21.15.96:0/991432219 --> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b8c04ae80 con 0x7f7b70071ea0 2024-04-24T23:59:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.185+0000 7f7b90c00640 1 -- 172.21.15.96:0/991432219 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7b8c0ae470 con 0x7f7b940cf0e0 2024-04-24T23:59:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.185+0000 7f7b8be00640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f7b70071ea0 0x7f7b700742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.185+0000 7f7b93e00640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7b7006bfe0 0x7f7b7006e4a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b84006fd0 tx=0x7f7b84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.186+0000 7f7b8be00640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f7b70071ea0 0x7f7b700742c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.187+0000 7f7b90c00640 1 -- 172.21.15.96:0/991432219 <== osd.0 v2:172.21.15.96:6816/4135409848 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b8c04ae80 con 0x7f7b70071ea0 2024-04-24T23:59:55.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.201+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 --> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7b940c8fd0 con 0x7f7b70071ea0 2024-04-24T23:59:55.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.202+0000 7f7b90c00640 1 -- 172.21.15.96:0/991432219 <== osd.0 v2:172.21.15.96:6816/4135409848 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7b940c8fd0 con 0x7f7b70071ea0 2024-04-24T23:59:55.202 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:55.202 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:59:55.202 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:55.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.202+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f7b70071ea0 msgr2=0x7f7b700742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.202+0000 7f7b99400640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6816/4135409848,v1:172.21.15.96:6817/4135409848] conn(0x7f7b70071ea0 0x7f7b700742c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.202+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7b7006bfe0 msgr2=0x7f7b7006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.202+0000 7f7b99400640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f7b7006bfe0 0x7f7b7006e4a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b84006fd0 tx=0x7f7b84008040 comp rx=0 tx=0).stop 2024-04-24T23:59:55.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.202+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 msgr2=0x7f7b94151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.202+0000 7f7b99400640 1 --2- 172.21.15.96:0/991432219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b940cf0e0 0x7f7b94151420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c034040 tx=0x7f7b8c004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:55.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.203+0000 7f7b98a00640 1 -- 172.21.15.96:0/991432219 reap_dead start 2024-04-24T23:59:55.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.203+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 shutdown_connections 2024-04-24T23:59:55.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.203+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 >> 172.21.15.96:0/991432219 conn(0x7f7b940b1f80 msgr2=0x7f7b9415e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:55.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.203+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 shutdown_connections 2024-04-24T23:59:55.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.203+0000 7f7b99400640 1 -- 172.21.15.96:0/991432219 wait complete. 2024-04-24T23:59:55.222 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T23:59:55.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.416+0000 7f5d67a00640 1 Processor -- start 2024-04-24T23:59:55.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.417+0000 7f5d67a00640 1 -- start start 2024-04-24T23:59:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.418+0000 7f5d67a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5d60070df0 0x7f5d6015f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.418+0000 7f5d67a00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d600713d0 con 0x7f5d600b2cc0 2024-04-24T23:59:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.418+0000 7f5d67a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d600ae4d0 con 0x7f5d6015b220 2024-04-24T23:59:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.418+0000 7f5d67a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f5d600aee00 con 0x7f5d60070df0 2024-04-24T23:59:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.418+0000 7f5d65a00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5d600b2cc0 0x7f5d600b3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51606/0 (socket says 172.21.15.96:51606) 2024-04-24T23:59:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.418+0000 7f5d65a00640 1 -- 172.21.15.96:0/3185433321 learned_addr learned my addr 172.21.15.96:0/3185433321 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.418+0000 7f5d5fe00640 1 --2- 172.21.15.96:0/3185433321 >> v2:172.21.15.96:3300/0 conn(0x7f5d60070df0 0x7f5d6015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.419+0000 7f5d5fe00640 1 -- 172.21.15.96:0/3185433321 >> v1:172.21.15.155:6789/0 conn(0x7f5d6015b220 legacy=0x7f5d6015ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.419+0000 7f5d5fe00640 1 -- 172.21.15.96:0/3185433321 >> v1:172.21.15.96:6789/0 conn(0x7f5d600b2cc0 legacy=0x7f5d600b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.419+0000 7f5d5fe00640 1 -- 172.21.15.96:0/3185433321 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d600ae7b0 con 0x7f5d60070df0 2024-04-24T23:59:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.419+0000 7f5d5f400640 1 -- 172.21.15.96:0/3185433321 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537110810 0 0) 0x7f5d600713d0 con 0x7f5d600b2cc0 2024-04-24T23:59:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.420+0000 7f5d5fe00640 1 --2- 172.21.15.96:0/3185433321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60070df0 0x7f5d6015f380 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009d90 tx=0x7f5d5002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a56fdfc8135847 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.420+0000 7f5d5f400640 1 -- 172.21.15.96:0/3185433321 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50007740 con 0x7f5d60070df0 2024-04-24T23:59:55.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.420+0000 7f5d5f400640 1 -- 172.21.15.96:0/3185433321 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d500078e0 con 0x7f5d60070df0 2024-04-24T23:59:55.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.420+0000 7f5d5f400640 1 -- 172.21.15.96:0/3185433321 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50007cb0 con 0x7f5d60070df0 2024-04-24T23:59:55.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.421+0000 7f5d67a00640 1 -- 172.21.15.96:0/3185433321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60070df0 msgr2=0x7f5d6015f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.421+0000 7f5d67a00640 1 --2- 172.21.15.96:0/3185433321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60070df0 0x7f5d6015f380 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009d90 tx=0x7f5d5002a6a0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.421+0000 7f5d67a00640 1 -- 172.21.15.96:0/3185433321 shutdown_connections 2024-04-24T23:59:55.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.421+0000 7f5d67a00640 1 --2- 172.21.15.96:0/3185433321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60070df0 0x7f5d6015f380 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.421+0000 7f5d67a00640 1 -- 172.21.15.96:0/3185433321 >> 172.21.15.96:0/3185433321 conn(0x7f5d600b19c0 msgr2=0x7f5d600b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:55.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.421+0000 7f5d67a00640 1 -- 172.21.15.96:0/3185433321 shutdown_connections 2024-04-24T23:59:55.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.421+0000 7f5d67a00640 1 -- 172.21.15.96:0/3185433321 wait complete. 2024-04-24T23:59:55.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.423+0000 7f5d67a00640 1 Processor -- start 2024-04-24T23:59:55.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.423+0000 7f5d67a00640 1 -- start start 2024-04-24T23:59:55.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.424+0000 7f5d67a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d60070df0 0x7f5d601543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.424+0000 7f5d67a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d600b2cc0 0x7f5d6015e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.424+0000 7f5d67a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6015b220 0x7f5d601559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.424+0000 7f5d67a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6006ed10 con 0x7f5d6015b220 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.424+0000 7f5d67a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6006eb90 con 0x7f5d600b2cc0 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.424+0000 7f5d67a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6015f8c0 con 0x7f5d60070df0 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d65a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6015b220 0x7f5d601559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d65a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6015b220 0x7f5d601559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34718/0 (socket says 172.21.15.96:34718) 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d65a00640 1 -- 172.21.15.96:0/2767991503 learned_addr learned my addr 172.21.15.96:0/2767991503 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d5fe00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d600b2cc0 0x7f5d6015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d65000640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d60070df0 0x7f5d601543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d65a00640 1 -- 172.21.15.96:0/2767991503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d60070df0 msgr2=0x7f5d601543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d65a00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d60070df0 0x7f5d601543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d65a00640 1 -- 172.21.15.96:0/2767991503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d600b2cc0 msgr2=0x7f5d6015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d65a00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d600b2cc0 0x7f5d6015e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.425+0000 7f5d65a00640 1 -- 172.21.15.96:0/2767991503 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d601578a0 con 0x7f5d6015b220 2024-04-24T23:59:55.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.426+0000 7f5d65a00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6015b220 0x7f5d601559b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c3c0 tx=0x7f5d5800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.426+0000 7f5d5cc00640 1 -- 172.21.15.96:0/2767991503 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d580074e0 con 0x7f5d6015b220 2024-04-24T23:59:55.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.426+0000 7f5d5cc00640 1 -- 172.21.15.96:0/2767991503 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d580047e0 con 0x7f5d6015b220 2024-04-24T23:59:55.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.426+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d60154aa0 con 0x7f5d6015b220 2024-04-24T23:59:55.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.426+0000 7f5d5cc00640 1 -- 172.21.15.96:0/2767991503 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d58004c50 con 0x7f5d6015b220 2024-04-24T23:59:55.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.426+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6015b7c0 con 0x7f5d6015b220 2024-04-24T23:59:55.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.427+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d60069110 con 0x7f5d6015b220 2024-04-24T23:59:55.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.428+0000 7f5d5cc00640 1 -- 172.21.15.96:0/2767991503 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f5d58011070 con 0x7f5d6015b220 2024-04-24T23:59:55.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.429+0000 7f5d5cc00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5d3c06bfe0 0x7f5d3c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.429+0000 7f5d5cc00640 1 -- 172.21.15.96:0/2767991503 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f5d5808aa10 con 0x7f5d6015b220 2024-04-24T23:59:55.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.430+0000 7f5d65000640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5d3c06bfe0 0x7f5d3c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.430+0000 7f5d65000640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5d3c06bfe0 0x7f5d3c06e4a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5d48006fd0 tx=0x7f5d48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.433+0000 7f5d5cc00640 1 -- 172.21.15.96:0/2767991503 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5d5801a2b0 con 0x7f5d6015b220 2024-04-24T23:59:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.629+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5d60154fc0 con 0x7f5d3c06bfe0 2024-04-24T23:59:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.630+0000 7f5d5cc00640 1 -- 172.21.15.96:0/2767991503 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5d4800be30 con 0x7f5d3c06bfe0 2024-04-24T23:59:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T23:59:55.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5d3c06bfe0 msgr2=0x7f5d3c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5d3c06bfe0 0x7f5d3c06e4a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5d48006fd0 tx=0x7f5d48008040 comp rx=0 tx=0).stop 2024-04-24T23:59:55.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6015b220 msgr2=0x7f5d601559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6015b220 0x7f5d601559b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c3c0 tx=0x7f5d5800c880 comp rx=0 tx=0).stop 2024-04-24T23:59:55.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 shutdown_connections 2024-04-24T23:59:55.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5d3c06bfe0 0x7f5d3c06e4a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6015b220 0x7f5d601559b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d600b2cc0 0x7f5d6015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 --2- 172.21.15.96:0/2767991503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d60070df0 0x7f5d601543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 >> 172.21.15.96:0/2767991503 conn(0x7f5d600b19c0 msgr2=0x7f5d600b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:55.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 shutdown_connections 2024-04-24T23:59:55.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.633+0000 7f5d67a00640 1 -- 172.21.15.96:0/2767991503 wait complete. 2024-04-24T23:59:55.652 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T23:59:55.652 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:59:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.860+0000 7f8413200640 1 Processor -- start 2024-04-24T23:59:55.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.860+0000 7f8413200640 1 -- start start 2024-04-24T23:59:55.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.862+0000 7f8413200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 0x7f8414070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.862+0000 7f8413200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f84140d06b0 0x7f84140d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.862+0000 7f8413200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84140706c0 con 0x7f84140d2350 2024-04-24T23:59:55.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.862+0000 7f8413200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f84140cf7c0 con 0x7f84140d06b0 2024-04-24T23:59:55.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.862+0000 7f8413200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f84140d27c0 con 0x7f841415bfa0 2024-04-24T23:59:55.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.863+0000 7f8411400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f84140d06b0 0x7f84140d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.863+0000 7f8411e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 0x7f8414070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.863+0000 7f8411400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f84140d06b0 0x7f84140d1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.96:34952/0 (socket says 172.21.15.96:34952) 2024-04-24T23:59:55.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.863+0000 7f8411400640 1 -- 172.21.15.96:0/3664651649 learned_addr learned my addr 172.21.15.96:0/3664651649 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:55.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.863+0000 7f8411400640 1 -- 172.21.15.96:0/3664651649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 msgr2=0x7f8414070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:55.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.863+0000 7f8411400640 1 --2- 172.21.15.96:0/3664651649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 0x7f8414070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.863+0000 7f8411400640 1 -- 172.21.15.96:0/3664651649 >> v1:172.21.15.155:6789/0 conn(0x7f84140d2350 legacy=0x7f841415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.863+0000 7f8411400640 1 -- 172.21.15.96:0/3664651649 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84140709a0 con 0x7f84140d06b0 2024-04-24T23:59:55.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.865+0000 7f8411400640 1 --2- 172.21.15.96:0/3664651649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84140d06b0 0x7f84140d1e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8400009870 tx=0x7f840002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3034a8bce1ca9d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.865+0000 7f8410a00640 1 -- 172.21.15.96:0/3664651649 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400037070 con 0x7f84140d06b0 2024-04-24T23:59:55.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.865+0000 7f8410a00640 1 -- 172.21.15.96:0/3664651649 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8400032440 con 0x7f84140d06b0 2024-04-24T23:59:55.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.865+0000 7f8410a00640 1 -- 172.21.15.96:0/3664651649 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400032810 con 0x7f84140d06b0 2024-04-24T23:59:55.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.866+0000 7f8413200640 1 -- 172.21.15.96:0/3664651649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84140d06b0 msgr2=0x7f84140d1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.866+0000 7f8413200640 1 --2- 172.21.15.96:0/3664651649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84140d06b0 0x7f84140d1e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8400009870 tx=0x7f840002a270 comp rx=0 tx=0).stop 2024-04-24T23:59:55.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.866+0000 7f8413200640 1 -- 172.21.15.96:0/3664651649 shutdown_connections 2024-04-24T23:59:55.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.866+0000 7f8413200640 1 --2- 172.21.15.96:0/3664651649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84140d06b0 0x7f84140d1e10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.866+0000 7f8413200640 1 --2- 172.21.15.96:0/3664651649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 0x7f8414070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.866+0000 7f8413200640 1 -- 172.21.15.96:0/3664651649 >> 172.21.15.96:0/3664651649 conn(0x7f841409aa70 msgr2=0x7f841409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:55.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.866+0000 7f8413200640 1 -- 172.21.15.96:0/3664651649 shutdown_connections 2024-04-24T23:59:55.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.866+0000 7f8413200640 1 -- 172.21.15.96:0/3664651649 wait complete. 2024-04-24T23:59:55.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.868+0000 7f8413200640 1 Processor -- start 2024-04-24T23:59:55.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.868+0000 7f8413200640 1 -- start start 2024-04-24T23:59:55.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.869+0000 7f8413200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84140d06b0 0x7f84141564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.869+0000 7f8413200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84140d2350 0x7f84140cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.869+0000 7f8413200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 0x7f84140cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.869+0000 7f8413200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f84140aebd0 con 0x7f84140d06b0 2024-04-24T23:59:55.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.869+0000 7f8413200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8414070f60 con 0x7f84140d2350 2024-04-24T23:59:55.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.869+0000 7f8413200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f841415c380 con 0x7f841415bfa0 2024-04-24T23:59:55.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.869+0000 7f8411e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84140d06b0 0x7f84141564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84140d06b0 0x7f84141564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34720/0 (socket says 172.21.15.96:34720) 2024-04-24T23:59:55.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411e00640 1 -- 172.21.15.96:0/4145421350 learned_addr learned my addr 172.21.15.96:0/4145421350 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:55.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8412800640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 0x7f84140cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411400640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84140d2350 0x7f84140cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411e00640 1 -- 172.21.15.96:0/4145421350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 msgr2=0x7f84140cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411e00640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 0x7f84140cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411e00640 1 -- 172.21.15.96:0/4145421350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84140d2350 msgr2=0x7f84140cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411e00640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84140d2350 0x7f84140cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411e00640 1 -- 172.21.15.96:0/4145421350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84140cad20 con 0x7f84140d06b0 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8412800640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f841415bfa0 0x7f84140cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411400640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84140d2350 0x7f84140cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.870+0000 7f8411e00640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84140d06b0 0x7f84141564b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f840400efc0 tx=0x7f840400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.871+0000 7f840a000640 1 -- 172.21.15.96:0/4145421350 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404018020 con 0x7f84140d06b0 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.871+0000 7f840a000640 1 -- 172.21.15.96:0/4145421350 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8404014480 con 0x7f84140d06b0 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.871+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84140cb000 con 0x7f84140d06b0 2024-04-24T23:59:55.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.871+0000 7f840a000640 1 -- 172.21.15.96:0/4145421350 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404014850 con 0x7f84140d06b0 2024-04-24T23:59:55.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.871+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84140cb5c0 con 0x7f84140d06b0 2024-04-24T23:59:55.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.872+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84140756b0 con 0x7f84140d06b0 2024-04-24T23:59:55.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.873+0000 7f840a000640 1 -- 172.21.15.96:0/4145421350 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f8404005d10 con 0x7f84140d06b0 2024-04-24T23:59:55.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.874+0000 7f840a000640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f83f406bfe0 0x7f83f406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.874+0000 7f840a000640 1 -- 172.21.15.96:0/4145421350 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f840408bb00 con 0x7f84140d06b0 2024-04-24T23:59:55.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.874+0000 7f8411400640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f83f406bfe0 0x7f83f406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.874+0000 7f840a000640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7f83f4071ea0 0x7f83f40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:55.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.874+0000 7f840a000640 1 -- 172.21.15.96:0/4145421350 --> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83f4074970 con 0x7f83f4071ea0 2024-04-24T23:59:55.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.874+0000 7f840a000640 1 -- 172.21.15.96:0/4145421350 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f84040902a0 con 0x7f84140d06b0 2024-04-24T23:59:55.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.875+0000 7f8412800640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7f83f4071ea0 0x7f83f40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:55.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.875+0000 7f8411400640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f83f406bfe0 0x7f83f406e4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8400034000 tx=0x7f840002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.875+0000 7f8412800640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7f83f4071ea0 0x7f83f40742c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:55.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.876+0000 7f840a000640 1 -- 172.21.15.96:0/4145421350 <== osd.1 v2:172.21.15.96:6800/940576727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83f4074970 con 0x7f83f4071ea0 2024-04-24T23:59:55.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.891+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 --> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f841406cc80 con 0x7f83f4071ea0 2024-04-24T23:59:55.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.891+0000 7f840a000640 1 -- 172.21.15.96:0/4145421350 <== osd.1 v2:172.21.15.96:6800/940576727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f841406cc80 con 0x7f83f4071ea0 2024-04-24T23:59:55.894 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:55.894 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:59:55.895 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:55.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7f83f4071ea0 msgr2=0x7f83f40742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6800/940576727,v1:172.21.15.96:6801/940576727] conn(0x7f83f4071ea0 0x7f83f40742c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:55.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f83f406bfe0 msgr2=0x7f83f406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f83f406bfe0 0x7f83f406e4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8400034000 tx=0x7f840002e000 comp rx=0 tx=0).stop 2024-04-24T23:59:55.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84140d06b0 msgr2=0x7f84141564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:55.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 --2- 172.21.15.96:0/4145421350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84140d06b0 0x7f84141564b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f840400efc0 tx=0x7f840400c490 comp rx=0 tx=0).stop 2024-04-24T23:59:55.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8412800640 1 -- 172.21.15.96:0/4145421350 reap_dead start 2024-04-24T23:59:55.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 shutdown_connections 2024-04-24T23:59:55.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 >> 172.21.15.96:0/4145421350 conn(0x7f841409aa70 msgr2=0x7f84140cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:55.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 shutdown_connections 2024-04-24T23:59:55.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:55.892+0000 7f8413200640 1 -- 172.21.15.96:0/4145421350 wait complete. 2024-04-24T23:59:55.910 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T23:59:56.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.101+0000 7fd330c00640 1 Processor -- start 2024-04-24T23:59:56.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.102+0000 7fd330c00640 1 -- start start 2024-04-24T23:59:56.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.103+0000 7fd330c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd32c15c230 0x7fd32c071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.103+0000 7fd330c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32c0acda0 0x7fd32c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.103+0000 7fd330c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd32c0aef50 0x7fd32c0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.103+0000 7fd330c00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c15c610 con 0x7fd32c15c230 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.103+0000 7fd330c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c160b20 con 0x7fd32c0aef50 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.103+0000 7fd330c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c0ad200 con 0x7fd32c0acda0 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd329e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd32c15c230 0x7fd32c071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd329e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd32c15c230 0x7fd32c071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34722/0 (socket says 172.21.15.96:34722) 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd329e00640 1 -- 172.21.15.96:0/818137632 learned_addr learned my addr 172.21.15.96:0/818137632 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd32a800640 1 --2- 172.21.15.96:0/818137632 >> v2:172.21.15.155:3300/0 conn(0x7fd32c0aef50 0x7fd32c0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd321400640 1 --2- 172.21.15.96:0/818137632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32c0acda0 0x7fd32c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd329e00640 1 -- 172.21.15.96:0/818137632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32c0acda0 msgr2=0x7fd32c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd329e00640 1 --2- 172.21.15.96:0/818137632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32c0acda0 0x7fd32c0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd329e00640 1 -- 172.21.15.96:0/818137632 >> v2:172.21.15.155:3300/0 conn(0x7fd32c0aef50 msgr2=0x7fd32c0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd329e00640 1 --2- 172.21.15.96:0/818137632 >> v2:172.21.15.155:3300/0 conn(0x7fd32c0aef50 0x7fd32c0722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.104+0000 7fd329e00640 1 -- 172.21.15.96:0/818137632 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c15fd60 con 0x7fd32c15c230 2024-04-24T23:59:56.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.106+0000 7fd329e00640 1 --2- 172.21.15.96:0/818137632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c15c230 0x7fd32c071800 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0cc610 tx=0x7fd31c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f858e3ff4661773c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.106+0000 7fd329400640 1 -- 172.21.15.96:0/818137632 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c036070 con 0x7fd32c15c230 2024-04-24T23:59:56.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.106+0000 7fd329400640 1 -- 172.21.15.96:0/818137632 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31c031600 con 0x7fd32c15c230 2024-04-24T23:59:56.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.106+0000 7fd329400640 1 -- 172.21.15.96:0/818137632 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0319d0 con 0x7fd32c15c230 2024-04-24T23:59:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.107+0000 7fd330c00640 1 -- 172.21.15.96:0/818137632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c15c230 msgr2=0x7fd32c071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.107+0000 7fd330c00640 1 --2- 172.21.15.96:0/818137632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c15c230 0x7fd32c071800 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0cc610 tx=0x7fd31c02a6a0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.107+0000 7fd330c00640 1 -- 172.21.15.96:0/818137632 shutdown_connections 2024-04-24T23:59:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.107+0000 7fd330c00640 1 --2- 172.21.15.96:0/818137632 >> v2:172.21.15.155:3300/0 conn(0x7fd32c0aef50 0x7fd32c0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.107+0000 7fd330c00640 1 --2- 172.21.15.96:0/818137632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32c0acda0 0x7fd32c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.107+0000 7fd330c00640 1 --2- 172.21.15.96:0/818137632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c15c230 0x7fd32c071800 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.107+0000 7fd330c00640 1 -- 172.21.15.96:0/818137632 >> 172.21.15.96:0/818137632 conn(0x7fd32c0b19c0 msgr2=0x7fd32c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.107+0000 7fd330c00640 1 -- 172.21.15.96:0/818137632 shutdown_connections 2024-04-24T23:59:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.107+0000 7fd330c00640 1 -- 172.21.15.96:0/818137632 wait complete. 2024-04-24T23:59:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.109+0000 7fd330c00640 1 Processor -- start 2024-04-24T23:59:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.109+0000 7fd330c00640 1 -- start start 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.110+0000 7fd330c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c0acda0 0x7fd32c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.110+0000 7fd330c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd32c0aef50 0x7fd32c15d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.110+0000 7fd330c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32c15c230 0x7fd32c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.110+0000 7fd330c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c160600 con 0x7fd32c0acda0 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.110+0000 7fd330c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c160320 con 0x7fd32c0aef50 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.110+0000 7fd330c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c0af3e0 con 0x7fd32c15c230 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.110+0000 7fd329e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c0acda0 0x7fd32c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.110+0000 7fd329e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c0acda0 0x7fd32c15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34730/0 (socket says 172.21.15.96:34730) 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.110+0000 7fd329e00640 1 -- 172.21.15.96:0/2730817957 learned_addr learned my addr 172.21.15.96:0/2730817957 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd329e00640 1 -- 172.21.15.96:0/2730817957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32c15c230 msgr2=0x7fd32c1536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd329e00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32c15c230 0x7fd32c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd329e00640 1 -- 172.21.15.96:0/2730817957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd32c0aef50 msgr2=0x7fd32c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd329e00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd32c0aef50 0x7fd32c15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd329e00640 1 -- 172.21.15.96:0/2730817957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c0cde20 con 0x7fd32c0acda0 2024-04-24T23:59:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd329e00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c0acda0 0x7fd32c15efa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd31c034040 tx=0x7fd31c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd322a00640 1 -- 172.21.15.96:0/2730817957 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c03f020 con 0x7fd32c0acda0 2024-04-24T23:59:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd322a00640 1 -- 172.21.15.96:0/2730817957 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31c037040 con 0x7fd32c0acda0 2024-04-24T23:59:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c0cd860 con 0x7fd32c0acda0 2024-04-24T23:59:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.111+0000 7fd322a00640 1 -- 172.21.15.96:0/2730817957 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c036070 con 0x7fd32c0acda0 2024-04-24T23:59:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.112+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c15d270 con 0x7fd32c0acda0 2024-04-24T23:59:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.113+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c069110 con 0x7fd32c0acda0 2024-04-24T23:59:56.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.114+0000 7fd322a00640 1 -- 172.21.15.96:0/2730817957 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fd31c042020 con 0x7fd32c0acda0 2024-04-24T23:59:56.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.115+0000 7fd322a00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30806bfe0 0x7fd30806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.115+0000 7fd322a00640 1 -- 172.21.15.96:0/2730817957 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fd31c0ab540 con 0x7fd32c0acda0 2024-04-24T23:59:56.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.115+0000 7fd321400640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30806bfe0 0x7fd30806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.116+0000 7fd321400640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30806bfe0 0x7fd30806e4a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd32c06ddb0 tx=0x7fd314008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.120+0000 7fd322a00640 1 -- 172.21.15.96:0/2730817957 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd31c049030 con 0x7fd32c0acda0 2024-04-24T23:59:56.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.319+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd32c0729d0 con 0x7fd30806bfe0 2024-04-24T23:59:56.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.320+0000 7fd322a00640 1 -- 172.21.15.96:0/2730817957 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd32c0729d0 con 0x7fd30806bfe0 2024-04-24T23:59:56.320 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T23:59:56.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30806bfe0 msgr2=0x7fd30806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30806bfe0 0x7fd30806e4a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd32c06ddb0 tx=0x7fd314008040 comp rx=0 tx=0).stop 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c0acda0 msgr2=0x7fd32c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c0acda0 0x7fd32c15efa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd31c034040 tx=0x7fd31c004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 shutdown_connections 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32c15c230 0x7fd32c1536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd32c0aef50 0x7fd32c15d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd30806bfe0 0x7fd30806e4a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 --2- 172.21.15.96:0/2730817957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd32c0acda0 0x7fd32c15efa0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 >> 172.21.15.96:0/2730817957 conn(0x7fd32c0b19c0 msgr2=0x7fd32c15a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 shutdown_connections 2024-04-24T23:59:56.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.323+0000 7fd330c00640 1 -- 172.21.15.96:0/2730817957 wait complete. 2024-04-24T23:59:56.342 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T23:59:56.343 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:59:56.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.547+0000 7fef1f400640 1 Processor -- start 2024-04-24T23:59:56.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.548+0000 7fef1f400640 1 -- start start 2024-04-24T23:59:56.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.549+0000 7fef1f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180b33d0 0x7fef180b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.549+0000 7fef1f400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fef18072540 0x7fef1806d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.549+0000 7fef1f400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef18072f00 con 0x7fef18162690 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.549+0000 7fef1f400640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fef18072190 con 0x7fef18072540 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.549+0000 7fef1f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef18071bd0 con 0x7fef180b33d0 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.550+0000 7fef1d400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fef18072540 0x7fef1806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.550+0000 7fef1ca00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fef18162690 0x7fef180b2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51622/0 (socket says 172.21.15.96:51622) 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.550+0000 7fef1ca00640 1 -- 172.21.15.96:0/71641140 learned_addr learned my addr 172.21.15.96:0/71641140 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.550+0000 7fef17e00640 1 --2- 172.21.15.96:0/71641140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180b33d0 0x7fef180b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.550+0000 7fef17400640 1 -- 172.21.15.96:0/71641140 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818003087 0 0) 0x7fef18072f00 con 0x7fef18162690 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.550+0000 7fef1d400640 1 -- 172.21.15.96:0/71641140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180b33d0 msgr2=0x7fef180b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.550+0000 7fef1d400640 1 --2- 172.21.15.96:0/71641140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180b33d0 0x7fef180b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.550+0000 7fef1d400640 1 -- 172.21.15.96:0/71641140 >> v1:172.21.15.96:6789/0 conn(0x7fef18162690 legacy=0x7fef180b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.550+0000 7fef1d400640 1 -- 172.21.15.96:0/71641140 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef18071eb0 con 0x7fef18072540 2024-04-24T23:59:56.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.551+0000 7fef1d400640 1 --2- 172.21.15.96:0/71641140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18072540 0x7fef1806d250 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef1002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27300781e7ba5d13 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.552+0000 7fef17400640 1 -- 172.21.15.96:0/71641140 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10007740 con 0x7fef18072540 2024-04-24T23:59:56.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.552+0000 7fef17400640 1 -- 172.21.15.96:0/71641140 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef100078e0 con 0x7fef18072540 2024-04-24T23:59:56.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.552+0000 7fef17400640 1 -- 172.21.15.96:0/71641140 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10007cb0 con 0x7fef18072540 2024-04-24T23:59:56.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.552+0000 7fef1f400640 1 -- 172.21.15.96:0/71641140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18072540 msgr2=0x7fef1806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.552+0000 7fef1f400640 1 --2- 172.21.15.96:0/71641140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18072540 0x7fef1806d250 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef1002a660 comp rx=0 tx=0).stop 2024-04-24T23:59:56.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.553+0000 7fef1f400640 1 -- 172.21.15.96:0/71641140 shutdown_connections 2024-04-24T23:59:56.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.553+0000 7fef1f400640 1 --2- 172.21.15.96:0/71641140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18072540 0x7fef1806d250 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.553+0000 7fef1f400640 1 --2- 172.21.15.96:0/71641140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180b33d0 0x7fef180b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.553+0000 7fef1f400640 1 -- 172.21.15.96:0/71641140 >> 172.21.15.96:0/71641140 conn(0x7fef180b19c0 msgr2=0x7fef180b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:56.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.553+0000 7fef1f400640 1 -- 172.21.15.96:0/71641140 shutdown_connections 2024-04-24T23:59:56.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.553+0000 7fef1f400640 1 -- 172.21.15.96:0/71641140 wait complete. 2024-04-24T23:59:56.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.555+0000 7fef1f400640 1 Processor -- start 2024-04-24T23:59:56.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.555+0000 7fef1f400640 1 -- start start 2024-04-24T23:59:56.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.556+0000 7fef1f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef18072540 0x7fef181599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.556+0000 7fef1f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180b33d0 0x7fef1809b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.556+0000 7fef1f400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18162690 0x7fef18159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1f400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fef18162a70 con 0x7fef18162690 2024-04-24T23:59:56.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1f400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef1806d790 con 0x7fef18072540 2024-04-24T23:59:56.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef18165d30 con 0x7fef180b33d0 2024-04-24T23:59:56.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1d400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18162690 0x7fef18159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1d400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18162690 0x7fef18159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34750/0 (socket says 172.21.15.96:34750) 2024-04-24T23:59:56.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1d400640 1 -- 172.21.15.96:0/1871900471 learned_addr learned my addr 172.21.15.96:0/1871900471 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1ca00640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef18072540 0x7fef181599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef17e00640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180b33d0 0x7fef1809b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1d400640 1 -- 172.21.15.96:0/1871900471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180b33d0 msgr2=0x7fef1809b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1d400640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef180b33d0 0x7fef1809b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1d400640 1 -- 172.21.15.96:0/1871900471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef18072540 msgr2=0x7fef181599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1d400640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef18072540 0x7fef181599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.557+0000 7fef1d400640 1 -- 172.21.15.96:0/1871900471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1809be90 con 0x7fef18162690 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.558+0000 7fef1d400640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18162690 0x7fef18159320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.558+0000 7fef14c00640 1 -- 172.21.15.96:0/1871900471 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10040070 con 0x7fef18162690 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.558+0000 7fef14c00640 1 -- 172.21.15.96:0/1871900471 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef10031c40 con 0x7fef18162690 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.558+0000 7fef14c00640 1 -- 172.21.15.96:0/1871900471 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10009450 con 0x7fef18162690 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.558+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1809c170 con 0x7fef18162690 2024-04-24T23:59:56.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.558+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1815b200 con 0x7fef18162690 2024-04-24T23:59:56.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.559+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef18069110 con 0x7fef18162690 2024-04-24T23:59:56.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.560+0000 7fef14c00640 1 -- 172.21.15.96:0/1871900471 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fef10039040 con 0x7fef18162690 2024-04-24T23:59:56.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.561+0000 7fef14c00640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7feef806c010 0x7feef806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.561+0000 7fef14c00640 1 -- 172.21.15.96:0/1871900471 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fef100abdf0 con 0x7fef18162690 2024-04-24T23:59:56.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.562+0000 7fef1ca00640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7feef806c010 0x7feef806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.562+0000 7fef14c00640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7feef8071ed0 0x7feef80742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.562+0000 7fef14c00640 1 -- 172.21.15.96:0/1871900471 --> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef10046e50 con 0x7feef8071ed0 2024-04-24T23:59:56.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.562+0000 7fef14c00640 1 -- 172.21.15.96:0/1871900471 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fef100ae4d0 con 0x7fef18162690 2024-04-24T23:59:56.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.562+0000 7fef17e00640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7feef8071ed0 0x7feef80742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.562+0000 7fef1ca00640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7feef806c010 0x7feef806e4d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fef0c000f60 tx=0x7fef0c007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.563+0000 7fef17e00640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7feef8071ed0 0x7feef80742f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.564+0000 7fef14c00640 1 -- 172.21.15.96:0/1871900471 <== osd.2 v2:172.21.15.96:6824/515371231 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef10046e50 con 0x7feef8071ed0 2024-04-24T23:59:56.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.578+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 --> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fef180b4350 con 0x7feef8071ed0 2024-04-24T23:59:56.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef14c00640 1 -- 172.21.15.96:0/1871900471 <== osd.2 v2:172.21.15.96:6824/515371231 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fef180b4350 con 0x7feef8071ed0 2024-04-24T23:59:56.579 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:56.579 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:59:56.579 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:56.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7feef8071ed0 msgr2=0x7feef80742f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6824/515371231,v1:172.21.15.96:6825/515371231] conn(0x7feef8071ed0 0x7feef80742f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7feef806c010 msgr2=0x7feef806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7feef806c010 0x7feef806e4d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fef0c000f60 tx=0x7fef0c007c00 comp rx=0 tx=0).stop 2024-04-24T23:59:56.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18162690 msgr2=0x7fef18159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 --2- 172.21.15.96:0/1871900471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef18162690 0x7fef18159320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef10004a40 comp rx=0 tx=0).stop 2024-04-24T23:59:56.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1d400640 1 -- 172.21.15.96:0/1871900471 reap_dead start 2024-04-24T23:59:56.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 shutdown_connections 2024-04-24T23:59:56.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 >> 172.21.15.96:0/1871900471 conn(0x7fef180b19c0 msgr2=0x7fef180b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:56.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 shutdown_connections 2024-04-24T23:59:56.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.579+0000 7fef1f400640 1 -- 172.21.15.96:0/1871900471 wait complete. 2024-04-24T23:59:56.597 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T23:59:56.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.790+0000 7fefa3e00640 1 Processor -- start 2024-04-24T23:59:56.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.790+0000 7fefa3e00640 1 -- start start 2024-04-24T23:59:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa3e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fefa415e480 0x7fefa40cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa3e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fefa40b2be0 0x7fefa4072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa3e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa406cc10 con 0x7fefa40cc6e0 2024-04-24T23:59:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa3e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fefa4073060 con 0x7fefa415e480 2024-04-24T23:59:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa3e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fefa406cef0 con 0x7fefa40b2be0 2024-04-24T23:59:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa2a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fefa415e480 0x7fefa40cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa3400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fefa40cc6e0 0x7fefa406d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51634/0 (socket says 172.21.15.96:51634) 2024-04-24T23:59:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa3400640 1 -- 172.21.15.96:0/1080442811 learned_addr learned my addr 172.21.15.96:0/1080442811 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa2a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fefa415e480 0x7fefa40cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34766/0 (socket says 172.21.15.96:34766) 2024-04-24T23:59:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fef9a000640 1 --2- 172.21.15.96:0/1080442811 >> v2:172.21.15.155:3300/0 conn(0x7fefa40b2be0 0x7fefa4072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa2a00640 1 -- 172.21.15.96:0/1080442811 >> v2:172.21.15.155:3300/0 conn(0x7fefa40b2be0 msgr2=0x7fefa4072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa2a00640 1 --2- 172.21.15.96:0/1080442811 >> v2:172.21.15.155:3300/0 conn(0x7fefa40b2be0 0x7fefa4072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa2a00640 1 -- 172.21.15.96:0/1080442811 >> v1:172.21.15.96:6789/0 conn(0x7fefa40cc6e0 legacy=0x7fefa406d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.793+0000 7fefa2a00640 1 -- 172.21.15.96:0/1080442811 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa406d1d0 con 0x7fefa415e480 2024-04-24T23:59:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.793+0000 7fef9a000640 1 --2- 172.21.15.96:0/1080442811 >> v2:172.21.15.155:3300/0 conn(0x7fefa40b2be0 0x7fefa4072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.792+0000 7fefa2000640 1 -- 172.21.15.96:0/1080442811 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537186413 0 0) 0x7fefa406cc10 con 0x7fefa40cc6e0 2024-04-24T23:59:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.794+0000 7fefa2a00640 1 --2- 172.21.15.96:0/1080442811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa415e480 0x7fefa40cf670 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fefa406ed90 tx=0x7fef9402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e34b0171183591 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.794+0000 7fefa2000640 1 -- 172.21.15.96:0/1080442811 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94037070 con 0x7fefa415e480 2024-04-24T23:59:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.794+0000 7fefa2000640 1 -- 172.21.15.96:0/1080442811 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef94032440 con 0x7fefa415e480 2024-04-24T23:59:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.794+0000 7fefa2000640 1 -- 172.21.15.96:0/1080442811 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9402ae60 con 0x7fefa415e480 2024-04-24T23:59:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.794+0000 7fefa3e00640 1 -- 172.21.15.96:0/1080442811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa415e480 msgr2=0x7fefa40cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.794+0000 7fefa3e00640 1 --2- 172.21.15.96:0/1080442811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa415e480 0x7fefa40cf670 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fefa406ed90 tx=0x7fef9402a110 comp rx=0 tx=0).stop 2024-04-24T23:59:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.795+0000 7fefa3e00640 1 -- 172.21.15.96:0/1080442811 shutdown_connections 2024-04-24T23:59:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.795+0000 7fefa3e00640 1 --2- 172.21.15.96:0/1080442811 >> v2:172.21.15.155:3300/0 conn(0x7fefa40b2be0 0x7fefa4072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.795+0000 7fefa3e00640 1 --2- 172.21.15.96:0/1080442811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa415e480 0x7fefa40cf670 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.795+0000 7fefa3e00640 1 -- 172.21.15.96:0/1080442811 >> 172.21.15.96:0/1080442811 conn(0x7fefa40b1f10 msgr2=0x7fefa40cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.795+0000 7fefa3e00640 1 -- 172.21.15.96:0/1080442811 shutdown_connections 2024-04-24T23:59:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.795+0000 7fefa3e00640 1 -- 172.21.15.96:0/1080442811 wait complete. 2024-04-24T23:59:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.796+0000 7fefa3e00640 1 Processor -- start 2024-04-24T23:59:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.797+0000 7fefa3e00640 1 -- start start 2024-04-24T23:59:56.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.797+0000 7fefa3e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa40b2be0 0x7fefa41f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.797+0000 7fefa3e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40cc6e0 0x7fefa41f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fefa3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa415e480 0x7fefa41609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fefa3e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fefa40ccb50 con 0x7fefa40cc6e0 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fefa3e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fefa4072d50 con 0x7fefa40b2be0 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fefa3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fefa40cccd0 con 0x7fefa415e480 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fef9a000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40cc6e0 0x7fefa41f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fef9a000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40cc6e0 0x7fefa41f0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34780/0 (socket says 172.21.15.96:34780) 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fef9a000640 1 -- 172.21.15.96:0/3833967973 learned_addr learned my addr 172.21.15.96:0/3833967973 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fefa2a00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa40b2be0 0x7fefa41f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fef9a000640 1 -- 172.21.15.96:0/3833967973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa415e480 msgr2=0x7fefa41609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fefa3400640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa415e480 0x7fefa41609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fef9a000640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa415e480 0x7fefa41609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fef9a000640 1 -- 172.21.15.96:0/3833967973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa40b2be0 msgr2=0x7fefa41f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fef9a000640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa40b2be0 0x7fefa41f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.798+0000 7fef9a000640 1 -- 172.21.15.96:0/3833967973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa415fe30 con 0x7fefa40cc6e0 2024-04-24T23:59:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.799+0000 7fef9a000640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40cc6e0 0x7fefa41f0e80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00c7f0 tx=0x7fef8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.799+0000 7fef9be00640 1 -- 172.21.15.96:0/3833967973 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c004230 con 0x7fefa40cc6e0 2024-04-24T23:59:56.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.799+0000 7fef9be00640 1 -- 172.21.15.96:0/3833967973 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8c0043d0 con 0x7fefa40cc6e0 2024-04-24T23:59:56.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.799+0000 7fef9be00640 1 -- 172.21.15.96:0/3833967973 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c007a70 con 0x7fefa40cc6e0 2024-04-24T23:59:56.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.799+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa41f4970 con 0x7fefa40cc6e0 2024-04-24T23:59:56.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.799+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa415ed90 con 0x7fefa40cc6e0 2024-04-24T23:59:56.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.800+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa4067e40 con 0x7fefa40cc6e0 2024-04-24T23:59:56.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.801+0000 7fef9be00640 1 -- 172.21.15.96:0/3833967973 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fef8c007c10 con 0x7fefa40cc6e0 2024-04-24T23:59:56.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.802+0000 7fef9be00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fef8006bfe0 0x7fef8006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:56.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.802+0000 7fef9be00640 1 -- 172.21.15.96:0/3833967973 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fef8c08aff0 con 0x7fefa40cc6e0 2024-04-24T23:59:56.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.803+0000 7fefa2a00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fef8006bfe0 0x7fef8006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:56.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.803+0000 7fefa2a00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fef8006bfe0 0x7fef8006e4a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef94034000 tx=0x7fef9402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:56.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:56.807+0000 7fef9be00640 1 -- 172.21.15.96:0/3833967973 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fef8c015020 con 0x7fefa40cc6e0 2024-04-24T23:59:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.006+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fefa40756b0 con 0x7fef8006bfe0 2024-04-24T23:59:57.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.007+0000 7fef9be00640 1 -- 172.21.15.96:0/3833967973 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fefa40756b0 con 0x7fef8006bfe0 2024-04-24T23:59:57.008 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T23:59:57.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fef8006bfe0 msgr2=0x7fef8006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fef8006bfe0 0x7fef8006e4a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef94034000 tx=0x7fef9402e000 comp rx=0 tx=0).stop 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40cc6e0 msgr2=0x7fefa41f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40cc6e0 0x7fefa41f0e80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00c7f0 tx=0x7fef8c00ccb0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 shutdown_connections 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa415e480 0x7fefa41609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fef8006bfe0 0x7fef8006e4a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40cc6e0 0x7fefa41f0e80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 --2- 172.21.15.96:0/3833967973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa40b2be0 0x7fefa41f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 >> 172.21.15.96:0/3833967973 conn(0x7fefa40b1f10 msgr2=0x7fefa40af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 shutdown_connections 2024-04-24T23:59:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.010+0000 7fefa3e00640 1 -- 172.21.15.96:0/3833967973 wait complete. 2024-04-24T23:59:57.030 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T23:59:57.030 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:59:57.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.232+0000 7f25b9e00640 1 Processor -- start 2024-04-24T23:59:57.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.233+0000 7f25b9e00640 1 -- start start 2024-04-24T23:59:57.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.234+0000 7f25b9e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f25b40cf100 0x7f25b40cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.234+0000 7f25b9e00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f25b40b4c80 0x7f25b40acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.234+0000 7f25b9e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25b40b43a0 con 0x7f25b415fcf0 2024-04-24T23:59:57.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.234+0000 7f25b9e00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f25b415d420 con 0x7f25b40b4c80 2024-04-24T23:59:57.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.234+0000 7f25b9e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f25b40cfa20 con 0x7f25b40cf100 2024-04-24T23:59:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.235+0000 7f25abe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f25b40b4c80 0x7f25b40acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.235+0000 7f25abe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f25b40b4c80 0x7f25b40acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58016/0 (socket says 172.21.15.96:58016) 2024-04-24T23:59:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.235+0000 7f25abe00640 1 -- 172.21.15.96:0/3342307345 learned_addr learned my addr 172.21.15.96:0/3342307345 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.235+0000 7f25b2a00640 1 --2- 172.21.15.96:0/3342307345 >> v2:172.21.15.155:3300/0 conn(0x7f25b40cf100 0x7f25b40cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.235+0000 7f25abe00640 1 -- 172.21.15.96:0/3342307345 >> v2:172.21.15.155:3300/0 conn(0x7f25b40cf100 msgr2=0x7f25b40cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.236+0000 7f25abe00640 1 --2- 172.21.15.96:0/3342307345 >> v2:172.21.15.155:3300/0 conn(0x7f25b40cf100 0x7f25b40cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.236+0000 7f25abe00640 1 -- 172.21.15.96:0/3342307345 >> v1:172.21.15.155:6789/0 conn(0x7f25b415fcf0 legacy=0x7f25b4160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.236+0000 7f25abe00640 1 -- 172.21.15.96:0/3342307345 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b415c810 con 0x7f25b40b4c80 2024-04-24T23:59:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.237+0000 7f25abe00640 1 --2- 172.21.15.96:0/3342307345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40b4c80 0x7f25b40acda0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f25b406c640 tx=0x7f259c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad86d6ac2902ec7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.237+0000 7f25b2000640 1 -- 172.21.15.96:0/3342307345 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c037070 con 0x7f25b40b4c80 2024-04-24T23:59:57.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.237+0000 7f25b2000640 1 -- 172.21.15.96:0/3342307345 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c032440 con 0x7f25b40b4c80 2024-04-24T23:59:57.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.237+0000 7f25b2000640 1 -- 172.21.15.96:0/3342307345 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c032810 con 0x7f25b40b4c80 2024-04-24T23:59:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.237+0000 7f25b9e00640 1 -- 172.21.15.96:0/3342307345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40b4c80 msgr2=0x7f25b40acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.237+0000 7f25b9e00640 1 --2- 172.21.15.96:0/3342307345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40b4c80 0x7f25b40acda0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f25b406c640 tx=0x7f259c02a270 comp rx=0 tx=0).stop 2024-04-24T23:59:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.238+0000 7f25b9e00640 1 -- 172.21.15.96:0/3342307345 shutdown_connections 2024-04-24T23:59:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.238+0000 7f25b9e00640 1 --2- 172.21.15.96:0/3342307345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40b4c80 0x7f25b40acda0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.238+0000 7f25b9e00640 1 --2- 172.21.15.96:0/3342307345 >> v2:172.21.15.155:3300/0 conn(0x7f25b40cf100 0x7f25b40cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.238+0000 7f25b9e00640 1 -- 172.21.15.96:0/3342307345 >> 172.21.15.96:0/3342307345 conn(0x7f25b40b19c0 msgr2=0x7f25b40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.238+0000 7f25b9e00640 1 -- 172.21.15.96:0/3342307345 shutdown_connections 2024-04-24T23:59:57.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.238+0000 7f25b9e00640 1 -- 172.21.15.96:0/3342307345 wait complete. 2024-04-24T23:59:57.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.239+0000 7f25b9e00640 1 Processor -- start 2024-04-24T23:59:57.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.240+0000 7f25b9e00640 1 -- start start 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b9e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40cf100 0x7f25b4156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b9e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25b415fcf0 0x7f25b41465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b9e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25b409b430 0x7f25b41581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b9e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f25b415d0b0 con 0x7f25b40cf100 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b9e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f25b415cdd0 con 0x7f25b415fcf0 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b9e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f25b406cb90 con 0x7f25b409b430 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b2a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40cf100 0x7f25b4156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b2a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40cf100 0x7f25b4156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58020/0 (socket says 172.21.15.96:58020) 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b2a00640 1 -- 172.21.15.96:0/3779397598 learned_addr learned my addr 172.21.15.96:0/3779397598 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b3400640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25b409b430 0x7f25b41581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b2a00640 1 -- 172.21.15.96:0/3779397598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25b409b430 msgr2=0x7f25b41581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25abe00640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25b415fcf0 0x7f25b41465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b2a00640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25b409b430 0x7f25b41581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b2a00640 1 -- 172.21.15.96:0/3779397598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25b415fcf0 msgr2=0x7f25b41465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b2a00640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25b415fcf0 0x7f25b41465d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b2a00640 1 -- 172.21.15.96:0/3779397598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b4156eb0 con 0x7f25b40cf100 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.241+0000 7f25b3400640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25b409b430 0x7f25b41581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.242+0000 7f25b2a00640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40cf100 0x7f25b4156970 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f25a400e9b0 tx=0x7f25a400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.242+0000 7f25ab400640 1 -- 172.21.15.96:0/3779397598 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a4017070 con 0x7f25b40cf100 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.242+0000 7f25ab400640 1 -- 172.21.15.96:0/3779397598 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a400c9a0 con 0x7f25b40cf100 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.242+0000 7f25ab400640 1 -- 172.21.15.96:0/3779397598 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a400cd90 con 0x7f25b40cf100 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.242+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b4157150 con 0x7f25b40cf100 2024-04-24T23:59:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.242+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b4157710 con 0x7f25b40cf100 2024-04-24T23:59:57.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.243+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25b4069110 con 0x7f25b40cf100 2024-04-24T23:59:57.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.244+0000 7f25ab400640 1 -- 172.21.15.96:0/3779397598 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f25a401a070 con 0x7f25b40cf100 2024-04-24T23:59:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.246+0000 7f25ab400640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f259006bfe0 0x7f259006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.246+0000 7f25ab400640 1 -- 172.21.15.96:0/3779397598 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f25a408af40 con 0x7f25b40cf100 2024-04-24T23:59:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.246+0000 7f25abe00640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f259006bfe0 0x7f259006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.247+0000 7f25ab400640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7f2590071ea0 0x7f25900742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.247+0000 7f25ab400640 1 -- 172.21.15.96:0/3779397598 --> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2590074970 con 0x7f2590071ea0 2024-04-24T23:59:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.247+0000 7f25ab400640 1 -- 172.21.15.96:0/3779397598 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f25a4090510 con 0x7f25b40cf100 2024-04-24T23:59:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.247+0000 7f25abe00640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f259006bfe0 0x7f259006e4a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f259c034000 tx=0x7f259c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.247+0000 7f25b3400640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7f2590071ea0 0x7f25900742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.248+0000 7f25b3400640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7f2590071ea0 0x7f25900742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.249+0000 7f25ab400640 1 -- 172.21.15.96:0/3779397598 <== osd.3 v2:172.21.15.96:6808/1162768165 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2590074970 con 0x7f2590071ea0 2024-04-24T23:59:57.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.263+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 --> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f25b406e810 con 0x7f2590071ea0 2024-04-24T23:59:57.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.263+0000 7f25ab400640 1 -- 172.21.15.96:0/3779397598 <== osd.3 v2:172.21.15.96:6808/1162768165 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f25b406e810 con 0x7f2590071ea0 2024-04-24T23:59:57.264 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:57.264 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:59:57.264 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:57.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.264+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7f2590071ea0 msgr2=0x7f25900742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.264+0000 7f25b9e00640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6808/1162768165,v1:172.21.15.96:6809/1162768165] conn(0x7f2590071ea0 0x7f25900742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.264+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f259006bfe0 msgr2=0x7f259006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.264+0000 7f25b9e00640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f259006bfe0 0x7f259006e4a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f259c034000 tx=0x7f259c02e000 comp rx=0 tx=0).stop 2024-04-24T23:59:57.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.264+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40cf100 msgr2=0x7f25b4156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.264+0000 7f25b9e00640 1 --2- 172.21.15.96:0/3779397598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25b40cf100 0x7f25b4156970 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f25a400e9b0 tx=0x7f25a400ee70 comp rx=0 tx=0).stop 2024-04-24T23:59:57.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.264+0000 7f25b3400640 1 -- 172.21.15.96:0/3779397598 reap_dead start 2024-04-24T23:59:57.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.264+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 shutdown_connections 2024-04-24T23:59:57.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.264+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 >> 172.21.15.96:0/3779397598 conn(0x7f25b40b19c0 msgr2=0x7f25b40acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:57.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.265+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 shutdown_connections 2024-04-24T23:59:57.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.265+0000 7f25b9e00640 1 -- 172.21.15.96:0/3779397598 wait complete. 2024-04-24T23:59:57.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T23:59:57.310 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:59:57.334 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:59:57.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.474+0000 7f3d2b000640 1 Processor -- start 2024-04-24T23:59:57.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.474+0000 7f3d2b000640 1 -- start start 2024-04-24T23:59:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.476+0000 7f3d2b000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3d240b4ec0 0x7f3d240cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.476+0000 7f3d2b000640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d2415fa90 con 0x7f3d240ccc20 2024-04-24T23:59:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.476+0000 7f3d2b000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d240b3e20 con 0x7f3d2415f6b0 2024-04-24T23:59:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.476+0000 7f3d2b000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3d240b4a30 con 0x7f3d240b4ec0 2024-04-24T23:59:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.476+0000 7f3d2a600640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3d240ccc20 0x7f3d24070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:38750/0 (socket says 172.21.15.96:38750) 2024-04-24T23:59:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.476+0000 7f3d2a600640 1 -- 172.21.15.96:0/2912115193 learned_addr learned my addr 172.21.15.96:0/2912115193 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:57.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.476+0000 7f3d29200640 1 --2- 172.21.15.96:0/2912115193 >> v2:172.21.15.155:3300/0 conn(0x7f3d240b4ec0 0x7f3d240cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778171626 0 0) 0x7f3d2415fa90 con 0x7f3d240ccc20 2024-04-24T23:59:57.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d0c003520 con 0x7f3d240ccc20 2024-04-24T23:59:57.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2397568840 0 0) 0x7f3d0c003520 con 0x7f3d240ccc20 2024-04-24T23:59:57.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 >> v2:172.21.15.155:3300/0 conn(0x7f3d240b4ec0 msgr2=0x7f3d240cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 --2- 172.21.15.96:0/2912115193 >> v2:172.21.15.155:3300/0 conn(0x7f3d240b4ec0 0x7f3d240cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 >> v1:172.21.15.155:6789/0 conn(0x7f3d2415f6b0 legacy=0x7f3d240ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d240b4100 con 0x7f3d240ccc20 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f3d1c0019f0 con 0x7f3d240ccc20 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 >> v1:172.21.15.96:6789/0 conn(0x7f3d240ccc20 legacy=0x7f3d24070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d0c0039b0 0x7f3d0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d0c0051c0 0x7f3d0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240b4a30 con 0x7f3d0c004800 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c00c060 con 0x7f3d0c0051c0 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0c00c260 con 0x7f3d0c0039b0 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.477+0000 7f3d29200640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.478+0000 7f3d2a600640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d0c0051c0 0x7f3d0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.478+0000 7f3d29200640 1 -- 172.21.15.96:0/2912115193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d0c0039b0 msgr2=0x7f3d0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:57.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.478+0000 7f3d29200640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d0c0039b0 0x7f3d0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.478+0000 7f3d29200640 1 -- 172.21.15.96:0/2912115193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d0c0051c0 msgr2=0x7f3d0c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:57.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.478+0000 7f3d29200640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d0c0051c0 0x7f3d0c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.478+0000 7f3d29200640 1 -- 172.21.15.96:0/2912115193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c003520 con 0x7f3d0c004800 2024-04-24T23:59:57.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.478+0000 7f3d2a600640 1 -- 172.21.15.96:0/2912115193 reap_dead start 2024-04-24T23:59:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.479+0000 7f3d29200640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d0c004c80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009a90 tx=0x7f3d0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a819636e953b030f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.479+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10036070 con 0x7f3d0c004800 2024-04-24T23:59:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.479+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10031400 con 0x7f3d0c004800 2024-04-24T23:59:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.479+0000 7f3d23e00640 1 -- 172.21.15.96:0/2912115193 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10009690 con 0x7f3d0c004800 2024-04-24T23:59:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.480+0000 7f3d2b000640 1 -- 172.21.15.96:0/2912115193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 msgr2=0x7f3d0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.480+0000 7f3d2b000640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d0c004c80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009a90 tx=0x7f3d0c005830 comp rx=0 tx=0).stop 2024-04-24T23:59:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.480+0000 7f3d2b000640 1 -- 172.21.15.96:0/2912115193 shutdown_connections 2024-04-24T23:59:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.480+0000 7f3d2b000640 1 --2- 172.21.15.96:0/2912115193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d0c004c80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.480+0000 7f3d2b000640 1 -- 172.21.15.96:0/2912115193 >> 172.21.15.96:0/2912115193 conn(0x7f3d240b1f10 msgr2=0x7f3d240cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.480+0000 7f3d2b000640 1 -- 172.21.15.96:0/2912115193 shutdown_connections 2024-04-24T23:59:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.480+0000 7f3d2b000640 1 -- 172.21.15.96:0/2912115193 wait complete. 2024-04-24T23:59:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.482+0000 7f3d2b000640 1 Processor -- start 2024-04-24T23:59:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.482+0000 7f3d2b000640 1 -- start start 2024-04-24T23:59:57.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d2b000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d24153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d2b000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2415ce50 0x7f3d240aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d2b000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2415d600 0x7f3d2415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d2b000640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240cf1c0 con 0x7f3d0c004800 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d2b000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240b46c0 con 0x7f3d2415d600 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d2b000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3d240b3a40 con 0x7f3d2415ce50 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d29c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d24153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d29c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d24153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58040/0 (socket says 172.21.15.96:58040) 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d29c00640 1 -- 172.21.15.96:0/235296383 learned_addr learned my addr 172.21.15.96:0/235296383 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d29200640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2415ce50 0x7f3d240aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.483+0000 7f3d2a600640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2415d600 0x7f3d2415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d29c00640 1 -- 172.21.15.96:0/235296383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2415ce50 msgr2=0x7f3d240aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d29c00640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2415ce50 0x7f3d240aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d29c00640 1 -- 172.21.15.96:0/235296383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2415d600 msgr2=0x7f3d2415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d29c00640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2415d600 0x7f3d2415da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d29c00640 1 -- 172.21.15.96:0/235296383 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2409cf80 con 0x7f3d0c004800 2024-04-24T23:59:57.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d29c00640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d24153e00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800c460 tx=0x7f3d1800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d21600640 1 -- 172.21.15.96:0/235296383 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18017070 con 0x7f3d0c004800 2024-04-24T23:59:57.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d21600640 1 -- 172.21.15.96:0/235296383 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d180052f0 con 0x7f3d0c004800 2024-04-24T23:59:57.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2409d260 con 0x7f3d0c004800 2024-04-24T23:59:57.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d21600640 1 -- 172.21.15.96:0/235296383 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18003830 con 0x7f3d0c004800 2024-04-24T23:59:57.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.484+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d2409d820 con 0x7f3d0c004800 2024-04-24T23:59:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.486+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d24067e40 con 0x7f3d0c004800 2024-04-24T23:59:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.486+0000 7f3d21600640 1 -- 172.21.15.96:0/235296383 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f3d1801a070 con 0x7f3d0c004800 2024-04-24T23:59:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.487+0000 7f3d21600640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3d0406bfe0 0x7f3d0406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.487+0000 7f3d21600640 1 -- 172.21.15.96:0/235296383 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f3d1808a280 con 0x7f3d0c004800 2024-04-24T23:59:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.487+0000 7f3d29200640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3d0406bfe0 0x7f3d0406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.488+0000 7f3d29200640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3d0406bfe0 0x7f3d0406e4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3d10033000 tx=0x7f3d10008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.491+0000 7f3d21600640 1 -- 172.21.15.96:0/235296383 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3d18058c10 con 0x7f3d0c004800 2024-04-24T23:59:57.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.685+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f3d24071840 con 0x7f3d0406bfe0 2024-04-24T23:59:57.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.685+0000 7f3d21600640 1 -- 172.21.15.96:0/235296383 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d24071840 con 0x7f3d0406bfe0 2024-04-24T23:59:57.686 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T23:59:57.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3d0406bfe0 msgr2=0x7f3d0406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3d0406bfe0 0x7f3d0406e4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3d10033000 tx=0x7f3d10008030 comp rx=0 tx=0).stop 2024-04-24T23:59:57.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 msgr2=0x7f3d24153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d24153e00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800c460 tx=0x7f3d1800c920 comp rx=0 tx=0).stop 2024-04-24T23:59:57.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 shutdown_connections 2024-04-24T23:59:57.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2415d600 0x7f3d2415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2415ce50 0x7f3d240aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3d0406bfe0 0x7f3d0406e4a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 --2- 172.21.15.96:0/235296383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d0c004800 0x7f3d24153e00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 >> 172.21.15.96:0/235296383 conn(0x7f3d240b1f10 msgr2=0x7f3d240afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:57.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 shutdown_connections 2024-04-24T23:59:57.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.688+0000 7f3d2b000640 1 -- 172.21.15.96:0/235296383 wait complete. 2024-04-24T23:59:57.707 INFO:tasks.ceph:Scrubbing osd.4 2024-04-24T23:59:57.707 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:59:57.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.905+0000 7fefd4a00640 1 Processor -- start 2024-04-24T23:59:57.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.905+0000 7fefd4a00640 1 -- start start 2024-04-24T23:59:57.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.907+0000 7fefd4a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fefd0166d30 0x7fefd00cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.907+0000 7fefd4a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fefd00cf620 0x7fefd006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.907+0000 7fefd4a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd00ccca0 con 0x7fefd0163720 2024-04-24T23:59:57.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.907+0000 7fefd4a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fefd00cfa90 con 0x7fefd00cf620 2024-04-24T23:59:57.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.907+0000 7fefd4a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fefd01668a0 con 0x7fefd0166d30 2024-04-24T23:59:57.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.907+0000 7fefcf200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fefd00cf620 0x7fefd006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.908+0000 7fefcf200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fefd00cf620 0x7fefd006db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58048/0 (socket says 172.21.15.96:58048) 2024-04-24T23:59:57.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.908+0000 7fefcf200640 1 -- 172.21.15.96:0/1876267155 learned_addr learned my addr 172.21.15.96:0/1876267155 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:57.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.908+0000 7fefcf200640 1 -- 172.21.15.96:0/1876267155 >> v2:172.21.15.155:3300/0 conn(0x7fefd0166d30 msgr2=0x7fefd00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:57.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.908+0000 7fefcf200640 1 --2- 172.21.15.96:0/1876267155 >> v2:172.21.15.155:3300/0 conn(0x7fefd0166d30 0x7fefd00cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.908+0000 7fefcf200640 1 -- 172.21.15.96:0/1876267155 >> v1:172.21.15.155:6789/0 conn(0x7fefd0163720 legacy=0x7fefd00cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:57.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.908+0000 7fefcf200640 1 -- 172.21.15.96:0/1876267155 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd00ccf80 con 0x7fefd00cf620 2024-04-24T23:59:57.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.909+0000 7fefcf200640 1 --2- 172.21.15.96:0/1876267155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 0x7fefd006db10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fefd006ef30 tx=0x7fefc802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b53ed4d18b2c61 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.909+0000 7fefcde00640 1 -- 172.21.15.96:0/1876267155 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8036070 con 0x7fefd00cf620 2024-04-24T23:59:57.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefcde00640 1 -- 172.21.15.96:0/1876267155 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc8031600 con 0x7fefd00cf620 2024-04-24T23:59:57.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefcde00640 1 -- 172.21.15.96:0/1876267155 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc80319d0 con 0x7fefd00cf620 2024-04-24T23:59:57.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefd4a00640 1 -- 172.21.15.96:0/1876267155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 msgr2=0x7fefd006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefd4a00640 1 --2- 172.21.15.96:0/1876267155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 0x7fefd006db10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fefd006ef30 tx=0x7fefc802a6f0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefd4a00640 1 -- 172.21.15.96:0/1876267155 shutdown_connections 2024-04-24T23:59:57.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefd4a00640 1 --2- 172.21.15.96:0/1876267155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 0x7fefd006db10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefd4a00640 1 --2- 172.21.15.96:0/1876267155 >> v2:172.21.15.155:3300/0 conn(0x7fefd0166d30 0x7fefd00cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefd4a00640 1 -- 172.21.15.96:0/1876267155 >> 172.21.15.96:0/1876267155 conn(0x7fefd00b1f80 msgr2=0x7fefd00cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:57.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefd4a00640 1 -- 172.21.15.96:0/1876267155 shutdown_connections 2024-04-24T23:59:57.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.910+0000 7fefd4a00640 1 -- 172.21.15.96:0/1876267155 wait complete. 2024-04-24T23:59:57.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.912+0000 7fefd4a00640 1 Processor -- start 2024-04-24T23:59:57.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.912+0000 7fefd4a00640 1 -- start start 2024-04-24T23:59:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.913+0000 7fefd4a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 0x7fefd01580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.913+0000 7fefd4a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefd0163720 0x7fefd009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.913+0000 7fefd4a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefd0166d30 0x7fefd01588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.913+0000 7fefd4a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fefd0163b00 con 0x7fefd00cf620 2024-04-24T23:59:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.913+0000 7fefd4a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fefd0166530 con 0x7fefd0163720 2024-04-24T23:59:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.913+0000 7fefd4a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fefd00cc910 con 0x7fefd0166d30 2024-04-24T23:59:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.913+0000 7fefce800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 0x7fefd01580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.913+0000 7fefce800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 0x7fefd01580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58056/0 (socket says 172.21.15.96:58056) 2024-04-24T23:59:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.913+0000 7fefce800640 1 -- 172.21.15.96:0/3434382205 learned_addr learned my addr 172.21.15.96:0/3434382205 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefc7e00640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefd0163720 0x7fefd009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefcf200640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefd0166d30 0x7fefd01588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefce800640 1 -- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefd0166d30 msgr2=0x7fefd01588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefce800640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefd0166d30 0x7fefd01588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefce800640 1 -- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefd0163720 msgr2=0x7fefd009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefce800640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefd0163720 0x7fefd009aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefce800640 1 -- 172.21.15.96:0/3434382205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd0163e20 con 0x7fefd00cf620 2024-04-24T23:59:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefcf200640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefd0166d30 0x7fefd01588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefce800640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 0x7fefd01580b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c410 tx=0x7fefc000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefc6a00640 1 -- 172.21.15.96:0/3434382205 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0017070 con 0x7fefd00cf620 2024-04-24T23:59:57.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefc6a00640 1 -- 172.21.15.96:0/3434382205 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc00035f0 con 0x7fefd00cf620 2024-04-24T23:59:57.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefc6a00640 1 -- 172.21.15.96:0/3434382205 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0003a20 con 0x7fefd00cf620 2024-04-24T23:59:57.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.914+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd0164100 con 0x7fefd00cf620 2024-04-24T23:59:57.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.915+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd01646c0 con 0x7fefd00cf620 2024-04-24T23:59:57.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.916+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fefd015d5b0 con 0x7fefd00cf620 2024-04-24T23:59:57.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.917+0000 7fefc6a00640 1 -- 172.21.15.96:0/3434382205 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fefc0003bc0 con 0x7fefd00cf620 2024-04-24T23:59:57.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.918+0000 7fefc6a00640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefac06bfe0 0x7fefac06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.918+0000 7fefc6a00640 1 -- 172.21.15.96:0/3434382205 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fefc008a230 con 0x7fefd00cf620 2024-04-24T23:59:57.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.918+0000 7fefc7e00640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefac06bfe0 0x7fefac06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.918+0000 7fefc6a00640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7fefac071ea0 0x7fefac0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:57.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.918+0000 7fefc6a00640 1 -- 172.21.15.96:0/3434382205 --> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fefac074970 con 0x7fefac071ea0 2024-04-24T23:59:57.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.918+0000 7fefc6a00640 1 -- 172.21.15.96:0/3434382205 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fefc0091050 con 0x7fefd00cf620 2024-04-24T23:59:57.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.918+0000 7fefcf200640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7fefac071ea0 0x7fefac0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:57.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.919+0000 7fefc7e00640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefac06bfe0 0x7fefac06e4a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fefd0161be0 tx=0x7fefb8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.919+0000 7fefcf200640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7fefac071ea0 0x7fefac0742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:57.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.921+0000 7fefc6a00640 1 -- 172.21.15.96:0/3434382205 <== osd.4 v2:172.21.15.155:6800/810886372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fefac074970 con 0x7fefac071ea0 2024-04-24T23:59:57.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.936+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 --> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fefd00756b0 con 0x7fefac071ea0 2024-04-24T23:59:57.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.936+0000 7fefc6a00640 1 -- 172.21.15.96:0/3434382205 <== osd.4 v2:172.21.15.155:6800/810886372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fefd00756b0 con 0x7fefac071ea0 2024-04-24T23:59:57.937 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:57.937 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:59:57.937 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:57.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.937+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7fefac071ea0 msgr2=0x7fefac0742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.937+0000 7fefd4a00640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.155:6800/810886372,v1:172.21.15.155:6801/810886372] conn(0x7fefac071ea0 0x7fefac0742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.937+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefac06bfe0 msgr2=0x7fefac06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.937+0000 7fefd4a00640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fefac06bfe0 0x7fefac06e4a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fefd0161be0 tx=0x7fefb8008040 comp rx=0 tx=0).stop 2024-04-24T23:59:57.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.937+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 msgr2=0x7fefd01580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:57.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.937+0000 7fefd4a00640 1 --2- 172.21.15.96:0/3434382205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd00cf620 0x7fefd01580b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c410 tx=0x7fefc000c8d0 comp rx=0 tx=0).stop 2024-04-24T23:59:57.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.937+0000 7fefcf200640 1 -- 172.21.15.96:0/3434382205 reap_dead start 2024-04-24T23:59:57.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.937+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 shutdown_connections 2024-04-24T23:59:57.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.937+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 >> 172.21.15.96:0/3434382205 conn(0x7fefd00b1f80 msgr2=0x7fefd0072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:57.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.938+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 shutdown_connections 2024-04-24T23:59:57.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:57.938+0000 7fefd4a00640 1 -- 172.21.15.96:0/3434382205 wait complete. 2024-04-24T23:59:57.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-24T23:59:58.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.152+0000 7f6e15800640 1 Processor -- start 2024-04-24T23:59:58.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.153+0000 7f6e15800640 1 -- start start 2024-04-24T23:59:58.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.154+0000 7f6e15800640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6e1015c230 0x7f6e10071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.154+0000 7f6e15800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e100af120 0x7f6e1006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.154+0000 7f6e15800640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e10160b20 con 0x7f6e100acda0 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.154+0000 7f6e15800640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f6e1015c610 con 0x7f6e1015c230 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.154+0000 7f6e15800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6e100ad230 con 0x7f6e100af120 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.155+0000 7f6e0ea00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6e1015c230 0x7f6e10071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.155+0000 7f6e06000640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6e100acda0 0x7f6e100aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:38752/0 (socket says 172.21.15.96:38752) 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.155+0000 7f6e06000640 1 -- 172.21.15.96:0/4051964825 learned_addr learned my addr 172.21.15.96:0/4051964825 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.155+0000 7f6e0f400640 1 --2- 172.21.15.96:0/4051964825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e100af120 0x7f6e1006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.155+0000 7f6e0ea00640 1 -- 172.21.15.96:0/4051964825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e100af120 msgr2=0x7f6e1006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.155+0000 7f6e0ea00640 1 --2- 172.21.15.96:0/4051964825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e100af120 0x7f6e1006cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.155+0000 7f6e0ea00640 1 -- 172.21.15.96:0/4051964825 >> v1:172.21.15.96:6789/0 conn(0x7f6e100acda0 legacy=0x7f6e100aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.155+0000 7f6e0ea00640 1 -- 172.21.15.96:0/4051964825 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1015fd60 con 0x7f6e1015c230 2024-04-24T23:59:58.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.155+0000 7f6e0e000640 1 -- 172.21.15.96:0/4051964825 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2743791559 0 0) 0x7f6e10160b20 con 0x7f6e100acda0 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.157+0000 7f6e0ea00640 1 --2- 172.21.15.96:0/4051964825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e1015c230 0x7f6e10071800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6e000097a0 tx=0x7f6e0002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307313a96454207e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.157+0000 7f6e0e000640 1 -- 172.21.15.96:0/4051964825 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00037070 con 0x7f6e1015c230 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.157+0000 7f6e0e000640 1 -- 172.21.15.96:0/4051964825 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e00032440 con 0x7f6e1015c230 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.157+0000 7f6e0e000640 1 -- 172.21.15.96:0/4051964825 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00032810 con 0x7f6e1015c230 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.157+0000 7f6e15800640 1 -- 172.21.15.96:0/4051964825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e1015c230 msgr2=0x7f6e10071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.157+0000 7f6e15800640 1 --2- 172.21.15.96:0/4051964825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e1015c230 0x7f6e10071800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6e000097a0 tx=0x7f6e0002a180 comp rx=0 tx=0).stop 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.158+0000 7f6e15800640 1 -- 172.21.15.96:0/4051964825 shutdown_connections 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.158+0000 7f6e15800640 1 --2- 172.21.15.96:0/4051964825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e100af120 0x7f6e1006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.158+0000 7f6e15800640 1 --2- 172.21.15.96:0/4051964825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e1015c230 0x7f6e10071800 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.158+0000 7f6e15800640 1 -- 172.21.15.96:0/4051964825 >> 172.21.15.96:0/4051964825 conn(0x7f6e100b19c0 msgr2=0x7f6e100b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.158+0000 7f6e15800640 1 -- 172.21.15.96:0/4051964825 shutdown_connections 2024-04-24T23:59:58.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.158+0000 7f6e15800640 1 -- 172.21.15.96:0/4051964825 wait complete. 2024-04-24T23:59:58.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.159+0000 7f6e15800640 1 Processor -- start 2024-04-24T23:59:58.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.159+0000 7f6e15800640 1 -- start start 2024-04-24T23:59:58.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.160+0000 7f6e15800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100acda0 0x7f6e1015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.160+0000 7f6e15800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e100af120 0x7f6e1015d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.160+0000 7f6e15800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e1015c230 0x7f6e101497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.160+0000 7f6e15800640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10160600 con 0x7f6e100acda0 2024-04-24T23:59:58.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.160+0000 7f6e15800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10160320 con 0x7f6e100af120 2024-04-24T23:59:58.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.160+0000 7f6e15800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6e100ad4d0 con 0x7f6e1015c230 2024-04-24T23:59:58.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e0ea00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100acda0 0x7f6e1015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e0ea00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100acda0 0x7f6e1015ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58074/0 (socket says 172.21.15.96:58074) 2024-04-24T23:59:58.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e0ea00640 1 -- 172.21.15.96:0/1777749613 learned_addr learned my addr 172.21.15.96:0/1777749613 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e0f400640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e1015c230 0x7f6e101497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e06000640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e100af120 0x7f6e1015d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e0ea00640 1 -- 172.21.15.96:0/1777749613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e1015c230 msgr2=0x7f6e101497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e0ea00640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e1015c230 0x7f6e101497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e0ea00640 1 -- 172.21.15.96:0/1777749613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e100af120 msgr2=0x7f6e1015d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e0ea00640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e100af120 0x7f6e1015d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e0ea00640 1 -- 172.21.15.96:0/1777749613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1015f380 con 0x7f6e100acda0 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.161+0000 7f6e06000640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e100af120 0x7f6e1015d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.162+0000 7f6e0ea00640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100acda0 0x7f6e1015ed80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6e000098c0 tx=0x7f6e000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.162+0000 7f6e07400640 1 -- 172.21.15.96:0/1777749613 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00037040 con 0x7f6e100acda0 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.162+0000 7f6e07400640 1 -- 172.21.15.96:0/1777749613 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e00030500 con 0x7f6e100acda0 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.162+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e100cd020 con 0x7f6e100acda0 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.162+0000 7f6e07400640 1 -- 172.21.15.96:0/1777749613 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e000308d0 con 0x7f6e100acda0 2024-04-24T23:59:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.162+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1015c8b0 con 0x7f6e100acda0 2024-04-24T23:59:58.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.163+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e100cce20 con 0x7f6e100acda0 2024-04-24T23:59:58.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.164+0000 7f6e07400640 1 -- 172.21.15.96:0/1777749613 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f6e00044020 con 0x7f6e100acda0 2024-04-24T23:59:58.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.165+0000 7f6e07400640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6dec06bfe0 0x7f6dec06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.165+0000 7f6e07400640 1 -- 172.21.15.96:0/1777749613 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f6e000ab0a0 con 0x7f6e100acda0 2024-04-24T23:59:58.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.165+0000 7f6e06000640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6dec06bfe0 0x7f6dec06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.166+0000 7f6e06000640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6dec06bfe0 0x7f6dec06e4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6e1015ce20 tx=0x7f6df8007c30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.169+0000 7f6e07400640 1 -- 172.21.15.96:0/1777749613 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6e00079ac0 con 0x7f6e100acda0 2024-04-24T23:59:58.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.369+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f6e1015d260 con 0x7f6dec06bfe0 2024-04-24T23:59:58.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.370+0000 7f6e07400640 1 -- 172.21.15.96:0/1777749613 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6e1015d260 con 0x7f6dec06bfe0 2024-04-24T23:59:58.370 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 4 to deep-scrub 2024-04-24T23:59:58.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6dec06bfe0 msgr2=0x7f6dec06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6dec06bfe0 0x7f6dec06e4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6e1015ce20 tx=0x7f6df8007c30 comp rx=0 tx=0).stop 2024-04-24T23:59:58.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100acda0 msgr2=0x7f6e1015ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100acda0 0x7f6e1015ed80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6e000098c0 tx=0x7f6e000046c0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 shutdown_connections 2024-04-24T23:59:58.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e1015c230 0x7f6e101497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e100af120 0x7f6e1015d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f6dec06bfe0 0x7f6dec06e4a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 --2- 172.21.15.96:0/1777749613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100acda0 0x7f6e1015ed80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.373+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 >> 172.21.15.96:0/1777749613 conn(0x7f6e100b19c0 msgr2=0x7f6e100b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:58.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.374+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 shutdown_connections 2024-04-24T23:59:58.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.374+0000 7f6e15800640 1 -- 172.21.15.96:0/1777749613 wait complete. 2024-04-24T23:59:58.392 INFO:tasks.ceph:Scrubbing osd.5 2024-04-24T23:59:58.393 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:59:58.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.583+0000 7f62c2c00640 1 Processor -- start 2024-04-24T23:59:58.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.583+0000 7f62c2c00640 1 -- start start 2024-04-24T23:59:58.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.585+0000 7f62c2c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc15f020 0x7f62bc15f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.585+0000 7f62c2c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62bc0ccdf0 0x7f62bc0cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.585+0000 7f62c2c00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62bc162080 con 0x7f62bc0cf0e0 2024-04-24T23:59:58.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.585+0000 7f62c2c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f62bc162e40 con 0x7f62bc0ccdf0 2024-04-24T23:59:58.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.585+0000 7f62c2c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc1629b0 con 0x7f62bc15f020 2024-04-24T23:59:58.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.585+0000 7f62c0e00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f62bc0cf0e0 0x7f62bc0cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:38756/0 (socket says 172.21.15.96:38756) 2024-04-24T23:59:58.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.585+0000 7f62c0e00640 1 -- 172.21.15.96:0/1874133805 learned_addr learned my addr 172.21.15.96:0/1874133805 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62c1800640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc15f020 0x7f62bc15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62c2200640 1 --2- 172.21.15.96:0/1874133805 >> v2:172.21.15.155:3300/0 conn(0x7f62bc0ccdf0 0x7f62bc0cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116533896 0 0) 0x7f62bc162080 con 0x7f62bc0cf0e0 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62a4003520 con 0x7f62bc0cf0e0 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3643058178 0 0) 0x7f62a4003520 con 0x7f62bc0cf0e0 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc15f020 msgr2=0x7f62bc15f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc15f020 0x7f62bc15f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 >> v2:172.21.15.155:3300/0 conn(0x7f62bc0ccdf0 msgr2=0x7f62bc0cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 --2- 172.21.15.96:0/1874133805 >> v2:172.21.15.155:3300/0 conn(0x7f62bc0ccdf0 0x7f62bc0cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc162360 con 0x7f62bc0cf0e0 2024-04-24T23:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f62a8001670 con 0x7f62bc0cf0e0 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 >> v1:172.21.15.96:6789/0 conn(0x7f62bc0cf0e0 legacy=0x7f62bc0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62a40039b0 0x7f62a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 0x7f62a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc15f020 0x7f62a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc162e40 con 0x7f62a4004800 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc1629b0 con 0x7f62a40039b0 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.586+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f62a400b9c0 con 0x7f62bc15f020 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.587+0000 7f62c0e00640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 0x7f62a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.587+0000 7f62c1800640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62a40039b0 0x7f62a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.587+0000 7f62c2200640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc15f020 0x7f62a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.587+0000 7f62c0e00640 1 -- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc15f020 msgr2=0x7f62a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.587+0000 7f62c0e00640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc15f020 0x7f62a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.587+0000 7f62c0e00640 1 -- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62a40039b0 msgr2=0x7f62a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.587+0000 7f62c0e00640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62a40039b0 0x7f62a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.587+0000 7f62c0e00640 1 -- 172.21.15.96:0/1874133805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a4003520 con 0x7f62a4004800 2024-04-24T23:59:58.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.587+0000 7f62c2200640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc15f020 0x7f62a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:58.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.588+0000 7f62c0e00640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 0x7f62a4004c80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f62a800c240 tx=0x7f62a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f975fdb9802b3c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.588+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a802e070 con 0x7f62a4004800 2024-04-24T23:59:58.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.589+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a8005af0 con 0x7f62a4004800 2024-04-24T23:59:58.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.589+0000 7f62bbe00640 1 -- 172.21.15.96:0/1874133805 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8007d30 con 0x7f62a4004800 2024-04-24T23:59:58.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.589+0000 7f62c2c00640 1 -- 172.21.15.96:0/1874133805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 msgr2=0x7f62a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.589+0000 7f62c2c00640 1 --2- 172.21.15.96:0/1874133805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 0x7f62a4004c80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f62a800c240 tx=0x7f62a4005830 comp rx=0 tx=0).stop 2024-04-24T23:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.589+0000 7f62c2200640 1 -- 172.21.15.96:0/1874133805 reap_dead start 2024-04-24T23:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.589+0000 7f62c2c00640 1 -- 172.21.15.96:0/1874133805 shutdown_connections 2024-04-24T23:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.589+0000 7f62c2c00640 1 -- 172.21.15.96:0/1874133805 >> 172.21.15.96:0/1874133805 conn(0x7f62bc0b1f80 msgr2=0x7f62bc0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.589+0000 7f62c2c00640 1 -- 172.21.15.96:0/1874133805 shutdown_connections 2024-04-24T23:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.589+0000 7f62c2c00640 1 -- 172.21.15.96:0/1874133805 wait complete. 2024-04-24T23:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.591+0000 7f62c2c00640 1 Processor -- start 2024-04-24T23:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.591+0000 7f62c2c00640 1 -- start start 2024-04-24T23:59:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.592+0000 7f62c2c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 0x7f62bc0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.592+0000 7f62c2c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62bc0ad2e0 0x7f62bc0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.592+0000 7f62c2c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc0caf70 0x7f62bc0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.592+0000 7f62c2c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc15f580 con 0x7f62a4004800 2024-04-24T23:59:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.592+0000 7f62c2c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc15f400 con 0x7f62bc0ad2e0 2024-04-24T23:59:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.592+0000 7f62c2c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc15f700 con 0x7f62bc0caf70 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.592+0000 7f62c1800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 0x7f62bc0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.592+0000 7f62c1800640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 0x7f62bc0acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58096/0 (socket says 172.21.15.96:58096) 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.592+0000 7f62c1800640 1 -- 172.21.15.96:0/2211900946 learned_addr learned my addr 172.21.15.96:0/2211900946 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62c0e00640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62bc0ad2e0 0x7f62bc0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62c1800640 1 -- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc0caf70 msgr2=0x7f62bc0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62c1800640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62bc0caf70 0x7f62bc0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62c1800640 1 -- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62bc0ad2e0 msgr2=0x7f62bc0caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62c1800640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62bc0ad2e0 0x7f62bc0caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62c1800640 1 -- 172.21.15.96:0/2211900946 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc0cb930 con 0x7f62a4004800 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62c1800640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 0x7f62bc0acda0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f62b00114f0 tx=0x7f62b00119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62b9600640 1 -- 172.21.15.96:0/2211900946 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0015930 con 0x7f62a4004800 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62b9600640 1 -- 172.21.15.96:0/2211900946 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b0015ad0 con 0x7f62a4004800 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62b9600640 1 -- 172.21.15.96:0/2211900946 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b001d400 con 0x7f62a4004800 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62bc0ad860 con 0x7f62a4004800 2024-04-24T23:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.593+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62bc0ade20 con 0x7f62a4004800 2024-04-24T23:59:58.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.594+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f62bc0756b0 con 0x7f62a4004800 2024-04-24T23:59:58.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.595+0000 7f62b9600640 1 -- 172.21.15.96:0/2211900946 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f62b001d5a0 con 0x7f62a4004800 2024-04-24T23:59:58.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.596+0000 7f62b9600640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f629c06bfe0 0x7f629c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.596+0000 7f62b9600640 1 -- 172.21.15.96:0/2211900946 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f62b008b600 con 0x7f62a4004800 2024-04-24T23:59:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.597+0000 7f62c0e00640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f629c06bfe0 0x7f629c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.597+0000 7f62b9600640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7f629c071ea0 0x7f629c0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.597+0000 7f62b9600640 1 -- 172.21.15.96:0/2211900946 --> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f629c074970 con 0x7f629c071ea0 2024-04-24T23:59:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.597+0000 7f62b9600640 1 -- 172.21.15.96:0/2211900946 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f62b0092050 con 0x7f62a4004800 2024-04-24T23:59:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.597+0000 7f62c2200640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7f629c071ea0 0x7f629c0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.597+0000 7f62c0e00640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f629c06bfe0 0x7f629c06e4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62a8033000 tx=0x7f62a8009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.598+0000 7f62c2200640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7f629c071ea0 0x7f629c0742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.600+0000 7f62b9600640 1 -- 172.21.15.96:0/2211900946 <== osd.5 v2:172.21.15.155:6821/841571603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f629c074970 con 0x7f629c071ea0 2024-04-24T23:59:58.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.614+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 --> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f62bc0d0800 con 0x7f629c071ea0 2024-04-24T23:59:58.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.614+0000 7f62b9600640 1 -- 172.21.15.96:0/2211900946 <== osd.5 v2:172.21.15.155:6821/841571603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f62bc0d0800 con 0x7f629c071ea0 2024-04-24T23:59:58.615 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:58.615 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:59:58.615 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7f629c071ea0 msgr2=0x7f629c0742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.155:6821/841571603,v1:172.21.15.155:6824/841571603] conn(0x7f629c071ea0 0x7f629c0742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f629c06bfe0 msgr2=0x7f629c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f629c06bfe0 0x7f629c06e4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62a8033000 tx=0x7f62a8009030 comp rx=0 tx=0).stop 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 msgr2=0x7f62bc0acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 --2- 172.21.15.96:0/2211900946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a4004800 0x7f62bc0acda0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f62b00114f0 tx=0x7f62b00119b0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2200640 1 -- 172.21.15.96:0/2211900946 reap_dead start 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 shutdown_connections 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 >> 172.21.15.96:0/2211900946 conn(0x7f62bc0b1f80 msgr2=0x7f62bc06b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 shutdown_connections 2024-04-24T23:59:58.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.615+0000 7f62c2c00640 1 -- 172.21.15.96:0/2211900946 wait complete. 2024-04-24T23:59:58.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-24T23:59:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.818+0000 7f211c600640 1 Processor -- start 2024-04-24T23:59:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.819+0000 7f211c600640 1 -- start start 2024-04-24T23:59:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.820+0000 7f211c600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21140b3cd0 0x7f2114165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.820+0000 7f211c600640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211415fa90 con 0x7f211415b220 2024-04-24T23:59:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.820+0000 7f211c600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21140713d0 con 0x7f2114070df0 2024-04-24T23:59:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.820+0000 7f211c600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f21140aee00 con 0x7f21140b3cd0 2024-04-24T23:59:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.820+0000 7f2119c00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f211415b220 0x7f211415ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:38766/0 (socket says 172.21.15.96:38766) 2024-04-24T23:59:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.821+0000 7f2119c00640 1 -- 172.21.15.96:0/643610062 learned_addr learned my addr 172.21.15.96:0/643610062 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.821+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 428427170 0 0) 0x7f211415fa90 con 0x7f211415b220 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.821+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20fc003520 con 0x7f211415b220 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.821+0000 7f211a600640 1 --2- 172.21.15.96:0/643610062 >> v2:172.21.15.155:3300/0 conn(0x7f21140b3cd0 0x7f2114165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.821+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 228635497 0 0) 0x7f20fc003520 con 0x7f211415b220 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.821+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 >> v2:172.21.15.155:3300/0 conn(0x7f21140b3cd0 msgr2=0x7f2114165fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.821+0000 7f2113e00640 1 --2- 172.21.15.96:0/643610062 >> v2:172.21.15.155:3300/0 conn(0x7f21140b3cd0 0x7f2114165fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.821+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 >> v1:172.21.15.155:6789/0 conn(0x7f2114070df0 legacy=0x7f211415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21140ae4d0 con 0x7f211415b220 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f2108001670 con 0x7f211415b220 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 >> v1:172.21.15.96:6789/0 conn(0x7f211415b220 legacy=0x7f211415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2113e00640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20fc0039b0 0x7f20fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2113e00640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20fc004800 0x7f20fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2113e00640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc0051c0 0x7f20fc00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f21140aee00 con 0x7f20fc004800 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc00e320 con 0x7f20fc0039b0 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f20fc00e520 con 0x7f20fc0051c0 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2119200640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20fc004800 0x7f20fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2119c00640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20fc0039b0 0x7f20fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f211a600640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc0051c0 0x7f20fc00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2119200640 1 -- 172.21.15.96:0/643610062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc0051c0 msgr2=0x7f20fc00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2119200640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc0051c0 0x7f20fc00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2119200640 1 -- 172.21.15.96:0/643610062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20fc0039b0 msgr2=0x7f20fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2119200640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20fc0039b0 0x7f20fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f2119200640 1 -- 172.21.15.96:0/643610062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20fc003520 con 0x7f20fc004800 2024-04-24T23:59:58.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.822+0000 7f211a600640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc0051c0 0x7f20fc00dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:58.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.823+0000 7f211a600640 1 -- 172.21.15.96:0/643610062 reap_dead start 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.824+0000 7f2119200640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20fc004800 0x7f20fc004c80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2104001e50 tx=0x7f20fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8f30d15161be38 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.824+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104001a70 con 0x7f20fc004800 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.824+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f210402ae40 con 0x7f20fc004800 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.824+0000 7f2113e00640 1 -- 172.21.15.96:0/643610062 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104003bb0 con 0x7f20fc004800 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.824+0000 7f211c600640 1 -- 172.21.15.96:0/643610062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20fc004800 msgr2=0x7f20fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.824+0000 7f211c600640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20fc004800 0x7f20fc004c80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2104001e50 tx=0x7f20fc005830 comp rx=0 tx=0).stop 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.824+0000 7f211c600640 1 -- 172.21.15.96:0/643610062 shutdown_connections 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.824+0000 7f211c600640 1 --2- 172.21.15.96:0/643610062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20fc004800 0x7f20fc004c80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.824+0000 7f211c600640 1 -- 172.21.15.96:0/643610062 >> 172.21.15.96:0/643610062 conn(0x7f21140b19c0 msgr2=0x7f21140b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.825+0000 7f211c600640 1 -- 172.21.15.96:0/643610062 shutdown_connections 2024-04-24T23:59:58.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.825+0000 7f211c600640 1 -- 172.21.15.96:0/643610062 wait complete. 2024-04-24T23:59:58.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.826+0000 7f211c600640 1 Processor -- start 2024-04-24T23:59:58.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.826+0000 7f211c600640 1 -- start start 2024-04-24T23:59:58.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.827+0000 7f211c600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc004800 0x7f2114155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.827+0000 7f211c600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211413e810 0x7f211413bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.827+0000 7f211c600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21140afd10 0x7f21140b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.827+0000 7f211c600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f211406eb90 con 0x7f211413e810 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.827+0000 7f211c600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f21140aea90 con 0x7f21140afd10 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.827+0000 7f211c600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f211406ed10 con 0x7f20fc004800 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f2119200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211413e810 0x7f211413bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f2119200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211413e810 0x7f211413bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58118/0 (socket says 172.21.15.96:58118) 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f2119200640 1 -- 172.21.15.96:0/1046788128 learned_addr learned my addr 172.21.15.96:0/1046788128 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f2119c00640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc004800 0x7f2114155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f211a600640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21140afd10 0x7f21140b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f2119200640 1 -- 172.21.15.96:0/1046788128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc004800 msgr2=0x7f2114155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f2119200640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc004800 0x7f2114155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f2119200640 1 -- 172.21.15.96:0/1046788128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21140afd10 msgr2=0x7f21140b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f2119200640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21140afd10 0x7f21140b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.828+0000 7f2119200640 1 -- 172.21.15.96:0/1046788128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211414e100 con 0x7f211413e810 2024-04-24T23:59:58.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.829+0000 7f2119200640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211413e810 0x7f211413bdc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2104000f80 tx=0x7f21040014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.829+0000 7f2111600640 1 -- 172.21.15.96:0/1046788128 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104037040 con 0x7f211413e810 2024-04-24T23:59:58.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.829+0000 7f2111600640 1 -- 172.21.15.96:0/1046788128 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2104041070 con 0x7f211413e810 2024-04-24T23:59:58.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.829+0000 7f2111600640 1 -- 172.21.15.96:0/1046788128 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104001a70 con 0x7f211413e810 2024-04-24T23:59:58.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.829+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211413ecf0 con 0x7f211413e810 2024-04-24T23:59:58.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.829+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211413f2b0 con 0x7f211413e810 2024-04-24T23:59:58.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.830+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21140acf00 con 0x7f211413e810 2024-04-24T23:59:58.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.831+0000 7f2111600640 1 -- 172.21.15.96:0/1046788128 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f2104006b50 con 0x7f211413e810 2024-04-24T23:59:58.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.832+0000 7f2111600640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f20f806bf80 0x7f20f806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:58.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.832+0000 7f2111600640 1 -- 172.21.15.96:0/1046788128 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f21040ab0d0 con 0x7f211413e810 2024-04-24T23:59:58.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.833+0000 7f2119c00640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f20f806bf80 0x7f20f806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:58.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.833+0000 7f2119c00640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f20f806bf80 0x7f20f806e440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2108001eb0 tx=0x7f2108001d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:58.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:58.836+0000 7f2111600640 1 -- 172.21.15.96:0/1046788128 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f21140acf00 con 0x7f211413e810 2024-04-24T23:59:59.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.035+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f2114069110 con 0x7f20f806bf80 2024-04-24T23:59:59.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.036+0000 7f2111600640 1 -- 172.21.15.96:0/1046788128 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2114069110 con 0x7f20f806bf80 2024-04-24T23:59:59.036 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 5 to deep-scrub 2024-04-24T23:59:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f20f806bf80 msgr2=0x7f20f806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f20f806bf80 0x7f20f806e440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2108001eb0 tx=0x7f2108001d80 comp rx=0 tx=0).stop 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211413e810 msgr2=0x7f211413bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211413e810 0x7f211413bdc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2104000f80 tx=0x7f21040014a0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 shutdown_connections 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21140afd10 0x7f21140b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f20f806bf80 0x7f20f806e440 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211413e810 0x7f211413bdc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 --2- 172.21.15.96:0/1046788128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20fc004800 0x7f2114155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 >> 172.21.15.96:0/1046788128 conn(0x7f21140b19c0 msgr2=0x7f211406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 shutdown_connections 2024-04-24T23:59:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.038+0000 7f211c600640 1 -- 172.21.15.96:0/1046788128 wait complete. 2024-04-24T23:59:59.057 INFO:tasks.ceph:Scrubbing osd.6 2024-04-24T23:59:59.057 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:59:59.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.263+0000 7f4a19a00640 1 Processor -- start 2024-04-24T23:59:59.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.263+0000 7f4a19a00640 1 -- start start 2024-04-24T23:59:59.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.264+0000 7f4a19a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4a1415e4a0 0x7f4a1415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a19a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a14072900 0x7f4a14071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a19a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a140720e0 con 0x7f4a140b2cc0 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a19a00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4a140730c0 con 0x7f4a1415e4a0 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a19a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a14072de0 con 0x7f4a14072900 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a12a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4a1415e4a0 0x7f4a1415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a12a00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4a1415e4a0 0x7f4a1415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58130/0 (socket says 172.21.15.96:58130) 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a12a00640 1 -- 172.21.15.96:0/3373748770 learned_addr learned my addr 172.21.15.96:0/3373748770 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a12000640 1 --2- 172.21.15.96:0/3373748770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a14072900 0x7f4a14071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a12a00640 1 -- 172.21.15.96:0/3373748770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a14072900 msgr2=0x7f4a14071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a12a00640 1 --2- 172.21.15.96:0/3373748770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a14072900 0x7f4a14071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a12a00640 1 -- 172.21.15.96:0/3373748770 >> v1:172.21.15.155:6789/0 conn(0x7f4a140b2cc0 legacy=0x7f4a1406cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.265+0000 7f4a12a00640 1 -- 172.21.15.96:0/3373748770 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a140710c0 con 0x7f4a1415e4a0 2024-04-24T23:59:59.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.266+0000 7f4a12a00640 1 --2- 172.21.15.96:0/3373748770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a1415e4a0 0x7f4a1415f380 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009870 tx=0x7f4a0402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16ba89ec06a8c15 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.267+0000 7f4a11600640 1 -- 172.21.15.96:0/3373748770 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04037070 con 0x7f4a1415e4a0 2024-04-24T23:59:59.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.267+0000 7f4a11600640 1 -- 172.21.15.96:0/3373748770 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a04032440 con 0x7f4a1415e4a0 2024-04-24T23:59:59.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.267+0000 7f4a11600640 1 -- 172.21.15.96:0/3373748770 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04032810 con 0x7f4a1415e4a0 2024-04-24T23:59:59.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.267+0000 7f4a19a00640 1 -- 172.21.15.96:0/3373748770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a1415e4a0 msgr2=0x7f4a1415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.267+0000 7f4a19a00640 1 --2- 172.21.15.96:0/3373748770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a1415e4a0 0x7f4a1415f380 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009870 tx=0x7f4a0402a210 comp rx=0 tx=0).stop 2024-04-24T23:59:59.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.268+0000 7f4a19a00640 1 -- 172.21.15.96:0/3373748770 shutdown_connections 2024-04-24T23:59:59.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.268+0000 7f4a19a00640 1 --2- 172.21.15.96:0/3373748770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a14072900 0x7f4a14071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.268+0000 7f4a19a00640 1 --2- 172.21.15.96:0/3373748770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a1415e4a0 0x7f4a1415f380 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.268+0000 7f4a19a00640 1 -- 172.21.15.96:0/3373748770 >> 172.21.15.96:0/3373748770 conn(0x7f4a140b19c0 msgr2=0x7f4a140b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:59.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.268+0000 7f4a19a00640 1 -- 172.21.15.96:0/3373748770 shutdown_connections 2024-04-24T23:59:59.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.268+0000 7f4a19a00640 1 -- 172.21.15.96:0/3373748770 wait complete. 2024-04-24T23:59:59.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.269+0000 7f4a19a00640 1 Processor -- start 2024-04-24T23:59:59.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.270+0000 7f4a19a00640 1 -- start start 2024-04-24T23:59:59.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a19a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a14072900 0x7f4a141448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a19a00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a140b2cc0 0x7f4a141f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a19a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1415e4a0 0x7f4a1409cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a19a00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4a140b5110 con 0x7f4a140b2cc0 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a19a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a14071680 con 0x7f4a14072900 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a19a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a140b3170 con 0x7f4a1415e4a0 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a12000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a140b2cc0 0x7f4a141f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a12000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a140b2cc0 0x7f4a141f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58138/0 (socket says 172.21.15.96:58138) 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a12000640 1 -- 172.21.15.96:0/202144977 learned_addr learned my addr 172.21.15.96:0/202144977 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a12a00640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a14072900 0x7f4a141448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a13400640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1415e4a0 0x7f4a1409cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a12000640 1 -- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1415e4a0 msgr2=0x7f4a1409cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a12000640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1415e4a0 0x7f4a1409cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a12000640 1 -- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a14072900 msgr2=0x7f4a141448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a12000640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a14072900 0x7f4a141448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.271+0000 7f4a12000640 1 -- 172.21.15.96:0/202144977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1409d660 con 0x7f4a140b2cc0 2024-04-24T23:59:59.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.272+0000 7f4a12000640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a140b2cc0 0x7f4a141f5360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00d800 tx=0x7f49fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.272+0000 7f4a0aa00640 1 -- 172.21.15.96:0/202144977 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00b6c0 con 0x7f4a140b2cc0 2024-04-24T23:59:59.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.272+0000 7f4a0aa00640 1 -- 172.21.15.96:0/202144977 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc019070 con 0x7f4a140b2cc0 2024-04-24T23:59:59.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.272+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a14154f00 con 0x7f4a140b2cc0 2024-04-24T23:59:59.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.272+0000 7f4a0aa00640 1 -- 172.21.15.96:0/202144977 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00ba80 con 0x7f4a140b2cc0 2024-04-24T23:59:59.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.272+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a141554c0 con 0x7f4a140b2cc0 2024-04-24T23:59:59.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.273+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a14069110 con 0x7f4a140b2cc0 2024-04-24T23:59:59.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.274+0000 7f4a0aa00640 1 -- 172.21.15.96:0/202144977 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f49fc00bc20 con 0x7f4a140b2cc0 2024-04-24T23:59:59.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.275+0000 7f4a0aa00640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f49f006bfe0 0x7f49f006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.275+0000 7f4a0aa00640 1 -- 172.21.15.96:0/202144977 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f49fc08b290 con 0x7f4a140b2cc0 2024-04-24T23:59:59.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.276+0000 7f4a12a00640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f49f006bfe0 0x7f49f006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.276+0000 7f4a0aa00640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f49f0071ea0 0x7f49f00742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.276+0000 7f4a0aa00640 1 -- 172.21.15.96:0/202144977 --> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49f0074970 con 0x7f49f0071ea0 2024-04-24T23:59:59.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.276+0000 7f4a0aa00640 1 -- 172.21.15.96:0/202144977 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f49fc092050 con 0x7f4a140b2cc0 2024-04-24T23:59:59.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.276+0000 7f4a12a00640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f49f006bfe0 0x7f49f006e4a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4a04034000 tx=0x7f4a0402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.276+0000 7f4a13400640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f49f0071ea0 0x7f49f00742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.277+0000 7f4a13400640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f49f0071ea0 0x7f49f00742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.279+0000 7f4a0aa00640 1 -- 172.21.15.96:0/202144977 <== osd.6 v2:172.21.15.155:6808/2968414204 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49f0074970 con 0x7f49f0071ea0 2024-04-24T23:59:59.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.294+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 --> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4a1406eae0 con 0x7f49f0071ea0 2024-04-24T23:59:59.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.294+0000 7f4a0aa00640 1 -- 172.21.15.96:0/202144977 <== osd.6 v2:172.21.15.155:6808/2968414204 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4a1406eae0 con 0x7f49f0071ea0 2024-04-24T23:59:59.295 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:59.295 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:59:59.295 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.295+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f49f0071ea0 msgr2=0x7f49f00742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.295+0000 7f4a19a00640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.155:6808/2968414204,v1:172.21.15.155:6809/2968414204] conn(0x7f49f0071ea0 0x7f49f00742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.295+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f49f006bfe0 msgr2=0x7f49f006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.295+0000 7f4a19a00640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f49f006bfe0 0x7f49f006e4a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4a04034000 tx=0x7f4a0402e000 comp rx=0 tx=0).stop 2024-04-24T23:59:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.295+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a140b2cc0 msgr2=0x7f4a141f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.295+0000 7f4a19a00640 1 --2- 172.21.15.96:0/202144977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a140b2cc0 0x7f4a141f5360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00d800 tx=0x7f49fc00dcc0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.295+0000 7f4a13400640 1 -- 172.21.15.96:0/202144977 reap_dead start 2024-04-24T23:59:59.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.295+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 shutdown_connections 2024-04-24T23:59:59.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.295+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 >> 172.21.15.96:0/202144977 conn(0x7f4a140b19c0 msgr2=0x7f4a14161220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:59.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.296+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 shutdown_connections 2024-04-24T23:59:59.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.296+0000 7f4a19a00640 1 -- 172.21.15.96:0/202144977 wait complete. 2024-04-24T23:59:59.315 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-24T23:59:59.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.512+0000 7f3d1c400640 1 Processor -- start 2024-04-24T23:59:59.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.512+0000 7f3d1c400640 1 -- start start 2024-04-24T23:59:59.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.514+0000 7f3d1c400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d1415c230 0x7f3d14071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.514+0000 7f3d1c400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3d140acda0 0x7f3d140aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.514+0000 7f3d1c400640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d14160b20 con 0x7f3d140aef50 2024-04-24T23:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.514+0000 7f3d1c400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3d1415c610 con 0x7f3d140acda0 2024-04-24T23:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.514+0000 7f3d1c400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3d140ad200 con 0x7f3d1415c230 2024-04-24T23:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.514+0000 7f3d1a400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3d140aef50 0x7f3d140722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:38774/0 (socket says 172.21.15.96:38774) 2024-04-24T23:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.514+0000 7f3d1a400640 1 -- 172.21.15.96:0/1632318619 learned_addr learned my addr 172.21.15.96:0/1632318619 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d19a00640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d1415c230 0x7f3d14071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d19000640 1 --2- 172.21.15.96:0/1632318619 >> v2:172.21.15.155:3300/0 conn(0x7f3d140acda0 0x7f3d140aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4174608885 0 0) 0x7f3d14160b20 con 0x7f3d140aef50 2024-04-24T23:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cfc003520 con 0x7f3d140aef50 2024-04-24T23:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2051443221 0 0) 0x7f3cfc003520 con 0x7f3d140aef50 2024-04-24T23:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d1415c230 msgr2=0x7f3d14071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d1415c230 0x7f3d14071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 >> v2:172.21.15.155:3300/0 conn(0x7f3d140acda0 msgr2=0x7f3d140aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 --2- 172.21.15.96:0/1632318619 >> v2:172.21.15.155:3300/0 conn(0x7f3d140acda0 0x7f3d140aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1415fd60 con 0x7f3d140aef50 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f3d0c0019f0 con 0x7f3d140aef50 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 >> v1:172.21.15.96:6789/0 conn(0x7f3d140aef50 legacy=0x7f3d140722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc0039b0 0x7f3cfc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d1415c230 0x7f3cfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1415c610 con 0x7f3cfc004800 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3d140ad200 con 0x7f3cfc0039b0 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3cfc00ba70 con 0x7f3d1415c230 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.515+0000 7f3d19000640 1 --2- 172.21.15.96:0/1632318619 >> v2:172.21.15.155:3300/0 conn(0x7f3d140acda0 0x7f3d140aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.516+0000 7f3d19000640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.516+0000 7f3d1a400640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d1415c230 0x7f3cfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.516+0000 7f3d19a00640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc0039b0 0x7f3cfc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.516+0000 7f3d19000640 1 -- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d1415c230 msgr2=0x7f3cfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.516+0000 7f3d19000640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d1415c230 0x7f3cfc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.516+0000 7f3d19000640 1 -- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc0039b0 msgr2=0x7f3cfc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.516+0000 7f3d19000640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc0039b0 0x7f3cfc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.516+0000 7f3d19000640 1 -- 172.21.15.96:0/1632318619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc003520 con 0x7f3cfc004800 2024-04-24T23:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.516+0000 7f3d1a400640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d1415c230 0x7f3cfc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:59.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.517+0000 7f3d19000640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3d00006fd0 tx=0x7f3cfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2794e68ea33cdbc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.517+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00037070 con 0x7f3cfc004800 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.518+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0002ace0 con 0x7f3cfc004800 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.518+0000 7f3d13e00640 1 -- 172.21.15.96:0/1632318619 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000f040 con 0x7f3cfc004800 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.518+0000 7f3d1c400640 1 -- 172.21.15.96:0/1632318619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc004800 msgr2=0x7f3cfc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.518+0000 7f3d1c400640 1 --2- 172.21.15.96:0/1632318619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3d00006fd0 tx=0x7f3cfc005830 comp rx=0 tx=0).stop 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.518+0000 7f3d1a400640 1 -- 172.21.15.96:0/1632318619 reap_dead start 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.518+0000 7f3d1c400640 1 -- 172.21.15.96:0/1632318619 shutdown_connections 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.518+0000 7f3d1c400640 1 -- 172.21.15.96:0/1632318619 >> 172.21.15.96:0/1632318619 conn(0x7f3d140b19c0 msgr2=0x7f3d140b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.518+0000 7f3d1c400640 1 -- 172.21.15.96:0/1632318619 shutdown_connections 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.518+0000 7f3d1c400640 1 -- 172.21.15.96:0/1632318619 wait complete. 2024-04-24T23:59:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.520+0000 7f3d1c400640 1 Processor -- start 2024-04-24T23:59:59.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.520+0000 7f3d1c400640 1 -- start start 2024-04-24T23:59:59.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.521+0000 7f3d1c400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d14153820 0x7f3d1415e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.521+0000 7f3d1c400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d1409aa70 0x7f3d140b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.521+0000 7f3d1c400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1415ec80 0x7f3d140b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.521+0000 7f3d1c400640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14160600 con 0x7f3d1409aa70 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.521+0000 7f3d1c400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14160320 con 0x7f3d1415ec80 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.521+0000 7f3d1c400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3d140af3e0 con 0x7f3d14153820 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.521+0000 7f3d19000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d1409aa70 0x7f3d140b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.521+0000 7f3d19000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d1409aa70 0x7f3d140b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58166/0 (socket says 172.21.15.96:58166) 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.521+0000 7f3d19000640 1 -- 172.21.15.96:0/3344149613 learned_addr learned my addr 172.21.15.96:0/3344149613 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.522+0000 7f3d19000640 1 -- 172.21.15.96:0/3344149613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d14153820 msgr2=0x7f3d1415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.522+0000 7f3d19000640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d14153820 0x7f3d1415e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.522+0000 7f3d19000640 1 -- 172.21.15.96:0/3344149613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1415ec80 msgr2=0x7f3d140b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.522+0000 7f3d19000640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1415ec80 0x7f3d140b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.522+0000 7f3d19000640 1 -- 172.21.15.96:0/3344149613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1409af00 con 0x7f3d1409aa70 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.522+0000 7f3d19000640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d1409aa70 0x7f3d140b4360 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3d00035040 tx=0x7f3d00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.522+0000 7f3d11600640 1 -- 172.21.15.96:0/3344149613 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00040020 con 0x7f3d1409aa70 2024-04-24T23:59:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.522+0000 7f3d11600640 1 -- 172.21.15.96:0/3344149613 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d00038040 con 0x7f3d1409aa70 2024-04-24T23:59:59.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.522+0000 7f3d11600640 1 -- 172.21.15.96:0/3344149613 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00037070 con 0x7f3d1409aa70 2024-04-24T23:59:59.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.523+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1409b1e0 con 0x7f3d1409aa70 2024-04-24T23:59:59.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.523+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1409b7a0 con 0x7f3d1409aa70 2024-04-24T23:59:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.524+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d14069110 con 0x7f3d1409aa70 2024-04-24T23:59:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.525+0000 7f3d11600640 1 -- 172.21.15.96:0/3344149613 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f3d00043020 con 0x7f3d1409aa70 2024-04-24T23:59:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.525+0000 7f3d11600640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3cf406bfe0 0x7f3cf406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.526+0000 7f3d11600640 1 -- 172.21.15.96:0/3344149613 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f3d000aaeb0 con 0x7f3d1409aa70 2024-04-24T23:59:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.526+0000 7f3d19a00640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3cf406bfe0 0x7f3cf406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.526+0000 7f3d19a00640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3cf406bfe0 0x7f3cf406e4a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3d08006a90 tx=0x7f3d08006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.530+0000 7f3d11600640 1 -- 172.21.15.96:0/3344149613 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3d0004a030 con 0x7f3d1409aa70 2024-04-24T23:59:59.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.725+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f3d140aeb70 con 0x7f3cf406bfe0 2024-04-24T23:59:59.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.726+0000 7f3d11600640 1 -- 172.21.15.96:0/3344149613 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d140aeb70 con 0x7f3cf406bfe0 2024-04-24T23:59:59.726 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 6 to deep-scrub 2024-04-24T23:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.728+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3cf406bfe0 msgr2=0x7f3cf406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3cf406bfe0 0x7f3cf406e4a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3d08006a90 tx=0x7f3d08006a20 comp rx=0 tx=0).stop 2024-04-24T23:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d1409aa70 msgr2=0x7f3d140b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d1409aa70 0x7f3d140b4360 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3d00035040 tx=0x7f3d00004730 comp rx=0 tx=0).stop 2024-04-24T23:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 shutdown_connections 2024-04-24T23:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d1415ec80 0x7f3d140b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f3cf406bfe0 0x7f3cf406e4a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d1409aa70 0x7f3d140b4360 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 --2- 172.21.15.96:0/3344149613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d14153820 0x7f3d1415e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 >> 172.21.15.96:0/3344149613 conn(0x7f3d140b19c0 msgr2=0x7f3d1406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:59.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 shutdown_connections 2024-04-24T23:59:59.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.729+0000 7f3d1c400640 1 -- 172.21.15.96:0/3344149613 wait complete. 2024-04-24T23:59:59.748 INFO:tasks.ceph:Scrubbing osd.7 2024-04-24T23:59:59.748 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:59:59.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.953+0000 7f76f7e00640 1 Processor -- start 2024-04-24T23:59:59.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.954+0000 7f76f7e00640 1 -- start start 2024-04-24T23:59:59.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.955+0000 7f76f7e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f76f00b33d0 0x7f76f015f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.955+0000 7f76f7e00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f00730c0 con 0x7f76f015e4a0 2024-04-24T23:59:59.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.955+0000 7f76f7e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f0072de0 con 0x7f76f0072900 2024-04-24T23:59:59.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.955+0000 7f76f7e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f76f00710c0 con 0x7f76f00b33d0 2024-04-24T23:59:59.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.956+0000 7f76f5400640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f76f015e4a0 0x7f76f0071ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:38788/0 (socket says 172.21.15.96:38788) 2024-04-24T23:59:59.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.956+0000 7f76f5400640 1 -- 172.21.15.96:0/1951459894 learned_addr learned my addr 172.21.15.96:0/1951459894 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-24T23:59:59.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.956+0000 7f76f5e00640 1 --2- 172.21.15.96:0/1951459894 >> v2:172.21.15.155:3300/0 conn(0x7f76f00b33d0 0x7f76f015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.956+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897442399 0 0) 0x7f76f00730c0 con 0x7f76f015e4a0 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.956+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76d8003520 con 0x7f76f015e4a0 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3953528853 0 0) 0x7f76d8003520 con 0x7f76f015e4a0 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 >> v2:172.21.15.155:3300/0 conn(0x7f76f00b33d0 msgr2=0x7f76f015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 --2- 172.21.15.96:0/1951459894 >> v2:172.21.15.155:3300/0 conn(0x7f76f00b33d0 0x7f76f015f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 >> v1:172.21.15.155:6789/0 conn(0x7f76f0072900 legacy=0x7f76f00b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f00713a0 con 0x7f76f015e4a0 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f76e4001670 con 0x7f76f015e4a0 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 >> v1:172.21.15.96:6789/0 conn(0x7f76f015e4a0 legacy=0x7f76f0071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d8003a00 0x7f76d8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d8004800 0x7f76d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f76f00710c0 con 0x7f76d80051c0 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76d800c0c0 con 0x7f76d8004800 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f76d800c2c0 con 0x7f76d8003a00 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76f5e00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.957+0000 7f76f4a00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d8004800 0x7f76d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.958+0000 7f76f5400640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d8003a00 0x7f76d8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.958+0000 7f76f5e00640 1 -- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d8003a00 msgr2=0x7f76d8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.958+0000 7f76f5e00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d8003a00 0x7f76d8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.958+0000 7f76f5e00640 1 -- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d8004800 msgr2=0x7f76d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.958+0000 7f76f5e00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d8004800 0x7f76d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.958+0000 7f76f5e00640 1 -- 172.21.15.96:0/1951459894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d8003520 con 0x7f76d80051c0 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.958+0000 7f76f4a00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d8004800 0x7f76d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:59:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.958+0000 7f76f5400640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d8003a00 0x7f76d8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:59:59.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.959+0000 7f76f5e00640 1 -- 172.21.15.96:0/1951459894 reap_dead start 2024-04-24T23:59:59.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.959+0000 7f76f5e00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76d800b9c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009fc0 tx=0x7f76d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc1fb2a919b14aa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.959+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8035020 con 0x7f76d80051c0 2024-04-24T23:59:59.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.959+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e8003bd0 con 0x7f76d80051c0 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.959+0000 7f76efe00640 1 -- 172.21.15.96:0/1951459894 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8009c10 con 0x7f76d80051c0 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.960+0000 7f76f7e00640 1 -- 172.21.15.96:0/1951459894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 msgr2=0x7f76d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.960+0000 7f76f7e00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76d800b9c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009fc0 tx=0x7f76d8005830 comp rx=0 tx=0).stop 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.960+0000 7f76f7e00640 1 -- 172.21.15.96:0/1951459894 shutdown_connections 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.960+0000 7f76f7e00640 1 --2- 172.21.15.96:0/1951459894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76d800b9c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.960+0000 7f76f7e00640 1 -- 172.21.15.96:0/1951459894 >> 172.21.15.96:0/1951459894 conn(0x7f76f00b19c0 msgr2=0x7f76f00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.960+0000 7f76f7e00640 1 -- 172.21.15.96:0/1951459894 shutdown_connections 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.960+0000 7f76f7e00640 1 -- 172.21.15.96:0/1951459894 wait complete. 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.962+0000 7f76f7e00640 1 Processor -- start 2024-04-24T23:59:59.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.962+0000 7f76f7e00640 1 -- start start 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f7e00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76f0153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f7e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f00addf0 0x7f76f00ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f01565c0 0x7f76f0156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f7e00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f76f015f380 con 0x7f76d80051c0 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f7e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76f00b5110 con 0x7f76f00addf0 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f7e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f76f015f500 con 0x7f76f01565c0 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f5400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76f0153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f5400640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76f0153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58192/0 (socket says 172.21.15.96:58192) 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f5400640 1 -- 172.21.15.96:0/3103854218 learned_addr learned my addr 172.21.15.96:0/3103854218 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f4a00640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f00addf0 0x7f76f00ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f5e00640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f01565c0 0x7f76f0156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f5400640 1 -- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f01565c0 msgr2=0x7f76f0156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f5400640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f01565c0 0x7f76f0156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.963+0000 7f76f5400640 1 -- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f00addf0 msgr2=0x7f76f00ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.964+0000 7f76f5400640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f00addf0 0x7f76f00ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.964+0000 7f76f5400640 1 -- 172.21.15.96:0/3103854218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f0154b80 con 0x7f76d80051c0 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.964+0000 7f76f5400640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76f0153e80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f76e400d770 tx=0x7f76e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.964+0000 7f76ed600640 1 -- 172.21.15.96:0/3103854218 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4019070 con 0x7f76d80051c0 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.964+0000 7f76ed600640 1 -- 172.21.15.96:0/3103854218 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e40074e0 con 0x7f76d80051c0 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.964+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f0154e20 con 0x7f76d80051c0 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.964+0000 7f76ed600640 1 -- 172.21.15.96:0/3103854218 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e40049e0 con 0x7f76d80051c0 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.964+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f01553e0 con 0x7f76d80051c0 2024-04-24T23:59:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.965+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76f0069110 con 0x7f76d80051c0 2024-04-24T23:59:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.967+0000 7f76ed600640 1 -- 172.21.15.96:0/3103854218 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f76e401c070 con 0x7f76d80051c0 2024-04-24T23:59:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.967+0000 7f76ed600640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f76d406c010 0x7f76d406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.968+0000 7f76ed600640 1 -- 172.21.15.96:0/3103854218 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f76e408a9a0 con 0x7f76d80051c0 2024-04-24T23:59:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.968+0000 7f76ed600640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f76d4071ed0 0x7f76d40742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:59:59.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.968+0000 7f76ed600640 1 -- 172.21.15.96:0/3103854218 --> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76d40749a0 con 0x7f76d4071ed0 2024-04-24T23:59:59.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.968+0000 7f76f4a00640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f76d406c010 0x7f76d406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.968+0000 7f76ed600640 1 -- 172.21.15.96:0/3103854218 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f76e408f2a0 con 0x7f76d80051c0 2024-04-24T23:59:59.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.968+0000 7f76f5e00640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f76d4071ed0 0x7f76d40742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:59:59.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.968+0000 7f76f4a00640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f76d406c010 0x7f76d406e4d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f76e0000c00 tx=0x7f76e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.969+0000 7f76f5e00640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f76d4071ed0 0x7f76d40742f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:59:59.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.971+0000 7f76ed600640 1 -- 172.21.15.96:0/3103854218 <== osd.7 v2:172.21.15.155:6816/654840370 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76d40749a0 con 0x7f76d4071ed0 2024-04-24T23:59:59.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.986+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 --> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f76f00af180 con 0x7f76d4071ed0 2024-04-24T23:59:59.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.987+0000 7f76ed600640 1 -- 172.21.15.96:0/3103854218 <== osd.7 v2:172.21.15.155:6816/654840370 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f76f00af180 con 0x7f76d4071ed0 2024-04-24T23:59:59.989 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-24T23:59:59.989 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:59:59.989 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-24T23:59:59.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f76d4071ed0 msgr2=0x7f76d40742f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.155:6816/654840370,v1:172.21.15.155:6817/654840370] conn(0x7f76d4071ed0 0x7f76d40742f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f76d406c010 msgr2=0x7f76d406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f76d406c010 0x7f76d406e4d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f76e0000c00 tx=0x7f76e0009040 comp rx=0 tx=0).stop 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 msgr2=0x7f76f0153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 --2- 172.21.15.96:0/3103854218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76d80051c0 0x7f76f0153e80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f76e400d770 tx=0x7f76e400dc30 comp rx=0 tx=0).stop 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f5e00640 1 -- 172.21.15.96:0/3103854218 reap_dead start 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 shutdown_connections 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 >> 172.21.15.96:0/3103854218 conn(0x7f76f00b19c0 msgr2=0x7f76f015f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 shutdown_connections 2024-04-24T23:59:59.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-24T23:59:59.988+0000 7f76f7e00640 1 -- 172.21.15.96:0/3103854218 wait complete. 2024-04-25T00:00:00.005 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T00:00:00.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.204+0000 7f4d99600640 1 Processor -- start 2024-04-25T00:00:00.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.204+0000 7f4d99600640 1 -- start start 2024-04-25T00:00:00.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.205+0000 7f4d99600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4d9415e4d0 0x7f4d940b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.205+0000 7f4d99600640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4d9406f880 0x7f4d940d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.205+0000 7f4d99600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d940aff90 con 0x7f4d9415e0f0 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.205+0000 7f4d99600640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4d940b5ad0 con 0x7f4d9406f880 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.205+0000 7f4d99600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4d940b5d00 con 0x7f4d9415e4d0 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.206+0000 7f4d98c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4d9406f880 0x7f4d940d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.206+0000 7f4d98c00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4d9406f880 0x7f4d940d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58194/0 (socket says 172.21.15.96:58194) 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.206+0000 7f4d98c00640 1 -- 172.21.15.96:0/4239461434 learned_addr learned my addr 172.21.15.96:0/4239461434 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.206+0000 7f4d93400640 1 --2- 172.21.15.96:0/4239461434 >> v2:172.21.15.155:3300/0 conn(0x7f4d9415e4d0 0x7f4d940b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.206+0000 7f4d98c00640 1 -- 172.21.15.96:0/4239461434 >> v2:172.21.15.155:3300/0 conn(0x7f4d9415e4d0 msgr2=0x7f4d940b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.206+0000 7f4d98c00640 1 --2- 172.21.15.96:0/4239461434 >> v2:172.21.15.155:3300/0 conn(0x7f4d9415e4d0 0x7f4d940b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.206+0000 7f4d98c00640 1 -- 172.21.15.96:0/4239461434 >> v1:172.21.15.155:6789/0 conn(0x7f4d9415e0f0 legacy=0x7f4d94162770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.206+0000 7f4d98c00640 1 -- 172.21.15.96:0/4239461434 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d940b6280 con 0x7f4d9406f880 2024-04-25T00:00:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.206+0000 7f4d93400640 1 --2- 172.21.15.96:0/4239461434 >> v2:172.21.15.155:3300/0 conn(0x7f4d9415e4d0 0x7f4d940b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.207+0000 7f4d98c00640 1 --2- 172.21.15.96:0/4239461434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d9406f880 0x7f4d940d1030 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4d9406c130 tx=0x7f4d8c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb810a371b8adc9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.208+0000 7f4d92a00640 1 -- 172.21.15.96:0/4239461434 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c036070 con 0x7f4d9406f880 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.208+0000 7f4d92a00640 1 -- 172.21.15.96:0/4239461434 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c031600 con 0x7f4d9406f880 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.208+0000 7f4d92a00640 1 -- 172.21.15.96:0/4239461434 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0319d0 con 0x7f4d9406f880 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.208+0000 7f4d99600640 1 -- 172.21.15.96:0/4239461434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d9406f880 msgr2=0x7f4d940d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.208+0000 7f4d99600640 1 --2- 172.21.15.96:0/4239461434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d9406f880 0x7f4d940d1030 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4d9406c130 tx=0x7f4d8c02a5d0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.208+0000 7f4d99600640 1 -- 172.21.15.96:0/4239461434 shutdown_connections 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.208+0000 7f4d99600640 1 --2- 172.21.15.96:0/4239461434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d9406f880 0x7f4d940d1030 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.208+0000 7f4d99600640 1 --2- 172.21.15.96:0/4239461434 >> v2:172.21.15.155:3300/0 conn(0x7f4d9415e4d0 0x7f4d940b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.208+0000 7f4d99600640 1 -- 172.21.15.96:0/4239461434 >> 172.21.15.96:0/4239461434 conn(0x7f4d9406c3b0 msgr2=0x7f4d9406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.209+0000 7f4d99600640 1 -- 172.21.15.96:0/4239461434 shutdown_connections 2024-04-25T00:00:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.209+0000 7f4d99600640 1 -- 172.21.15.96:0/4239461434 wait complete. 2024-04-25T00:00:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.210+0000 7f4d99600640 1 Processor -- start 2024-04-25T00:00:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.211+0000 7f4d99600640 1 -- start start 2024-04-25T00:00:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d99600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d9406f880 0x7f4d9406dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d99600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d9415e0f0 0x7f4d94160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d99600640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d94153fe0 0x7f4d94140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d99600640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94162250 con 0x7f4d94153fe0 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d99600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94161f70 con 0x7f4d9406f880 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d99600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4d940d1570 con 0x7f4d9415e0f0 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d98c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d94153fe0 0x7f4d94140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d98c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d94153fe0 0x7f4d94140d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58202/0 (socket says 172.21.15.96:58202) 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d98c00640 1 -- 172.21.15.96:0/1082700325 learned_addr learned my addr 172.21.15.96:0/1082700325 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d98c00640 1 -- 172.21.15.96:0/1082700325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d9415e0f0 msgr2=0x7f4d94160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d98c00640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d9415e0f0 0x7f4d94160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d98c00640 1 -- 172.21.15.96:0/1082700325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d9406f880 msgr2=0x7f4d9406dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d93e00640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d9406f880 0x7f4d9406dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d98c00640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d9406f880 0x7f4d9406dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d98c00640 1 -- 172.21.15.96:0/1082700325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9415ea60 con 0x7f4d94153fe0 2024-04-25T00:00:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.212+0000 7f4d93e00640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d9406f880 0x7f4d9406dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T00:00:00.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.213+0000 7f4d98c00640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d94153fe0 0x7f4d94140d90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009f40 tx=0x7f4d8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:00.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.213+0000 7f4d8be00640 1 -- 172.21.15.96:0/1082700325 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c036050 con 0x7f4d94153fe0 2024-04-25T00:00:00.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.213+0000 7f4d8be00640 1 -- 172.21.15.96:0/1082700325 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c042070 con 0x7f4d94153fe0 2024-04-25T00:00:00.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.213+0000 7f4d8be00640 1 -- 172.21.15.96:0/1082700325 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c007bf0 con 0x7f4d94153fe0 2024-04-25T00:00:00.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.213+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9415ed40 con 0x7f4d94153fe0 2024-04-25T00:00:00.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.213+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d94160a50 con 0x7f4d94153fe0 2024-04-25T00:00:00.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.215+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d940756b0 con 0x7f4d94153fe0 2024-04-25T00:00:00.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.216+0000 7f4d8be00640 1 -- 172.21.15.96:0/1082700325 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f4d8c047460 con 0x7f4d94153fe0 2024-04-25T00:00:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.216+0000 7f4d8be00640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d7406bfe0 0x7f4d7406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.217+0000 7f4d8be00640 1 -- 172.21.15.96:0/1082700325 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f4d8c0ac060 con 0x7f4d94153fe0 2024-04-25T00:00:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.217+0000 7f4d93e00640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d7406bfe0 0x7f4d7406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.217+0000 7f4d93e00640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d7406bfe0 0x7f4d7406e4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4d84003eb0 tx=0x7f4d84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:00.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.221+0000 7f4d8be00640 1 -- 172.21.15.96:0/1082700325 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4d940aff90 con 0x7f4d94153fe0 2024-04-25T00:00:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.422+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f4d94160c20 con 0x7f4d7406bfe0 2024-04-25T00:00:00.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.423+0000 7f4d8be00640 1 -- 172.21.15.96:0/1082700325 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4d94160c20 con 0x7f4d7406bfe0 2024-04-25T00:00:00.423 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d7406bfe0 msgr2=0x7f4d7406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d7406bfe0 0x7f4d7406e4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4d84003eb0 tx=0x7f4d84009040 comp rx=0 tx=0).stop 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d94153fe0 msgr2=0x7f4d94140d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d94153fe0 0x7f4d94140d90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009f40 tx=0x7f4d8c004a40 comp rx=0 tx=0).stop 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 shutdown_connections 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f4d7406bfe0 0x7f4d7406e4a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d94153fe0 0x7f4d94140d90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d9415e0f0 0x7f4d94160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 --2- 172.21.15.96:0/1082700325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d9406f880 0x7f4d9406dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.425+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 >> 172.21.15.96:0/1082700325 conn(0x7f4d9406c3b0 msgr2=0x7f4d94156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.426+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 shutdown_connections 2024-04-25T00:00:00.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.426+0000 7f4d99600640 1 -- 172.21.15.96:0/1082700325 wait complete. 2024-04-25T00:00:00.445 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T00:00:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.646+0000 7fd0fe200640 1 Processor -- start 2024-04-25T00:00:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.646+0000 7fd0fe200640 1 -- start start 2024-04-25T00:00:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0fe200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f81553f0 0x7fd0f815b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0fe200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd0f80cdbd0 0x7fd0f80cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0fe200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd0f8070d60 0x7fd0f80711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0fe200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd0f80cf6e0 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0fe200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd0f80ce100 con 0x7fd0f8070d60 2024-04-25T00:00:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0fe200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd0f80ce3e0 con 0x7fd0f81553f0 2024-04-25T00:00:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0efe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd0f80cdbd0 0x7fd0f80cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0efe00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd0f80cdbd0 0x7fd0f80cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58214/0 (socket says 172.21.15.96:58214) 2024-04-25T00:00:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0efe00640 1 -- 172.21.15.96:0/2349134045 learned_addr learned my addr 172.21.15.96:0/2349134045 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T00:00:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.648+0000 7fd0fce00640 1 --2- 172.21.15.96:0/2349134045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f81553f0 0x7fd0f815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.649+0000 7fd0fd800640 1 --2- 172.21.15.96:0/2349134045 >> v2:172.21.15.155:3300/0 conn(0x7fd0f8070d60 0x7fd0f80711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.649+0000 7fd0efe00640 1 -- 172.21.15.96:0/2349134045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f81553f0 msgr2=0x7fd0f815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.649+0000 7fd0efe00640 1 --2- 172.21.15.96:0/2349134045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f81553f0 0x7fd0f815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.649+0000 7fd0efe00640 1 -- 172.21.15.96:0/2349134045 >> v2:172.21.15.155:3300/0 conn(0x7fd0f8070d60 msgr2=0x7fd0f80711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.649+0000 7fd0efe00640 1 --2- 172.21.15.96:0/2349134045 >> v2:172.21.15.155:3300/0 conn(0x7fd0f8070d60 0x7fd0f80711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.649+0000 7fd0efe00640 1 -- 172.21.15.96:0/2349134045 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f80ce6c0 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.649+0000 7fd0fce00640 1 --2- 172.21.15.96:0/2349134045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f81553f0 0x7fd0f815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T00:00:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.649+0000 7fd0fd800640 1 --2- 172.21.15.96:0/2349134045 >> v2:172.21.15.155:3300/0 conn(0x7fd0f8070d60 0x7fd0f80711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T00:00:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.650+0000 7fd0efe00640 1 --2- 172.21.15.96:0/2349134045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 0x7fd0f80cf1a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8073210 tx=0x7fd0e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5a977ba1b49ea2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.650+0000 7fd0f7e00640 1 -- 172.21.15.96:0/2349134045 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0037070 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.650+0000 7fd0f7e00640 1 -- 172.21.15.96:0/2349134045 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0032440 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.650+0000 7fd0f7e00640 1 -- 172.21.15.96:0/2349134045 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0032810 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.651+0000 7fd0fe200640 1 -- 172.21.15.96:0/2349134045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 msgr2=0x7fd0f80cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.651+0000 7fd0fe200640 1 --2- 172.21.15.96:0/2349134045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 0x7fd0f80cf1a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8073210 tx=0x7fd0e002a1e0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.651+0000 7fd0fe200640 1 -- 172.21.15.96:0/2349134045 shutdown_connections 2024-04-25T00:00:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.651+0000 7fd0fe200640 1 --2- 172.21.15.96:0/2349134045 >> v2:172.21.15.155:3300/0 conn(0x7fd0f8070d60 0x7fd0f80711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.651+0000 7fd0fe200640 1 --2- 172.21.15.96:0/2349134045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 0x7fd0f80cf1a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.651+0000 7fd0fe200640 1 --2- 172.21.15.96:0/2349134045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f81553f0 0x7fd0f815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.651+0000 7fd0fe200640 1 -- 172.21.15.96:0/2349134045 >> 172.21.15.96:0/2349134045 conn(0x7fd0f80b1f10 msgr2=0x7fd0f80cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.651+0000 7fd0fe200640 1 -- 172.21.15.96:0/2349134045 shutdown_connections 2024-04-25T00:00:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.651+0000 7fd0fe200640 1 -- 172.21.15.96:0/2349134045 wait complete. 2024-04-25T00:00:00.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.653+0000 7fd0fe200640 1 Processor -- start 2024-04-25T00:00:00.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.653+0000 7fd0fe200640 1 -- start start 2024-04-25T00:00:00.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fe200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f8070d60 0x7fd0f81509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fe200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 0x7fd0f80aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fe200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f81553f0 0x7fd0f81523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fe200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f806cdb0 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fe200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f806cc30 con 0x7fd0f81553f0 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fe200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd0f81557d0 con 0x7fd0f8070d60 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0efe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 0x7fd0f80aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0efe00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 0x7fd0f80aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58230/0 (socket says 172.21.15.96:58230) 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0efe00640 1 -- 172.21.15.96:0/1470448020 learned_addr learned my addr 172.21.15.96:0/1470448020 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fce00640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f8070d60 0x7fd0f81509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0efe00640 1 -- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f8070d60 msgr2=0x7fd0f81509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0efe00640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f8070d60 0x7fd0f81509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0efe00640 1 -- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f81553f0 msgr2=0x7fd0f81523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fd800640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f81553f0 0x7fd0f81523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0efe00640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f81553f0 0x7fd0f81523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0efe00640 1 -- 172.21.15.96:0/1470448020 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f8152da0 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fce00640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f8070d60 0x7fd0f81509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T00:00:00.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.654+0000 7fd0fd800640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f81553f0 0x7fd0f81523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T00:00:00.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.655+0000 7fd0efe00640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 0x7fd0f80aed40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd0e002a220 tx=0x7fd0e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:00.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.655+0000 7fd0f5600640 1 -- 172.21.15.96:0/1470448020 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0037040 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.655+0000 7fd0f5600640 1 -- 172.21.15.96:0/1470448020 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0042070 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.655+0000 7fd0f5600640 1 -- 172.21.15.96:0/1470448020 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0030bb0 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.655+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f8153080 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.655+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f80ae820 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.656+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0f8067e40 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.657+0000 7fd0f5600640 1 -- 172.21.15.96:0/1470448020 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fd0e0047460 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.658+0000 7fd0f5600640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0d406bfe0 0x7fd0d406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:00.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.658+0000 7fd0f5600640 1 -- 172.21.15.96:0/1470448020 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fd0e00abaf0 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.658+0000 7fd0fce00640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0d406bfe0 0x7fd0d406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:00.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.659+0000 7fd0fce00640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0d406bfe0 0x7fd0d406e4a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8006fd0 tx=0x7fd0e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:00.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.662+0000 7fd0f5600640 1 -- 172.21.15.96:0/1470448020 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd0e0045360 con 0x7fd0f80cdbd0 2024-04-25T00:00:00.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.860+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0f80756b0 con 0x7fd0d406bfe0 2024-04-25T00:00:00.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.862+0000 7fd0f5600640 1 -- 172.21.15.96:0/1470448020 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13350 (secure 0 0 0) 0x7fd0f80756b0 con 0x7fd0d406bfe0 2024-04-25T00:00:00.863 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T00:00:00.863 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-25T00:00:00.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0d406bfe0 msgr2=0x7fd0d406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0d406bfe0 0x7fd0d406e4a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8006fd0 tx=0x7fd0e8008040 comp rx=0 tx=0).stop 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 msgr2=0x7fd0f80aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 0x7fd0f80aed40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd0e002a220 tx=0x7fd0e00046c0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 shutdown_connections 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f81553f0 0x7fd0f81523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7fd0d406bfe0 0x7fd0d406e4a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0f80cdbd0 0x7fd0f80aed40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 --2- 172.21.15.96:0/1470448020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0f8070d60 0x7fd0f81509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 >> 172.21.15.96:0/1470448020 conn(0x7fd0f80b1f10 msgr2=0x7fd0f815b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 shutdown_connections 2024-04-25T00:00:00.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:00.865+0000 7fd0fe200640 1 -- 172.21.15.96:0/1470448020 wait complete. 2024-04-25T00:00:00.884 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-04-25T00:00:00.335581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224768,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749952,"statfs":{"total":773094113280,"available":772863950848,"internally_reserved":0,"allocated":4530176,"data_stored":2496152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003131"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-24T23:59:48.135647+0000","last_change":"2024-04-24T23:57:55.884371+0000","last_active":"2024-04-24T23:59:48.135647+0000","last_peered":"2024-04-24T23:59:48.135647+0000","last_clean":"2024-04-24T23:59:48.135647+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-24T23:59:48.135647+0000","last_undegraded":"2024-04-24T23:59:48.135647+0000","last_fullsized":"2024-04-24T23:59:48.135647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:57:54.618614+0000","last_clean_scrub_stamp":"2024-04-24T23:57:54.618614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:32.985999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T00:00:00.887 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T23:57:54.618614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=57, tm_sec=54, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=59, tm_sec=53, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-25T00:00:00.887 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T00:00:20.888 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T00:00:21.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.101+0000 7f5dcee00640 1 Processor -- start 2024-04-25T00:00:21.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.101+0000 7f5dcee00640 1 -- start start 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.103+0000 7f5dcee00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b4ec0 0x7f5dc80cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.103+0000 7f5dcee00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5dc80ccc20 0x7f5dc8070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.103+0000 7f5dcee00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc815fa90 con 0x7f5dc815f6b0 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.103+0000 7f5dcee00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc80b4a30 con 0x7f5dc80ccc20 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.103+0000 7f5dcee00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc80b3e20 con 0x7f5dc80b4ec0 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.103+0000 7f5dcd000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b4ec0 0x7f5dc80cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.103+0000 7f5dcda00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5dc815f6b0 0x7f5dc80ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.96:36782/0 (socket says 172.21.15.96:36782) 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.104+0000 7f5dcda00640 1 -- 172.21.15.96:0/2764421102 learned_addr learned my addr 172.21.15.96:0/2764421102 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.104+0000 7f5dce400640 1 --2- 172.21.15.96:0/2764421102 >> v2:172.21.15.155:3300/0 conn(0x7f5dc80ccc20 0x7f5dc8070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.104+0000 7f5dcd000640 1 -- 172.21.15.96:0/2764421102 >> v2:172.21.15.155:3300/0 conn(0x7f5dc80ccc20 msgr2=0x7f5dc8070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.104+0000 7f5dc7e00640 1 -- 172.21.15.96:0/2764421102 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 19538643 0 0) 0x7f5dc815fa90 con 0x7f5dc815f6b0 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.104+0000 7f5dcd000640 1 --2- 172.21.15.96:0/2764421102 >> v2:172.21.15.155:3300/0 conn(0x7f5dc80ccc20 0x7f5dc8070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.104+0000 7f5dcd000640 1 -- 172.21.15.96:0/2764421102 >> v1:172.21.15.155:6789/0 conn(0x7f5dc815f6b0 legacy=0x7f5dc80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.104+0000 7f5dcd000640 1 -- 172.21.15.96:0/2764421102 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc80b4100 con 0x7f5dc80b4ec0 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.106+0000 7f5dcd000640 1 --2- 172.21.15.96:0/2764421102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b4ec0 0x7f5dc80cc6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5db40097a0 tx=0x7f5db402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e9fc2aafaff20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.106+0000 7f5dc7e00640 1 -- 172.21.15.96:0/2764421102 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4037070 con 0x7f5dc80b4ec0 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.106+0000 7f5dc7e00640 1 -- 172.21.15.96:0/2764421102 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db4032440 con 0x7f5dc80b4ec0 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.106+0000 7f5dc7e00640 1 -- 172.21.15.96:0/2764421102 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4032810 con 0x7f5dc80b4ec0 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.107+0000 7f5dcee00640 1 -- 172.21.15.96:0/2764421102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b4ec0 msgr2=0x7f5dc80cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.107+0000 7f5dcee00640 1 --2- 172.21.15.96:0/2764421102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b4ec0 0x7f5dc80cc6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5db40097a0 tx=0x7f5db402a180 comp rx=0 tx=0).stop 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.107+0000 7f5dcee00640 1 -- 172.21.15.96:0/2764421102 shutdown_connections 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.107+0000 7f5dcee00640 1 --2- 172.21.15.96:0/2764421102 >> v2:172.21.15.155:3300/0 conn(0x7f5dc80ccc20 0x7f5dc8070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.107+0000 7f5dcee00640 1 --2- 172.21.15.96:0/2764421102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc80b4ec0 0x7f5dc80cc6e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.107+0000 7f5dcee00640 1 -- 172.21.15.96:0/2764421102 >> 172.21.15.96:0/2764421102 conn(0x7f5dc80b1f10 msgr2=0x7f5dc80cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.107+0000 7f5dcee00640 1 -- 172.21.15.96:0/2764421102 shutdown_connections 2024-04-25T00:00:21.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.107+0000 7f5dcee00640 1 -- 172.21.15.96:0/2764421102 wait complete. 2024-04-25T00:00:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.109+0000 7f5dcee00640 1 Processor -- start 2024-04-25T00:00:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.109+0000 7f5dcee00640 1 -- start start 2024-04-25T00:00:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.110+0000 7f5dcee00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc80b4ec0 0x7f5dc80caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.110+0000 7f5dcee00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dc80ccc20 0x7f5dc8071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.110+0000 7f5dcee00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc815f6b0 0x7f5dc8071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.110+0000 7f5dcee00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc80cf1c0 con 0x7f5dc80ccc20 2024-04-25T00:00:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.110+0000 7f5dcee00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc80b46c0 con 0x7f5dc80b4ec0 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.110+0000 7f5dcee00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc80b3a40 con 0x7f5dc815f6b0 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.110+0000 7f5dcd000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dc80ccc20 0x7f5dc8071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dcd000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dc80ccc20 0x7f5dc8071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52888/0 (socket says 172.21.15.96:52888) 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dcd000640 1 -- 172.21.15.96:0/2464882314 learned_addr learned my addr 172.21.15.96:0/2464882314 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dce400640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc815f6b0 0x7f5dc8071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dcda00640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc80b4ec0 0x7f5dc80caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dcd000640 1 -- 172.21.15.96:0/2464882314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc815f6b0 msgr2=0x7f5dc8071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dcd000640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc815f6b0 0x7f5dc8071cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dcd000640 1 -- 172.21.15.96:0/2464882314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc80b4ec0 msgr2=0x7f5dc80caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dcd000640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc80b4ec0 0x7f5dc80caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dcd000640 1 -- 172.21.15.96:0/2464882314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc80caa00 con 0x7f5dc80ccc20 2024-04-25T00:00:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.111+0000 7f5dcd000640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dc80ccc20 0x7f5dc8071770 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5db40097a0 tx=0x7f5db40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.112+0000 7f5dc5600640 1 -- 172.21.15.96:0/2464882314 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4037050 con 0x7f5dc80ccc20 2024-04-25T00:00:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.112+0000 7f5dc5600640 1 -- 172.21.15.96:0/2464882314 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db4038040 con 0x7f5dc80ccc20 2024-04-25T00:00:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.112+0000 7f5dc5600640 1 -- 172.21.15.96:0/2464882314 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4004490 con 0x7f5dc80ccc20 2024-04-25T00:00:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.112+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc806d080 con 0x7f5dc80ccc20 2024-04-25T00:00:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.112+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc806d640 con 0x7f5dc80ccc20 2024-04-25T00:00:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.113+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc8067e40 con 0x7f5dc80ccc20 2024-04-25T00:00:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.114+0000 7f5dc5600640 1 -- 172.21.15.96:0/2464882314 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f5db403c6d0 con 0x7f5dc80ccc20 2024-04-25T00:00:21.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.115+0000 7f5dc5600640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5da806bfe0 0x7f5da806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.115+0000 7f5dc5600640 1 -- 172.21.15.96:0/2464882314 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f5db40ab8c0 con 0x7f5dc80ccc20 2024-04-25T00:00:21.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.115+0000 7f5dcda00640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5da806bfe0 0x7f5da806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.116+0000 7f5dcda00640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5da806bfe0 0x7f5da806e4a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc000f60 tx=0x7f5dbc007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:21.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.120+0000 7f5dc5600640 1 -- 172.21.15.96:0/2464882314 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5dc80caa00 con 0x7f5dc80ccc20 2024-04-25T00:00:21.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.314+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 --> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5dc80cec00 con 0x7f5da806bfe0 2024-04-25T00:00:21.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.315+0000 7f5dc5600640 1 -- 172.21.15.96:0/2464882314 <== mgr.4101 v2:172.21.15.96:6832/2887634096 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13358 (secure 0 0 0) 0x7f5dc80cec00 con 0x7f5da806bfe0 2024-04-25T00:00:21.316 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T00:00:21.316 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-25T00:00:21.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5da806bfe0 msgr2=0x7f5da806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5da806bfe0 0x7f5da806e4a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc000f60 tx=0x7f5dbc007c00 comp rx=0 tx=0).stop 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dc80ccc20 msgr2=0x7f5dc8071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dc80ccc20 0x7f5dc8071770 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5db40097a0 tx=0x7f5db40046c0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 shutdown_connections 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dc815f6b0 0x7f5dc8071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f5da806bfe0 0x7f5da806e4a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dc80ccc20 0x7f5dc8071770 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 --2- 172.21.15.96:0/2464882314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dc80b4ec0 0x7f5dc80caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 >> 172.21.15.96:0/2464882314 conn(0x7f5dc80b1f10 msgr2=0x7f5dc8070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 shutdown_connections 2024-04-25T00:00:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.318+0000 7f5dcee00640 1 -- 172.21.15.96:0/2464882314 wait complete. 2024-04-25T00:00:21.339 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-04-25T00:00:20.341205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224756,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749964,"statfs":{"total":773094113280,"available":772863963136,"internally_reserved":0,"allocated":4530176,"data_stored":2496152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003366"},"pg_stats":[{"pgid":"1.0","version":"36'119","reported_seq":211,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T00:00:01.305566+0000","last_change":"2024-04-25T00:00:01.305645+0000","last_active":"2024-04-25T00:00:01.305566+0000","last_peered":"2024-04-25T00:00:01.305566+0000","last_clean":"2024-04-25T00:00:01.305566+0000","last_became_active":"2024-04-24T23:57:55.878497+0000","last_became_peered":"2024-04-24T23:57:55.878497+0000","last_unstale":"2024-04-25T00:00:01.305566+0000","last_undegraded":"2024-04-25T00:00:01.305566+0000","last_fullsized":"2024-04-25T00:00:01.305566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-04-25T00:00:01.305306+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-04-25T00:00:01.305306+0000","last_clean_scrub_stamp":"2024-04-25T00:00:01.305306+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:40.283757+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1011712,"data_stored":754795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T00:00:21.340 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T00:00:21.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.532+0000 7f79ef200640 1 Processor -- start 2024-04-25T00:00:21.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.532+0000 7f79ef200640 1 -- start start 2024-04-25T00:00:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.534+0000 7f79ef200640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f79f015cfe0 0x7f79f00cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.534+0000 7f79ef200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79f01415d0 0x7f79f0141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.534+0000 7f79ef200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f00ce620 con 0x7f79f013ef60 2024-04-25T00:00:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.534+0000 7f79ef200640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f79f00ce900 con 0x7f79f015cfe0 2024-04-25T00:00:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.534+0000 7f79ef200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79f00cebe0 con 0x7f79f01415d0 2024-04-25T00:00:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.534+0000 7f79ed400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f79f015cfe0 0x7f79f00cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.534+0000 7f79ed400640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f79f015cfe0 0x7f79f00cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52896/0 (socket says 172.21.15.96:52896) 2024-04-25T00:00:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.534+0000 7f79ed400640 1 -- 172.21.15.96:0/1046526279 learned_addr learned my addr 172.21.15.96:0/1046526279 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T00:00:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.534+0000 7f79ee800640 1 --2- 172.21.15.96:0/1046526279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79f01415d0 0x7f79f0141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.535+0000 7f79ed400640 1 -- 172.21.15.96:0/1046526279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79f01415d0 msgr2=0x7f79f0141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.535+0000 7f79ed400640 1 --2- 172.21.15.96:0/1046526279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79f01415d0 0x7f79f0141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.535+0000 7f79ed400640 1 -- 172.21.15.96:0/1046526279 >> v1:172.21.15.155:6789/0 conn(0x7f79f013ef60 legacy=0x7f79f00cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.535+0000 7f79ed400640 1 -- 172.21.15.96:0/1046526279 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f00ccb10 con 0x7f79f015cfe0 2024-04-25T00:00:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.536+0000 7f79ed400640 1 --2- 172.21.15.96:0/1046526279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f015cfe0 0x7f79f00cc5d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009870 tx=0x7f79dc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc1ea29b4e242da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.536+0000 7f79eca00640 1 -- 172.21.15.96:0/1046526279 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc037070 con 0x7f79f015cfe0 2024-04-25T00:00:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.536+0000 7f79eca00640 1 -- 172.21.15.96:0/1046526279 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79dc032440 con 0x7f79f015cfe0 2024-04-25T00:00:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.536+0000 7f79eca00640 1 -- 172.21.15.96:0/1046526279 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc032810 con 0x7f79f015cfe0 2024-04-25T00:00:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.537+0000 7f79ef200640 1 -- 172.21.15.96:0/1046526279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f015cfe0 msgr2=0x7f79f00cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.537+0000 7f79ef200640 1 --2- 172.21.15.96:0/1046526279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f015cfe0 0x7f79f00cc5d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009870 tx=0x7f79dc02a210 comp rx=0 tx=0).stop 2024-04-25T00:00:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.537+0000 7f79ef200640 1 -- 172.21.15.96:0/1046526279 shutdown_connections 2024-04-25T00:00:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.537+0000 7f79ef200640 1 --2- 172.21.15.96:0/1046526279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79f01415d0 0x7f79f0141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.537+0000 7f79ef200640 1 --2- 172.21.15.96:0/1046526279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f015cfe0 0x7f79f00cc5d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.537+0000 7f79ef200640 1 -- 172.21.15.96:0/1046526279 >> 172.21.15.96:0/1046526279 conn(0x7f79f00b18b0 msgr2=0x7f79f00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.537+0000 7f79ef200640 1 -- 172.21.15.96:0/1046526279 shutdown_connections 2024-04-25T00:00:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.537+0000 7f79ef200640 1 -- 172.21.15.96:0/1046526279 wait complete. 2024-04-25T00:00:21.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.539+0000 7f79ef200640 1 Processor -- start 2024-04-25T00:00:21.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.539+0000 7f79ef200640 1 -- start start 2024-04-25T00:00:21.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.540+0000 7f79ef200640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f013ef60 0x7f79f00716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.540+0000 7f79ef200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79f01415d0 0x7f79f0139580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.540+0000 7f79ef200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79f015cfe0 0x7f79f00c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.540+0000 7f79ef200640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f79f006cba0 con 0x7f79f013ef60 2024-04-25T00:00:21.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.540+0000 7f79ef200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79f006ca20 con 0x7f79f01415d0 2024-04-25T00:00:21.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.540+0000 7f79ef200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79f006cd20 con 0x7f79f015cfe0 2024-04-25T00:00:21.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.540+0000 7f79ede00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f013ef60 0x7f79f00716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.540+0000 7f79ede00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f013ef60 0x7f79f00716b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52902/0 (socket says 172.21.15.96:52902) 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.540+0000 7f79ede00640 1 -- 172.21.15.96:0/3020425128 learned_addr learned my addr 172.21.15.96:0/3020425128 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79ede00640 1 -- 172.21.15.96:0/3020425128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79f015cfe0 msgr2=0x7f79f00c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79ede00640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79f015cfe0 0x7f79f00c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79ede00640 1 -- 172.21.15.96:0/3020425128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79f01415d0 msgr2=0x7f79f0139580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79ede00640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79f01415d0 0x7f79f0139580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79ede00640 1 -- 172.21.15.96:0/3020425128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f0071ee0 con 0x7f79f013ef60 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79ede00640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f013ef60 0x7f79f00716b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c430 tx=0x7f79e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79e6000640 1 -- 172.21.15.96:0/3020425128 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0011790 con 0x7f79f013ef60 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79e6000640 1 -- 172.21.15.96:0/3020425128 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e0017070 con 0x7f79f013ef60 2024-04-25T00:00:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f00721c0 con 0x7f79f013ef60 2024-04-25T00:00:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79e6000640 1 -- 172.21.15.96:0/3020425128 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0011bb0 con 0x7f79f013ef60 2024-04-25T00:00:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.541+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f015b0f0 con 0x7f79f013ef60 2024-04-25T00:00:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.542+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f015aee0 con 0x7f79f013ef60 2024-04-25T00:00:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.543+0000 7f79e6000640 1 -- 172.21.15.96:0/3020425128 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f79e001c460 con 0x7f79f013ef60 2024-04-25T00:00:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.544+0000 7f79e6000640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f79d006c010 0x7f79d006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.544+0000 7f79e6000640 1 -- 172.21.15.96:0/3020425128 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f79e008ad90 con 0x7f79f013ef60 2024-04-25T00:00:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.545+0000 7f79ed400640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f79d006c010 0x7f79d006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.545+0000 7f79ed400640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f79d006c010 0x7f79d006e4d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f79dc034000 tx=0x7f79dc02c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:21.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.549+0000 7f79e6000640 1 -- 172.21.15.96:0/3020425128 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f79e0059720 con 0x7f79f013ef60 2024-04-25T00:00:21.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.749+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f79f00755d0 con 0x7f79f013ef60 2024-04-25T00:00:21.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.756+0000 7f79e6000640 1 -- 172.21.15.96:0/3020425128 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f79e0059020 con 0x7f79f013ef60 2024-04-25T00:00:21.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.759+0000 7f79e6000640 1 -- 172.21.15.96:0/3020425128 <== mon.0 v2:172.21.15.96:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f79e005d3d0 con 0x7f79f013ef60 2024-04-25T00:00:21.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.759+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f79d006c010 msgr2=0x7f79d006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.759+0000 7f79ef200640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f79d006c010 0x7f79d006e4d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f79dc034000 tx=0x7f79dc02c000 comp rx=0 tx=0).stop 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f013ef60 msgr2=0x7f79f00716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f013ef60 0x7f79f00716b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c430 tx=0x7f79e000c8f0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 shutdown_connections 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79f015cfe0 0x7f79f00c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79f01415d0 0x7f79f0139580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f79d006c010 0x7f79d006e4d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 --2- 172.21.15.96:0/3020425128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f013ef60 0x7f79f00716b0 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c430 tx=0x7f79e000c8f0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 >> 172.21.15.96:0/3020425128 conn(0x7f79f00b18b0 msgr2=0x7f79f00cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 shutdown_connections 2024-04-25T00:00:21.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.760+0000 7f79ef200640 1 -- 172.21.15.96:0/3020425128 wait complete. 2024-04-25T00:00:21.781 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T00:00:21.781 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T00:00:21.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.971+0000 7f7467c00640 1 Processor -- start 2024-04-25T00:00:21.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.971+0000 7f7467c00640 1 -- start start 2024-04-25T00:00:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.973+0000 7f7467c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74600af120 0x7f7460071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.973+0000 7f7467c00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7460160b20 con 0x7f74600acda0 2024-04-25T00:00:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.973+0000 7f7467c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74600ad230 con 0x7f746015c230 2024-04-25T00:00:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.973+0000 7f7467c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f746015c610 con 0x7f74600af120 2024-04-25T00:00:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.973+0000 7f7465c00640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f74600acda0 0x7f746006cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42294/0 (socket says 172.21.15.96:42294) 2024-04-25T00:00:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.973+0000 7f7465c00640 1 -- 172.21.15.96:0/1805699314 learned_addr learned my addr 172.21.15.96:0/1805699314 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352673956 0 0) 0x7f7460160b20 con 0x7f74600acda0 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745fe00640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74600af120 0x7f7460071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7448003520 con 0x7f74600acda0 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2197532323 0 0) 0x7f7448003520 con 0x7f74600acda0 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74600af120 msgr2=0x7f7460071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74600af120 0x7f7460071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 >> v1:172.21.15.155:6789/0 conn(0x7f746015c230 legacy=0x7f74600aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746015fd60 con 0x7f74600acda0 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2737105240 0 0) 0x7f74580019f0 con 0x7f74600acda0 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 >> v1:172.21.15.96:6789/0 conn(0x7f74600acda0 legacy=0x7f746006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74600af120 0x7f74480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7448003f60 0x7f7448004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7448004d40 0x7f74480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f746015c610 con 0x7f7448003f60 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f744800baa0 con 0x7f7448004d40 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f744800bca0 con 0x7f74600af120 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.974+0000 7f745fe00640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7448003f60 0x7f7448004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.975+0000 7f745fe00640 1 -- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74600af120 msgr2=0x7f74480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.975+0000 7f7465200640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74600af120 0x7f74480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.975+0000 7f7465c00640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7448004d40 0x7f74480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.975+0000 7f745fe00640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74600af120 0x7f74480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.975+0000 7f745fe00640 1 -- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7448004d40 msgr2=0x7f74480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.975+0000 7f745fe00640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7448004d40 0x7f74480051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.975+0000 7f745fe00640 1 -- 172.21.15.96:0/1805699314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7448003520 con 0x7f7448003f60 2024-04-25T00:00:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.975+0000 7f7465200640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74600af120 0x7f74480039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.976+0000 7f745fe00640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7448003f60 0x7f7448004800 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f744c009ac0 tx=0x7f7448005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda907fe51f65acd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.976+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c036070 con 0x7f7448003f60 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.976+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f744c031400 con 0x7f7448003f60 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.976+0000 7f745f400640 1 -- 172.21.15.96:0/1805699314 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c009690 con 0x7f7448003f60 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.977+0000 7f7467c00640 1 -- 172.21.15.96:0/1805699314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7448003f60 msgr2=0x7f7448004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.977+0000 7f7467c00640 1 --2- 172.21.15.96:0/1805699314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7448003f60 0x7f7448004800 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f744c009ac0 tx=0x7f7448005830 comp rx=0 tx=0).stop 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.977+0000 7f7465c00640 1 -- 172.21.15.96:0/1805699314 reap_dead start 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.977+0000 7f7467c00640 1 -- 172.21.15.96:0/1805699314 shutdown_connections 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.977+0000 7f7467c00640 1 -- 172.21.15.96:0/1805699314 >> 172.21.15.96:0/1805699314 conn(0x7f74600b19c0 msgr2=0x7f74600b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:21.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.977+0000 7f7467c00640 1 -- 172.21.15.96:0/1805699314 shutdown_connections 2024-04-25T00:00:21.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.977+0000 7f7467c00640 1 -- 172.21.15.96:0/1805699314 wait complete. 2024-04-25T00:00:21.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.979+0000 7f7467c00640 1 Processor -- start 2024-04-25T00:00:21.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.979+0000 7f7467c00640 1 -- start start 2024-04-25T00:00:21.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.980+0000 7f7467c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7448003f60 0x7f74600cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.980+0000 7f7467c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74601f3c70 0x7f74600b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.980+0000 7f7467c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74600c9040 0x7f74600cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.980+0000 7f7467c00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7460160600 con 0x7f74600c9040 2024-04-25T00:00:21.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.980+0000 7f7467c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7460160320 con 0x7f74601f3c70 2024-04-25T00:00:21.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.980+0000 7f7467c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74600ad4d0 con 0x7f7448003f60 2024-04-25T00:00:21.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.980+0000 7f7465c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74600c9040 0x7f74600cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.980+0000 7f7465c00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74600c9040 0x7f74600cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52924/0 (socket says 172.21.15.96:52924) 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.980+0000 7f7465c00640 1 -- 172.21.15.96:0/3025135616 learned_addr learned my addr 172.21.15.96:0/3025135616 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f7465200640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7448003f60 0x7f74600cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f7465c00640 1 -- 172.21.15.96:0/3025135616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7448003f60 msgr2=0x7f74600cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f7465c00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7448003f60 0x7f74600cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f745fe00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74601f3c70 0x7f74600b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f7465c00640 1 -- 172.21.15.96:0/3025135616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74601f3c70 msgr2=0x7f74600b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f7465c00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74601f3c70 0x7f74600b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f7465c00640 1 -- 172.21.15.96:0/3025135616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74600b4c20 con 0x7f74600c9040 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f7465200640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7448003f60 0x7f74600cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f7465c00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74600c9040 0x7f74600cdc40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7460073940 tx=0x7f745800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f745cc00640 1 -- 172.21.15.96:0/3025135616 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458004d60 con 0x7f74600c9040 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f745cc00640 1 -- 172.21.15.96:0/3025135616 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f745800bb80 con 0x7f74600c9040 2024-04-25T00:00:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74600cab60 con 0x7f74600c9040 2024-04-25T00:00:21.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.981+0000 7f745cc00640 1 -- 172.21.15.96:0/3025135616 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458007110 con 0x7f74600c9040 2024-04-25T00:00:21.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.982+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74601f44a0 con 0x7f74600c9040 2024-04-25T00:00:21.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.983+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7460069110 con 0x7f74600c9040 2024-04-25T00:00:21.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.984+0000 7f745cc00640 1 -- 172.21.15.96:0/3025135616 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f745801b020 con 0x7f74600c9040 2024-04-25T00:00:21.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.985+0000 7f745cc00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f744006c010 0x7f744006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:00:21.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.985+0000 7f745cc00640 1 -- 172.21.15.96:0/3025135616 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f745808b290 con 0x7f74600c9040 2024-04-25T00:00:21.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.985+0000 7f7465200640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f744006c010 0x7f744006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:00:21.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.986+0000 7f7465200640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f744006c010 0x7f744006e4d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f74540016b0 tx=0x7f7454009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:00:21.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:21.990+0000 7f745cc00640 1 -- 172.21.15.96:0/3025135616 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7458059b10 con 0x7f74600c9040 2024-04-25T00:00:22.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.231+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f746015b360 con 0x7f74600c9040 2024-04-25T00:00:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.232+0000 7f745cc00640 1 -- 172.21.15.96:0/3025135616 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3875 (secure 0 0 0) 0x7f7458059410 con 0x7f74600c9040 2024-04-25T00:00:22.232 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T00:00:22.232 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1875464528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1875464528},{"type":"v1","addr":"172.21.15.155:6835","nonce":1875464528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/2449705897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":2449705897},{"type":"v1","addr":"172.21.15.96:6837","nonce":2449705897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/4160377725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4160377725},{"type":"v1","addr":"172.21.15.155:6833","nonce":4160377725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1770630051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1770630051},{"type":"v1","addr":"172.21.15.96:6835","nonce":1770630051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-04-25T00:00:22.233 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2024-04-25T00:00:22.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f744006c010 msgr2=0x7f744006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:22.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f744006c010 0x7f744006e4d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f74540016b0 tx=0x7f7454009040 comp rx=0 tx=0).stop 2024-04-25T00:00:22.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74600c9040 msgr2=0x7f74600cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:00:22.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74600c9040 0x7f74600cdc40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7460073940 tx=0x7f745800b4a0 comp rx=0 tx=0).stop 2024-04-25T00:00:22.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 shutdown_connections 2024-04-25T00:00:22.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:6832/2887634096,v1:172.21.15.96:6833/2887634096] conn(0x7f744006c010 0x7f744006e4d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:22.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74600c9040 0x7f74600cdc40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:22.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74601f3c70 0x7f74600b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:22.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 --2- 172.21.15.96:0/3025135616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7448003f60 0x7f74600cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:00:22.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 >> 172.21.15.96:0/3025135616 conn(0x7f74600b19c0 msgr2=0x7f746015a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:00:22.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 shutdown_connections 2024-04-25T00:00:22.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T00:00:22.235+0000 7f7467c00640 1 -- 172.21.15.96:0/3025135616 wait complete. 2024-04-25T00:00:22.255 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T00:00:22.255 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T00:00:22.255 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T00:00:22.255 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.281 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T00:00:22.281 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T00:00:22.281 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.342 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T00:00:22.342 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T00:00:22.343 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.365 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T00:00:22.366 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T00:00:22.366 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.429 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T00:00:22.429 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T00:00:22.429 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T00:00:22.430 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.512 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T00:00:22.512 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T00:00:22.513 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.579 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T00:00:22.579 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T00:00:22.579 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.627 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T00:00:22.628 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T00:00:22.628 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.706 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T00:00:22.707 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T00:00:22.707 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.771 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T00:00:22.772 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T00:00:22.772 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.831 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T00:00:22.831 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T00:00:22.831 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.909 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T00:00:22.909 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T00:00:22.909 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:22.994 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T00:00:22.994 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T00:00:22.994 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T00:00:22.994 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:23.071 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T00:00:23.071 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T00:00:23.071 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:25.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-25T00:00:27.490 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:00:27.498 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:00:29.173 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T00:00:29.173 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T00:00:29.174 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T00:00:29.174 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:29.216 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T00:00:29.216 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T00:00:29.216 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:29.244 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T00:00:29.244 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T00:00:29.244 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T00:00:29.320 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T00:00:29.321 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T00:00:29.321 DEBUG:teuthology.orchestra.run.smithi096:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-04-25T00:00:29.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T00:00:29.426 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T00:00:29.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T00:00:29.591 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T00:00:29.728 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T00:00:29.728 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T00:00:29.874 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T00:00:29.875 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T00:00:30.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T00:00:30.034 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T00:00:30.260 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T00:00:30.261 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T00:00:30.399 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T00:00:30.399 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T00:00:30.521 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T00:00:30.522 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T00:00:30.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-25T00:00:30.667 INFO:tasks.ceph:Archiving mon data... 2024-04-25T00:00:30.668 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/data/mon.a.tgz 2024-04-25T00:00:30.668 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-25T00:00:30.727 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.TdrBei4mjw 2024-04-25T00:00:30.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.TdrBei4mjw 2024-04-25T00:00:30.895 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.TdrBei4mjw 2024-04-25T00:00:31.034 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.TdrBei4mjw is 360KB 2024-04-25T00:00:31.141 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.TdrBei4mjw 2024-04-25T00:00:31.194 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/data/mon.b.tgz 2024-04-25T00:00:31.195 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-25T00:00:31.241 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.hpnL8PEGy6 2024-04-25T00:00:31.241 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hpnL8PEGy6 2024-04-25T00:00:31.467 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.hpnL8PEGy6 2024-04-25T00:00:31.582 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.hpnL8PEGy6 is 492KB 2024-04-25T00:00:31.678 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.hpnL8PEGy6 2024-04-25T00:00:31.729 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/data/mon.c.tgz 2024-04-25T00:00:31.729 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-25T00:00:31.771 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.TaNYSaeAto 2024-04-25T00:00:31.771 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.TaNYSaeAto 2024-04-25T00:00:31.988 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.TaNYSaeAto 2024-04-25T00:00:32.096 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.TaNYSaeAto is 492KB 2024-04-25T00:00:32.190 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.TaNYSaeAto 2024-04-25T00:00:32.237 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T00:00:32.237 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T00:00:32.245 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T00:00:32.410 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T00:00:32.465 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T00:00:32.465 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T00:00:32.467 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/remote/smithi096/crash 2024-04-25T00:00:32.468 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T00:00:32.554 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/remote/smithi155/crash 2024-04-25T00:00:32.728 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T00:00:32.816 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T00:00:32.817 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:00:32.825 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:00:32.967 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T00:00:33.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T00:00:33.145 INFO:tasks.ceph:Compressing logs... 2024-04-25T00:00:33.146 DEBUG:teuthology.orchestra.run.smithi096:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T00:00:33.153 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T00:00:33.231 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48178.log 2024-04-25T00:00:33.232 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38921.log 2024-04-25T00:00:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49414.log 2024-04-25T00:00:33.233 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48178.log.gz 2024-04-25T00:00:33.234 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40139.log 2024-04-25T00:00:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.38921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2024-04-25T00:00:33.234 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38921.log.gz 2024-04-25T00:00:33.236 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-04-25T00:00:33.236 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49414.log.gz 2024-04-25T00:00:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2024-04-25T00:00:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.40139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40139.log.gz 2024-04-25T00:00:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T00:00:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33488.log 2024-04-25T00:00:33.238 INFO:teuthology.orchestra.run.smithi155.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2024-04-25T00:00:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T00:00:33.238 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48033.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2024-04-25T00:00:33.239 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48640.log 2024-04-25T00:00:33.239 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2024-04-25T00:00:33.239 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-04-25T00:00:33.239 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48640.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48640.log.gz 2024-04-25T00:00:33.239 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41278.log 2024-04-25T00:00:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40534.log 2024-04-25T00:00:33.240 INFO:teuthology.orchestra.run.smithi096.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2024-04-25T00:00:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44987.log 2024-04-25T00:00:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33488.log: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T00:00:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T00:00:33.241 INFO:teuthology.orchestra.run.smithi155.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33488.log.gz 2024-04-25T00:00:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T00:00:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T00:00:33.241 INFO:teuthology.orchestra.run.smithi155.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T00:00:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T00:00:33.243 INFO:teuthology.orchestra.run.smithi096.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41278.log.gz 2024-04-25T00:00:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47597.log 2024-04-25T00:00:33.244 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40534.log.gz 2024-04-25T00:00:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39430.log 2024-04-25T00:00:33.244 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44987.log.gz 2024-04-25T00:00:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44819.log 2024-04-25T00:00:33.244 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47597.log.gz 2024-04-25T00:00:33.245 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T00:00:33.245 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T00:00:33.246 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39262.log 2024-04-25T00:00:33.246 INFO:teuthology.orchestra.run.smithi096.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39430.log.gz 2024-04-25T00:00:33.246 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2024-04-25T00:00:33.246 INFO:teuthology.orchestra.run.smithi096.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44819.log.gz 2024-04-25T00:00:33.247 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33608.log 2024-04-25T00:00:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49590.log 2024-04-25T00:00:33.248 INFO:teuthology.orchestra.run.smithi096.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39262.log.gz 2024-04-25T00:00:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46836.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2024-04-25T00:00:33.248 INFO:teuthology.orchestra.run.smithi096.stderr: /var/log/ceph/ceph-client.admin.44525.log 2024-04-25T00:00:33.248 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T00:00:33.249 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33608.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33608.log.gz 2024-04-25T00:00:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40199.log 2024-04-25T00:00:33.249 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49590.log.gz 2024-04-25T00:00:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44525.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2024-04-25T00:00:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2024-04-25T00:00:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46794.log 2024-04-25T00:00:33.251 INFO:teuthology.orchestra.run.smithi096.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40199.log.gz 2024-04-25T00:00:33.252 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46696.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2024-04-25T00:00:33.252 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49506.log 2024-04-25T00:00:33.252 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.6.log: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T00:00:33.252 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.39126.log 2024-04-25T00:00:33.253 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47183.log 2024-04-25T00:00:33.253 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33399.log 2024-04-25T00:00:33.254 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2024-04-25T00:00:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47865.log 2024-04-25T00:00:33.254 INFO:teuthology.orchestra.run.smithi096.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49506.log.gz 2024-04-25T00:00:33.255 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.39126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.39540.log 2024-04-25T00:00:33.255 INFO:teuthology.orchestra.run.smithi155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.39126.log.gz 2024-04-25T00:00:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49330.log 2024-04-25T00:00:33.255 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47183.log.gz 2024-04-25T00:00:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48892.log 2024-04-25T00:00:33.256 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47865.log.gz 2024-04-25T00:00:33.257 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33448.log 2024-04-25T00:00:33.257 INFO:teuthology.orchestra.run.smithi155.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33399.log.gz 2024-04-25T00:00:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49330.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49330.log.gz 2024-04-25T00:00:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49372.log 2024-04-25T00:00:33.258 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.3.39540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33648.log 2024-04-25T00:00:33.258 INFO:teuthology.orchestra.run.smithi155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.39540.log.gz 2024-04-25T00:00:33.258 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-04-25T00:00:33.259 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48892.log.gz 2024-04-25T00:00:33.260 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33448.log: gzip -5 --verbose 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33448.log.gz 2024-04-25T00:00:33.260 INFO:teuthology.orchestra.run.smithi155.stderr: -- /var/log/ceph/ceph-client.1.39145.log 2024-04-25T00:00:33.261 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49372.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T00:00:33.261 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49372.log.gz 2024-04-25T00:00:33.261 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47907.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-04-25T00:00:33.261 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45273.log 2024-04-25T00:00:33.262 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33648.log: gzip -5 --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33648.log.gz 2024-04-25T00:00:33.262 INFO:teuthology.orchestra.run.smithi155.stderr: -- /var/log/ceph/ceph-client.1.40143.log/var/log/ceph/ceph-client.1.39145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.39145.log.gz 2024-04-25T00:00:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41362.log 2024-04-25T00:00:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45273.log: 84.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T00:00:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40198.log 2024-04-25T00:00:33.263 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45273.log.gz 2024-04-25T00:00:33.264 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-25T00:00:33.264 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45653.log 2024-04-25T00:00:33.265 INFO:teuthology.orchestra.run.smithi096.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.41362.log.gz 2024-04-25T00:00:33.265 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33357.log 2024-04-25T00:00:33.266 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43535.log 2024-04-25T00:00:33.266 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40198.log.gz 2024-04-25T00:00:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.40143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40143.log.gz 2024-04-25T00:00:33.267 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45653.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45653.log.gz 2024-04-25T00:00:33.267 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45359.log 2024-04-25T00:00:33.268 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43535.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43535.log.gzgzip 2024-04-25T00:00:33.268 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 2024-04-25T00:00:33.269 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33357.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33357.log.gz 2024-04-25T00:00:33.269 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.39544.log 2024-04-25T00:00:33.269 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48430.log 2024-04-25T00:00:33.269 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45359.log.gz 2024-04-25T00:00:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46594.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T00:00:33.270 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2024-04-25T00:00:33.271 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33528.log 2024-04-25T00:00:33.271 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44777.log 2024-04-25T00:00:33.272 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.2.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48430.log.gz 2024-04-25T00:00:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.3.39544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.39544.log.gz 2024-04-25T00:00:33.272 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45922.log 2024-04-25T00:00:33.273 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33528.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33528.log.gz 2024-04-25T00:00:33.273 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42878.log 2024-04-25T00:00:33.273 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44777.log.gz 2024-04-25T00:00:33.274 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T00:00:33.275 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45922.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27029.log 2024-04-25T00:00:33.275 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45922.log.gz 2024-04-25T00:00:33.275 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T00:00:33.276 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47471.log 2024-04-25T00:00:33.276 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42878.log.gz 2024-04-25T00:00:33.276 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.tmp-client.admin.27029.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27029.log.gz 2024-04-25T00:00:33.276 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47781.log 2024-04-25T00:00:33.277 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47309.log 2024-04-25T00:00:33.278 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47471.log.gz 2024-04-25T00:00:33.278 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T00:00:33.279 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39863.log 2024-04-25T00:00:33.279 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47781.log.gz 2024-04-25T00:00:33.280 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42920.log 2024-04-25T00:00:33.280 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2024-04-25T00:00:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.42325.log 2024-04-25T00:00:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42920.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39863.log.gz 2024-04-25T00:00:33.282 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42920.log.gz 2024-04-25T00:00:33.282 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43949.log 2024-04-25T00:00:33.283 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.2.42325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.42325.log.gz 2024-04-25T00:00:33.283 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33471.log 2024-04-25T00:00:33.284 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44395.log 2024-04-25T00:00:33.284 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43949.log.gz 2024-04-25T00:00:33.285 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.33471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45569.log 2024-04-25T00:00:33.285 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33471.log.gz 2024-04-25T00:00:33.286 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43703.log 2024-04-25T00:00:33.286 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44395.log.gz 2024-04-25T00:00:33.287 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45569.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T00:00:33.287 INFO:teuthology.orchestra.run.smithi096.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45569.log.gz 2024-04-25T00:00:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48934.log 2024-04-25T00:00:33.288 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43703.log.gz 2024-04-25T00:00:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45834.log 2024-04-25T00:00:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48934.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48934.log.gz 2024-04-25T00:00:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42542.log 2024-04-25T00:00:33.291 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45834.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T00:00:33.291 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45834.log.gz 2024-04-25T00:00:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47991.log 2024-04-25T00:00:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44346.log 2024-04-25T00:00:33.293 INFO:teuthology.orchestra.run.smithi096.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42542.log.gz 2024-04-25T00:00:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-04-25T00:00:33.294 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gz 2024-04-25T00:00:33.295 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2024-04-25T00:00:33.295 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44346.log.gz 2024-04-25T00:00:33.296 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-04-25T00:00:33.296 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-04-25T00:00:33.297 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44440.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2024-04-25T00:00:33.297 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42500.log 2024-04-25T00:00:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49060.log 2024-04-25T00:00:33.298 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-04-25T00:00:33.299 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42500.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42500.log.gz -5 2024-04-25T00:00:33.300 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40816.log 2024-04-25T00:00:33.301 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41500.log 2024-04-25T00:00:33.301 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T00:00:33.302 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49060.log.gz 2024-04-25T00:00:33.302 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40816.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40816.log.gz 2024-04-25T00:00:33.302 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47225.log 2024-04-25T00:00:33.303 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39388.log 2024-04-25T00:00:33.303 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41500.log.gz 2024-04-25T00:00:33.304 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44567.log 2024-04-25T00:00:33.304 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47225.log.gz 2024-04-25T00:00:33.305 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40533.log 2024-04-25T00:00:33.305 INFO:teuthology.orchestra.run.smithi096.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39388.log.gz 2024-04-25T00:00:33.306 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49162.log 2024-04-25T00:00:33.307 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40533.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44567.log.gz 2024-04-25T00:00:33.307 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40533.log.gz 2024-04-25T00:00:33.308 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2024-04-25T00:00:33.308 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46878.log 2024-04-25T00:00:33.309 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49162.log.gz 2024-04-25T00:00:33.310 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43619.log 2024-04-25T00:00:33.310 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-04-25T00:00:33.311 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39220.log 2024-04-25T00:00:33.311 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46878.log.gz 2024-04-25T00:00:33.312 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43619.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T00:00:33.312 INFO:teuthology.orchestra.run.smithi096.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43619.log.gz 2024-04-25T00:00:33.313 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43340.log 2024-04-25T00:00:33.313 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39220.log.gz 2024-04-25T00:00:33.314 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48682.log 2024-04-25T00:00:33.315 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41320.log 2024-04-25T00:00:33.315 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43340.log.gz 2024-04-25T00:00:33.316 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46132.log 2024-04-25T00:00:33.317 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48682.log.gz 2024-04-25T00:00:33.317 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41320.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41320.log.gz 2024-04-25T00:00:33.318 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45443.log 2024-04-25T00:00:33.319 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49288.log 2024-04-25T00:00:33.319 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46132.log.gz 2024-04-25T00:00:33.320 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45443.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45443.log.gz 2024-04-25T00:00:33.320 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.42321.log 2024-04-25T00:00:33.321 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40774.log 2024-04-25T00:00:33.321 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49288.log.gz 2024-04-25T00:00:33.321 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.2.42321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.42321.log.gz 2024-04-25T00:00:33.322 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42584.log 2024-04-25T00:00:33.323 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-04-25T00:00:33.323 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40774.log.gz 2024-04-25T00:00:33.324 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39132.log 2024-04-25T00:00:33.324 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42584.log.gz 2024-04-25T00:00:33.325 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44482.log 2024-04-25T00:00:33.325 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2024-04-25T00:00:33.326 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39132.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-mds.c.log -- replaced with /var/log/ceph/ceph-client.admin.39132.log.gz 2024-04-25T00:00:33.326 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-04-25T00:00:33.327 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46090.log 2024-04-25T00:00:33.328 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2024-04-25T00:00:33.328 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33087.log 2024-04-25T00:00:33.330 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46090.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46090.log.gz 2024-04-25T00:00:33.330 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47655.log 2024-04-25T00:00:33.332 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.33087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45697.log 2024-04-25T00:00:33.332 INFO:teuthology.orchestra.run.smithi096.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33087.log.gz 2024-04-25T00:00:33.333 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38744.log 2024-04-25T00:00:33.333 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47655.log.gz 2024-04-25T00:00:33.335 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46636.log 2024-04-25T00:00:33.335 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45697.log.gz 2024-04-25T00:00:33.335 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.38744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49550.log 2024-04-25T00:00:33.337 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38744.log.gz 2024-04-25T00:00:33.337 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40535.log 2024-04-25T00:00:33.337 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46636.log.gz 2024-04-25T00:00:33.339 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49550.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49550.log.gz 2024-04-25T00:00:33.339 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46920.log 2024-04-25T00:00:33.339 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2024-04-25T00:00:33.340 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40535.log.gz 2024-04-25T00:00:33.340 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43907.log 2024-04-25T00:00:33.340 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46920.log.gz 2024-04-25T00:00:33.342 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39556.log 2024-04-25T00:00:33.342 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2024-04-25T00:00:33.343 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43781.log 2024-04-25T00:00:33.343 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43907.log.gz 2024-04-25T00:00:33.344 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47949.log 2024-04-25T00:00:33.345 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39556.log.gz 2024-04-25T00:00:33.346 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43781.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T00:00:33.346 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43781.log.gz 2024-04-25T00:00:33.347 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47949.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47949.log.gz 2024-04-25T00:00:33.347 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43865.log 2024-04-25T00:00:33.348 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T00:00:33.349 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43865.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43865.log.gz 2024-04-25T00:00:33.349 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48850.log 2024-04-25T00:00:33.350 INFO:teuthology.orchestra.run.smithi155.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T00:00:33.350 INFO:teuthology.orchestra.run.smithi155.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T00:00:33.351 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42752.log 2024-04-25T00:00:33.352 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47070.log 2024-04-25T00:00:33.352 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48850.log.gz 2024-04-25T00:00:33.353 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42752.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42752.log.gz 2024-04-25T00:00:33.354 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44735.log 2024-04-25T00:00:33.355 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-04-25T00:00:33.355 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47070.log.gz 2024-04-25T00:00:33.356 INFO:teuthology.orchestra.run.smithi155.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T00:00:33.357 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40942.log 2024-04-25T00:00:33.357 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44735.log.gz 2024-04-25T00:00:33.358 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42962.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T00:00:33.358 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2024-04-25T00:00:33.359 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46282.log 2024-04-25T00:00:33.360 INFO:teuthology.orchestra.run.smithi096.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40942.log.gz 2024-04-25T00:00:33.360 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.0.log: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T00:00:33.361 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48220.log 2024-04-25T00:00:33.362 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38840.log 2024-04-25T00:00:33.362 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46282.log.gz 2024-04-25T00:00:33.363 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48220.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48220.log.gz 2024-04-25T00:00:33.365 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.38840.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38840.log.gz 2024-04-25T00:00:33.365 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45231.log 2024-04-25T00:00:33.366 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40858.log 2024-04-25T00:00:33.368 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44903.log 2024-04-25T00:00:33.368 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45231.log.gz 2024-04-25T00:00:33.369 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40858.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40858.log.gz 2024-04-25T00:00:33.371 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44903.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44903.log.gz 2024-04-25T00:00:33.371 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43256.log 2024-04-25T00:00:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40531.log 2024-04-25T00:00:33.373 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49115.log 2024-04-25T00:00:33.374 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43256.log.gz 2024-04-25T00:00:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44651.log 2024-04-25T00:00:33.375 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40531.log.gz 2024-04-25T00:00:33.376 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49115.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42017.log 2024-04-25T00:00:33.376 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49115.log.gz 2024-04-25T00:00:33.378 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43130.log 2024-04-25T00:00:33.378 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44651.log.gz 2024-04-25T00:00:33.380 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42017.log: gzip -5 --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42017.log.gz 2024-04-25T00:00:33.380 INFO:teuthology.orchestra.run.smithi096.stderr: /var/log/ceph/ceph-client.admin.46048.log 2024-04-25T00:00:33.381 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43130.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43130.log.gz 2024-04-25T00:00:33.381 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42836.log 2024-04-25T00:00:33.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48304.log 2024-04-25T00:00:33.383 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46048.log.gz 2024-04-25T00:00:33.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46474.log 2024-04-25T00:00:33.383 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42836.log.gz 2024-04-25T00:00:33.384 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39858.log 2024-04-25T00:00:33.384 INFO:teuthology.orchestra.run.smithi096.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48304.log.gz 2024-04-25T00:00:33.385 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.46474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48766.log 2024-04-25T00:00:33.386 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46474.log.gz 2024-04-25T00:00:33.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39858.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45611.log 2024-04-25T00:00:33.387 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39858.log.gz 2024-04-25T00:00:33.388 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48766.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T00:00:33.388 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48766.log.gz 2024-04-25T00:00:33.389 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45611.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45611.log.gz 2024-04-25T00:00:33.390 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49204.log 2024-04-25T00:00:33.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41068.log 2024-04-25T00:00:33.392 INFO:teuthology.orchestra.run.smithi155.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T00:00:33.393 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49204.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49204.log.gz 2024-04-25T00:00:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41068.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41068.log.gz 2024-04-25T00:00:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39304.log 2024-04-25T00:00:33.396 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46174.log 2024-04-25T00:00:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39304.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39304.log.gz 2024-04-25T00:00:33.398 INFO:teuthology.orchestra.run.smithi155.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T00:00:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46174.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46174.log.gz 2024-04-25T00:00:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39856.log 2024-04-25T00:00:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40526.log 2024-04-25T00:00:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39856.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39856.log.gz 2024-04-25T00:00:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40526.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40526.log.gz 2024-04-25T00:00:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43661.log 2024-04-25T00:00:33.406 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39859.log 2024-04-25T00:00:33.407 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43661.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43661.log.gz 2024-04-25T00:00:33.409 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39859.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39859.log.gz 2024-04-25T00:00:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49632.log 2024-04-25T00:00:33.417 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44165.log 2024-04-25T00:00:33.417 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49632.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49632.log.gz 2024-04-25T00:00:33.417 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44165.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44165.log.gz 2024-04-25T00:00:33.417 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39346.log 2024-04-25T00:00:33.417 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46986.log 2024-04-25T00:00:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39346.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39346.log.gz 2024-04-25T00:00:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46986.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46986.log.gz 2024-04-25T00:00:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39682.log 2024-04-25T00:00:33.420 INFO:teuthology.orchestra.run.smithi155.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T00:00:33.422 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46470.log 2024-04-25T00:00:33.422 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39682.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39682.log.gz 2024-04-25T00:00:33.424 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.46470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41026.log 2024-04-25T00:00:33.425 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46470.log.gz 2024-04-25T00:00:33.425 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48117.log 2024-04-25T00:00:33.426 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-25T00:00:33.426 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m0.220s 2024-04-25T00:00:33.426 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m0.788s 2024-04-25T00:00:33.427 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.174s 2024-04-25T00:00:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41026.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41026.log.gz 2024-04-25T00:00:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48117.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48117.log.gz 2024-04-25T00:00:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38963.log 2024-04-25T00:00:33.430 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39864.log 2024-04-25T00:00:33.431 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.38963.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38963.log.gz 2024-04-25T00:00:33.433 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39864.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39864.log.gz 2024-04-25T00:00:33.433 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43172.log 2024-04-25T00:00:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39598.log 2024-04-25T00:00:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43172.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43172.log.gz 2024-04-25T00:00:33.438 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39598.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39598.log.gz 2024-04-25T00:00:33.438 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39514.log 2024-04-25T00:00:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39176.log 2024-04-25T00:00:33.441 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39514.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39514.log.gz 2024-04-25T00:00:33.443 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39176.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39176.log.gz 2024-04-25T00:00:33.443 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44285.log 2024-04-25T00:00:33.445 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45485.log 2024-04-25T00:00:33.446 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44285.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44285.log.gz 2024-04-25T00:00:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45485.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45485.log.gz 2024-04-25T00:00:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48262.log 2024-04-25T00:00:33.450 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48724.log 2024-04-25T00:00:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48262.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48262.log.gz 2024-04-25T00:00:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48724.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48724.log.gz 2024-04-25T00:00:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39847.log 2024-04-25T00:00:33.455 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2024-04-25T00:00:33.455 INFO:teuthology.orchestra.run.smithi096.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T00:00:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39006.log 2024-04-25T00:00:33.457 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39847.log.gz 2024-04-25T00:00:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40200.log 2024-04-25T00:00:33.458 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2024-04-25T00:00:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39006.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39006.log.gz 2024-04-25T00:00:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5/var/log/ceph/ceph-client.admin.40200.log: --verbose -- /var/log/ceph/ceph-client.admin.40197.log 2024-04-25T00:00:33.460 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40200.log.gz 2024-04-25T00:00:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40900.log 2024-04-25T00:00:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39090.log 2024-04-25T00:00:33.463 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40197.log.gz 2024-04-25T00:00:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40900.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40900.log.gz 2024-04-25T00:00:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39860.log 2024-04-25T00:00:33.466 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39090.log.gz 2024-04-25T00:00:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45792.log 2024-04-25T00:00:33.469 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42710.log 2024-04-25T00:00:33.469 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39860.log.gz 2024-04-25T00:00:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40524.log 2024-04-25T00:00:33.470 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45792.log.gz 2024-04-25T00:00:33.471 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42710.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42710.log.gz 2024-04-25T00:00:33.472 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47697.log 2024-04-25T00:00:33.472 INFO:teuthology.orchestra.run.smithi096.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T00:00:33.472 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40524.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40524.log.gz 2024-04-25T00:00:33.472 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40194.log 2024-04-25T00:00:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47823.log 2024-04-25T00:00:33.474 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47697.log.gz 2024-04-25T00:00:33.475 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2024-04-25T00:00:33.475 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40194.log.gz 2024-04-25T00:00:33.476 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2024-04-25T00:00:33.477 INFO:teuthology.orchestra.run.smithi096.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47823.log.gz 2024-04-25T00:00:33.478 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47555.log 2024-04-25T00:00:33.478 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2024-04-25T00:00:33.478 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42458.log 2024-04-25T00:00:33.479 INFO:teuthology.orchestra.run.smithi096.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2024-04-25T00:00:33.480 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47028.log 2024-04-25T00:00:33.480 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47555.log.gz 2024-04-25T00:00:33.481 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42458.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42458.log.gz 2024-04-25T00:00:33.481 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42668.log 2024-04-25T00:00:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48808.log 2024-04-25T00:00:33.483 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47028.log.gz 2024-04-25T00:00:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45876.log 2024-04-25T00:00:33.484 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42668.log.gz 2024-04-25T00:00:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48808.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48808.log.gz 2024-04-25T00:00:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44693.log 2024-04-25T00:00:33.486 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40984.log 2024-04-25T00:00:33.486 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45876.log.gz 2024-04-25T00:00:33.487 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44693.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44693.log.gz 2024-04-25T00:00:33.487 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45151.log 2024-04-25T00:00:33.488 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39472.log 2024-04-25T00:00:33.489 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40984.log.gz 2024-04-25T00:00:33.489 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41110.log 2024-04-25T00:00:33.490 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45151.log.gz 2024-04-25T00:00:33.491 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39472.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47267.log 2024-04-25T00:00:33.491 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39472.log.gz 2024-04-25T00:00:33.492 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2024-04-25T00:00:33.492 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41110.log.gz 2024-04-25T00:00:33.493 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47739.log 2024-04-25T00:00:33.493 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47267.log.gz 2024-04-25T00:00:33.494 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44945.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2024-04-25T00:00:33.494 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2024-04-25T00:00:33.495 INFO:teuthology.orchestra.run.smithi096.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T00:00:33.495 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41152.log 2024-04-25T00:00:33.496 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47739.log.gz 2024-04-25T00:00:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39640.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2024-04-25T00:00:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40481.log 2024-04-25T00:00:33.498 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48388.log 2024-04-25T00:00:33.498 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41152.log.gz 2024-04-25T00:00:33.499 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40481.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40481.log.gz 2024-04-25T00:00:33.499 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44207.log 2024-04-25T00:00:33.500 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2024-04-25T00:00:33.500 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48388.log.gz 2024-04-25T00:00:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44207.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44207.log.gz 2024-04-25T00:00:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42794.log 2024-04-25T00:00:33.502 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45401.log 2024-04-25T00:00:33.503 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2024-04-25T00:00:33.503 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.42794.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42794.log.gz 2024-04-25T00:00:33.504 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49246.log 2024-04-25T00:00:33.505 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38634.log 2024-04-25T00:00:33.506 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45401.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45401.log.gz 2024-04-25T00:00:33.506 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49246.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49246.log.gz 2024-04-25T00:00:33.506 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49018.log 2024-04-25T00:00:33.507 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.38634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47351.log 2024-04-25T00:00:33.508 INFO:teuthology.orchestra.run.smithi096.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T00:00:33.508 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38634.log.gz 2024-04-25T00:00:33.509 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49018.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49018.log.gz 2024-04-25T00:00:33.509 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40536.log 2024-04-25T00:00:33.509 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44861.log 2024-04-25T00:00:33.510 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47351.log: /var/log/ceph/ceph-client.admin.40536.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47351.log.gz 2024-04-25T00:00:33.510 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41236.log 2024-04-25T00:00:33.510 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40536.log.gz 2024-04-25T00:00:33.511 INFO:teuthology.orchestra.run.smithi096.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T00:00:33.511 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41194.log 2024-04-25T00:00:33.512 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44861.log.gz 2024-04-25T00:00:33.512 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49457.log 2024-04-25T00:00:33.512 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41236.log.gz 2024-04-25T00:00:33.513 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.41194.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T00:00:33.513 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41194.log.gz 2024-04-25T00:00:33.514 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39048.log 2024-04-25T00:00:33.514 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49457.log.gz 2024-04-25T00:00:33.515 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40185.log 2024-04-25T00:00:33.516 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39048.log: gzip 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 88.6% -5 2024-04-25T00:00:33.516 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39048.log.gz --verbose 2024-04-25T00:00:33.516 INFO:teuthology.orchestra.run.smithi096.stderr: -- /var/log/ceph/ceph-client.admin.44609.log 2024-04-25T00:00:33.517 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40187.log 2024-04-25T00:00:33.517 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40185.log.gz 2024-04-25T00:00:33.518 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-04-25T00:00:33.518 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44609.log.gz 2024-04-25T00:00:33.519 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2024-04-25T00:00:33.519 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40187.log.gz 2024-04-25T00:00:33.520 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.33352.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz -5 2024-04-25T00:00:33.520 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.0.41847.log 2024-04-25T00:00:33.521 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45964.log 2024-04-25T00:00:33.521 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2024-04-25T00:00:33.522 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.41847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41847.log.gz 2024-04-25T00:00:33.522 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41884.log 2024-04-25T00:00:33.523 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40732.log 2024-04-25T00:00:33.523 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45964.log.gz 2024-04-25T00:00:33.523 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.41884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41884.log.gz 2024-04-25T00:00:33.524 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2024-04-25T00:00:33.525 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39862.log 2024-04-25T00:00:33.525 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40732.log.gz 2024-04-25T00:00:33.526 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43214.log 2024-04-25T00:00:33.526 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2024-04-25T00:00:33.527 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.39862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48976.log 2024-04-25T00:00:33.527 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39862.log.gz 2024-04-25T00:00:33.528 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46006.log 2024-04-25T00:00:33.528 INFO:teuthology.orchestra.run.smithi096.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43214.log.gz 2024-04-25T00:00:33.528 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48346.log 2024-04-25T00:00:33.529 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48976.log.gz 2024-04-25T00:00:33.529 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-04-25T00:00:33.530 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46006.log.gz 2024-04-25T00:00:33.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2024-04-25T00:00:33.531 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48346.log.gz 2024-04-25T00:00:33.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47513.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-04-25T00:00:33.531 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43823.log 2024-04-25T00:00:33.532 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-04-25T00:00:33.532 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2024-04-25T00:00:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45741.log 2024-04-25T00:00:33.533 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43823.log.gz 2024-04-25T00:00:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43046.log 2024-04-25T00:00:33.535 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-04-25T00:00:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45741.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45741.log.gz 2024-04-25T00:00:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43382.log 2024-04-25T00:00:33.536 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40180.log 2024-04-25T00:00:33.536 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43046.log.gz 2024-04-25T00:00:33.537 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43298.log 2024-04-25T00:00:33.537 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43382.log.gz 2024-04-25T00:00:33.538 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.40180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45029.log 2024-04-25T00:00:33.538 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40180.log.gz 2024-04-25T00:00:33.539 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48075.log 2024-04-25T00:00:33.539 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43298.log.gz 2024-04-25T00:00:33.540 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45029.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45029.log.gz 2024-04-25T00:00:33.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48075.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48075.log.gz 2024-04-25T00:00:33.606 INFO:teuthology.orchestra.run.smithi096.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T00:00:33.611 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-04-25T00:00:33.611 INFO:teuthology.orchestra.run.smithi096.stderr:real 0m0.410s 2024-04-25T00:00:33.611 INFO:teuthology.orchestra.run.smithi096.stderr:user 0m1.064s 2024-04-25T00:00:33.611 INFO:teuthology.orchestra.run.smithi096.stderr:sys 0m0.706s 2024-04-25T00:00:33.612 INFO:tasks.ceph:Archiving logs... 2024-04-25T00:00:33.612 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/remote/smithi096/log 2024-04-25T00:00:33.612 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T00:00:33.971 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/remote/smithi155/log 2024-04-25T00:00:33.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T00:00:34.165 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T00:00:34.271 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T00:00:34.271 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T00:00:34.279 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T00:00:34.423 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T00:00:34.668 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T00:00:34.668 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T00:00:34.674 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T00:00:34.720 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2024-04-25T00:00:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-04-25T00:00:34.730 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T00:00:34.730 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2024-04-25T00:00:34.730 INFO:teuthology.orchestra.run.smithi096.stdout:^- hv01.front.sepia.ceph.com 2 6 377 58 +905us[ +905us] +/- 579ms 2024-04-25T00:00:34.730 INFO:teuthology.orchestra.run.smithi096.stdout:^* hv02.front.sepia.ceph.com 3 6 377 60 +66us[ +62us] +/- 70ms 2024-04-25T00:00:34.730 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -53us[ -53us] +/- 73ms 2024-04-25T00:00:34.730 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T00:00:34.739 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T00:00:34.739 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-04-25T00:00:34.739 INFO:teuthology.orchestra.run.smithi155.stdout:^- hv01.front.sepia.ceph.com 2 6 377 59 +902us[ +900us] +/- 579ms 2024-04-25T00:00:34.739 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 +72us[ +70us] +/- 70ms 2024-04-25T00:00:34.739 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -43us[ -43us] +/- 73ms 2024-04-25T00:00:34.739 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T00:00:34.741 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T00:00:34.762 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T00:00:34.763 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T00:00:34.798 DEBUG:teuthology.orchestra.run.smithi096:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T00:00:35.000 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T00:00:35.167 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T00:00:35.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:00:35.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T00:00:35.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:00:35.355 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T00:00:35.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T00:00:35.433 INFO:teuthology.task.internal:Duration was 698.071764 seconds 2024-04-25T00:00:35.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T00:00:35.461 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T00:00:35.461 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T00:00:35.469 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T00:00:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T00:00:35.611 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T00:00:36.122 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T00:00:36.123 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T00:00:36.123 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T00:00:36.188 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T00:00:36.188 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T00:00:36.265 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T00:00:36.265 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T00:00:36.271 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T00:00:36.355 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T00:00:36.355 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T00:00:36.361 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T00:00:36.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T00:00:36.543 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T00:00:36.543 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T00:00:36.624 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T00:00:36.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T00:00:36.719 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T00:00:36.727 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T00:00:36.820 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-04-25T00:00:36.824 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-04-25T00:00:36.865 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T00:00:36.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:00:36.915 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T00:00:36.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:00:36.966 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T00:00:37.014 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T00:00:37.015 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/remote/smithi096 2024-04-25T00:00:37.015 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T00:00:37.107 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672222/remote/smithi155 2024-04-25T00:00:37.107 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T00:00:37.202 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T00:00:37.202 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T00:00:37.210 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T00:00:37.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T00:00:37.323 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T00:00:37.323 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T00:00:37.369 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T00:00:37.369 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T00:00:37.377 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T00:00:37.426 INFO:teuthology.orchestra.run.smithi096.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 00:00 /home/ubuntu/cephtest 2024-04-25T00:00:37.434 INFO:teuthology.orchestra.run.smithi155.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 00:00 /home/ubuntu/cephtest 2024-04-25T00:00:37.437 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T00:00:37.457 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T00:00:37.529 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} duration: 698.0717639923096 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T00:00:37.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T00:00:37.601 INFO:teuthology.run:pass